orinoco/things-enrichment-tools
Watch
5
0
Fork
You've already forked things-enrichment-tools
 1
Code Issues 3 Pull requests Packages Activity Actions

Juser scraper #6

Merged
adina merged 47 commits from juser into main 2026-07-24 12:16:27 +00:00
Conversation 8 Commits 47 Files changed 3 +890 -1

2026-07-24

Adina Wagner
add brief documentation
8b2ff59f20
2026-07-24 14:05:36 +02:00
Adina Wagner
fix try except clause
7b66188ba9
2026-07-24 13:15:46 +02:00
Adina Wagner
RF and reuse glitching safeguard
2c08f69aaf
2026-07-24 11:04:15 +02:00
Adina Wagner
retry journal lookup when xml download is glitchy
13e46451d0
2026-07-24 10:56:59 +02:00
Adina Wagner
only submit updated or new publications
c92f7a1bfd
2026-07-24 10:56:11 +02:00
Adina Wagner
Fix annotation terms
ba2ccbdaa8
2026-07-24 10:55:36 +02:00
Adina Wagner
allow look-ups based on JulID and update person records if new identifiers are found
36f7423f8a
2026-07-24 10:55:00 +02:00
Adina Wagner
fix: default to string, not None
bcb71ecb00
2026-07-24 10:53:59 +02:00
Adina Wagner
remove left-over debug-debris
13f085972e
2026-07-24 10:52:52 +02:00

2026-07-23

Adina Wagner
clean up debugging residue
c4c5ea8d5f
2026-07-23 15:09:00 +02:00
Adina Wagner
Fix: Check also capitalized dois (e.g., ZENODO)
1ce2ef9a2d
2026-07-23 15:08:37 +02:00
Adina Wagner
Fix: don't create duplicate author entries
d209e1ba26
2026-07-23 15:08:04 +02:00
Adina Wagner
refactor and restructure records 
source document: https://hedgedoc.psychoinformatics.de/3cSouq0YSJ6m64_ArWpJEg?view
d17c03e83d
2026-07-23 14:01:50 +02:00

2026-07-17

Adina Wagner
no license lookup
27d5152395
2026-07-17 15:27:53 +02:00
Adina Wagner
safeguard doi lookup
c4f1e690e6
2026-07-17 15:27:33 +02:00
Adina Wagner
add pof4 neuroimaging 
its not relevant for us strictly, but publications often
use it nevertheless
ee48f9bdf0
2026-07-17 06:18:18 +02:00
Adina Wagner
fix: keynames
46f6216e24
2026-07-17 06:17:08 +02:00
Adina Wagner
fix: only add funding if info is available
10414ac754
2026-07-17 06:16:39 +02:00
Adina Wagner
fix example
20eb78bfe7
2026-07-17 06:15:42 +02:00

2026-07-02

Adina Wagner
fix: actually look up date
b0160d934e
2026-07-02 15:09:02 +02:00
Adina Wagner
light linting
4cd657d386
2026-07-02 15:08:48 +02:00
Adina Wagner
WIP: actually print records
36ed29dc1e
2026-07-02 14:40:48 +02:00
Adina Wagner
fix: retrieve pid, not entire record
b8075279af
2026-07-02 14:33:32 +02:00
Adina Wagner
WIP: for testing, dump records as jsonlines
e21c9c63eb
2026-07-02 14:19:49 +02:00
Adina Wagner
add generated_by to publication record
821ea6ca33
2026-07-02 14:19:10 +02:00
Adina Wagner
Save author name as display_name
bfbad024a1
2026-07-02 09:20:07 +02:00
Adina Wagner
Split into protected and public submission cache
9e323f60e4
2026-07-02 09:04:23 +02:00

2026-07-01

Adina Wagner
Create proper new person records
e673268435
2026-07-01 21:52:10 +02:00
Adina Wagner
fix: remove creator conditional from orcid processing 
the majority of psyinf records to not have such
a key in their orcid identifier dict
f9e9e5fb19
2026-07-01 21:45:32 +02:00
Adina Wagner
Fix: find ORCIDs irrespective of casing
997088426b
2026-07-01 21:44:34 +02:00
Adina Wagner
CI: Scrape-user workflow
0a56c75b53
2026-07-01 20:37:15 +02:00
Adina Wagner
add brief documentation string
3900ece247
2026-07-01 20:36:53 +02:00
Adina Wagner
towards Publication records
b39521b23c
2026-07-01 20:24:21 +02:00
Adina Wagner
Refactor to object-oriented style
64c1c50e43
2026-07-01 08:45:54 +02:00