orinoco/things-enrichment-tools
Watch
5
0
Fork
You've already forked things-enrichment-tools
 1
Code Issues 3 Pull requests Packages Activity Actions
Assorted tools for enriching Thing-based metadata records with machine-retrievable information from 3rd-party services
34 commits 4 branches 0 tags 543 KiB
  • Python 100%
Find a file
Exact
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Adina Wagner dcfcceda15 Doc: document machine-annotation patterns and conventions
2026-08-03 15:46:12 +02:00
.forgejo/workflows allow calendar scraping also on dispatch 2026-08-03 13:51:29 +02:00
docs Doc: document machine-annotation patterns and conventions 2026-08-03 15:46:12 +02:00
tools Rewrite calendar scraper to comply to new machine-annotation schema 2026-08-03 13:46:36 +02:00
README.md Juser scraper (#6) 2026-07-24 12:16:26 +00:00

README.md

Knowledge Enrichment

This repository hosts tools and workflows to enrich dumpthings knowledge pools with additional machine-generated records.

available tools

  • tools/scrape-calendar.py (used by .forgejo/workflows/scrape.yml): scrapes three FZJ funding calendars and adds their events as XYZCompetition records (research information scheme)
  • tools/enrich-via-doi.py (used by .forgejo/workflows/enrich_publications.yml): reads publication records and extends them with external metadata available via doi.org content negotiation
  • tools/get-depiction-urls.py (used by the 'from-model'-websites, e.g., https://hub.psychoinformatics.de/www/www-from-model/src/branch/main/.forgejo/workflows/register-depictions.yaml): Given metadata input, this script extracts download URLs for each Depiction of the record, provided the depiction has a kind included in the depiction-type argument. For each depiction distribution, it will output the record curie, the file extension and the url, to stdout.
  • tools/scrape-juser.py (used by .forgejo/workflows/scrape-juser.yml): Given an xml export of publications in MARC21 format as provided by Juser (juser.fz-juelich.de), as well as a local cache of XYZPerson and XYZPublication records, this script generates new or updates existing Publication and Person records. Person records are submitted into a 'protected' inbox, whereas Publication records are submitted into a 'public' inbox.