House-keeping: Remove competitions with an application deadline in the past? #10

Open
opened 2026-08-03 11:14:54 +00:00 by adina · 0 comments
Owner

This repo is somewhat suboptimal, but there is no better fitting alternative at the moment: When fixing the competition calendar scraping to follow the new record layout (#9), I also looked through fixing up old records. At the moment, the pool simply collects funding records, but never cleans them up - so anyone searching for competition records in the pool will see dozens of outdated competitions.

How do we handle this? Should "outdated" records be removed?

A reason against removal is that the outdated records may still be needed, once other records (e.g., concrete applications) link them. It may still be informative to know which past competition call was the basis for a project application, and later also project. (I will remove outdated records for now simply because a) I know that they are not yet linked to anything and b) because they follow an outdated record pattern, but for future records, this argument is very relevant.)

But without the removal, with lots of "clutter" from outdated competitions, the pool is not a good place to search for funding. It would either need specific filtering, e.g. based on application deadline, from the pool itself, or a downstream consumer (e.g., matrix bot, website) would need to do the filtering.

This repo is somewhat suboptimal, but there is no better fitting alternative at the moment: When fixing the competition calendar scraping to follow the new record layout (#9), I also looked through fixing up old records. At the moment, the pool simply collects funding records, but never cleans them up - so anyone searching for competition records in the pool will see dozens of outdated competitions. How do we handle this? Should "outdated" records be removed? A reason against removal is that the outdated records may still be needed, once other records (e.g., concrete applications) link them. It may still be informative to know which past competition call was the basis for a project application, and later also project. (I **will** remove outdated records for now simply because a) I know that they are not yet linked to anything and b) because they follow an outdated record pattern, but for future records, this argument is very relevant.) But without the removal, with lots of "clutter" from outdated competitions, the pool is not a good place to search for funding. It would either need specific filtering, e.g. based on application deadline, from the pool itself, or a downstream consumer (e.g., matrix bot, website) would need to do the filtering.
Sign in to join this conversation.
No labels
No milestone
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
orinoco/things-enrichment-tools#10
No description provided.