Add dynamic configuration #206
2026-06-12
add test for unicode IRI handling
All checks were successful
Test execution / Test-all (push) Successful in 2m12s
addapt
dump-things-pid-check to the new structure
Adapt the code of `dump-things-pid-check` to the dynamic configuration changes.
ensure that record-dir config files are created
If a record-dir backend is created on a directory, check if the config file exists, if not write it.
add compatibility check for git audit directories
Add code to check whether the directory specified int the git-audit configuration is either non-existing, empty, or compatible with git-audit.
replace
schema-attribute in pydantic-objects
Replaces the `schema`-attribute with the attribute `schema_location`. That prevents shadowing of pydantic's internal `schema`-attribute and gets rid of pydantic-issues warnings.
return admin_token in test fixture
The test-fixture `fast_api_simple` now returns a tuple containing: - test_client instance - store path - admin token
improve incoming-path verification
Verify that incoming paths exist when a collection is created a token has write-access to the collection. Checks that incoming-label is set for the token. Add tests for incoming path validation.
handle configuration file structure failures
Do not allow unknown keys in configuration files. Add a test for structure error detection.
add test for config file error detection
Test that errors in the format of the configuration file are caught and converted to `ConfigError`.
improve configuration processing
Add scanner error detection to configuration loading. Raise an error if the configuration YAML-file cannot be loaded. Detect and reject token definitions with write permissions and without incoming-labels or write access for collections that do not define an incoming directory. Rename `get_permissions` to `get_token_permissions`
fix default token name setting in config conversion
Use the correct token names, when converting version 1 configuration files to version 2 configuration files.
add
--admin-token-hash, remove --admin-token
This commit removes the option `--admin-token` and adds the option `--admin-token-hash`, which accepts a hashed token (sha256 in 64-digits hex representation).
add collection configuration checks
Check the following two conditions when new collections are created: 1. the name of the collection is not a reserved name. 2. collections do not share incoming or curated directories with other collections. This is done to prevent data leaks, which could happen when different collections share directories.
fix tests
Remove schema-definitions from sqlite-backend configuration. Use empty dicitionary as default for Configuration.admin_tokens.
add the dump-things-load-config command
Add a command that interprets configuration files and creates the objects defined in the configuration file in a service. This command can be used to migrate from old dump-things server to new dump-things server, when the option --old-format is used. Note that there are a few differences between the old and the new format: 1. Keys in `tokens` are now token names, that map to token configurations. 2. Token configurations now contain the additional attributes `representation` and `hashed`. 3. `schema` is now an attribute of a collection. It is removed from sqlite backend configurations.
use hashed admin token representations
When adding the plain admin token `t` via `/admin_tokens`, `AdminTokenRequest.representation` must contain `hash_token_representation(t)`. The value of `AdminTokenRequest.representation` is checked for the correct pattern (a 40-digit hex number) and stored verbatim in the configuration. To authenticate an administrator, the token provided in the `x-dumpthings-token`-header is hashed and compared to the stored values of `AdminTokenRequest.representation`.
adapt collection- and token-managing tests
Test that endpoints of deleted collections are removed from the openapi documentation and generate 404-errors when accessed. Adapt token listing test to the modified token result structure, which does not contain the token representation anymore.
hash admin-token representation by default
By default the admin-token representation is hashed. That means the request should contain the plain token, unless the request-attribute `hashed` is set. In this case, the `POST /admin-tokens` endpoint assumes that the representation is already hashed. It will perform a simple syntax verification to assure that the representation is a 40-digit hex number.
ensure that api-doc tags are deleted
When a collection is deleted, the collection specific openapi doc tags are deleted as well.
add tag_info generation
Ensure that generated endpoints are tagged and sorted correctly in the openapi docs.
add explicit admin-token endpoints
Handle admin tokens seperately from the traditional token handling