Unable to rerun containerized workflow with Docker 27 #27

New issue

Open

opened 2025-02-05 19:10:28 +00:00 by mslw · 0 comments

mslw commented

2025-02-05 19:10:28 +00:00

(Migrated from github.com)

Running datalad rerun results-containerized with Docker version 27.5.1 produces the following error after the download is complete (ellipsis used to remove non-essential parts). The docker image is loaded, but the ID does not match DataLad's expectation:

[INFO] == Command start (output follows) =====
[ERROR] Failed to execute ['(...)datalad_container\\adapters\\docker.py', 'run', 'container/image', 'sh', '-c', 'mkdir /tmp/dockertmp; HOME=/tmp/dockertmp make -f Docker-Makefile clean results_def.tex && rm -rf /tmp/dockertmp']
(...)
RuntimeError: docker image sha256:f881bd4db45ac9775f5a5377485a7c939fea4685d7482eed4809cb83fc3b51a3 was not successfully loaded
[INFO] == Command exit (modification check follows) =====

This seems specific to Docker 27 (currently the latest version). It was observed and confirmed only on Windows, but likely affects other operating systems. With Docker 26, things reportedly work fine.

The probable cause is discussed in datalad/datalad-container#269. At this point, a workaround would be to either downgrade docker to v26, or to run a patched version of datalad-container from a pull request linked in that issue.

The issue was first reported by Lisa W., who AFAIK is not on GitHub.

Running `datalad rerun results-containerized` with Docker version 27.5.1 produces the following error after the download is complete (ellipsis used to remove non-essential parts). The docker image is loaded, but the ID does not match DataLad's expectation: ``` [INFO] == Command start (output follows) ===== [ERROR] Failed to execute ['(...)datalad_container\\adapters\\docker.py', 'run', 'container/image', 'sh', '-c', 'mkdir /tmp/dockertmp; HOME=/tmp/dockertmp make -f Docker-Makefile clean results_def.tex && rm -rf /tmp/dockertmp'] (...) RuntimeError: docker image sha256:f881bd4db45ac9775f5a5377485a7c939fea4685d7482eed4809cb83fc3b51a3 was not successfully loaded [INFO] == Command exit (modification check follows) ===== ``` This seems specific to Docker 27 (currently the latest version). It was observed and confirmed only on Windows, but likely affects other operating systems. With Docker 26, things reportedly work fine. The probable cause is discussed in datalad/datalad-container#269. At this point, a workaround would be to either downgrade docker to v26, or to run a patched version of `datalad-container` from a pull request linked in that issue. The issue was first reported by Lisa W., who AFAIK is not on GitHub.