add hook that copies the easybuild subdirectory of every installation to a central reprod directory

[bedroge]

This implements two hooks that will improve the reproducibility of a stack: one that copies missing patches from extensions to $installdir/easybuild, and one that copies the entire $installdir/easybuild to stack_root/reprod/app_name/app_version/timestamp/.

See https://gitlab.com/eessi/support/-/issues/145#note_2437292887 for more details.

Still WIP, also because the post_easyblock_hook is not available yet and will be part of the next release (EB 5.1.1).

[bedroge]

This should work now, but it needs a new EB release as it depends on easybuilders/easybuild-framework#4938 and easybuilders/easybuild-framework#4939.

[bedroge]

Still needs EESSI/software-layer#1135 to be ingested first.

[ocaisa]

Looks good, just a tiny change needed

[ocaisa]

@bedroge Can you add a temporary test build here to make sure this is working as expected?

[bedroge]

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-jsc architecture:aarch64/nvidia/grace

[eessi-bot-jsc]

New job on instance eessi-bot-jsc for CPU micro-architecture aarch64-nvidia-grace for repository eessi.io-2023.06-software in job dir /p/project1/ceasybuilders/eessibot/jobs/2025.07/pr_24/13867218

date	job status	comment
Jul 08 15:49:54 UTC 2025	submitted	job id 13867218 awaits release by job manager
Jul 08 15:50:27 UTC 2025	released	job awaits launch by Slurm scheduler
Jul 08 15:51:32 UTC 2025	running	job 13867218 is running
Jul 08 15:54:45 UTC 2025	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file slurm-13867218.out ✅ no message matching FATAL: ✅ no message matching ERROR: ✅ no message matching FAILED: ✅ no message matching required modules missing: ✅ found message(s) matching No missing installations ✅ found message matching .tar.gz created! Artefacts eessi-2023.06-software-linux-aarch64-nvidia-grace-17519899910.tar.gz size: 0 MiB (90034 bytes) entries: 80 modules under 2023.06/software/linux/aarch64/nvidia/grace/modules/all cowsay/3.04.lua software under 2023.06/software/linux/aarch64/nvidia/grace/software cowsay/3.04 other under 2023.06/software/linux/aarch64/nvidia/grace 2023.06/init/easybuild/eb_hooks.py
Jul 08 15:54:45 UTC 2025	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite was not run, test step itself failed to execute. Details ✅ job output file slurm-13867218.out ❌ found message matching ERROR: ✅ no message matching [\s*FAILED\s*].*Ran .* test case

[bedroge]

@bedroge Can you add a temporary test build here to make sure this is working as expected?

Done for 2023.06. We can't test it for 2025.06 yet, as we first need to have some scripts and a module file in place.

[bedroge]

If you'd really like to test 2025.06 as well, we should first deploy+merge #30.

[ocaisa]

It doesn't seem to work? No reprod directory in the tarball...

[bedroge]

It doesn't seem to work? No reprod directory in the tarball...

I've disabled the hook for EESSI version 2023.06, as I didn't see much value in only doing that for new builds (we will have an incomplete reprod dir). On the other hand, it doesn't do any harm, so we could enable it?

(edit: the dummy build was just to prove that it doesn't break anything for 2023.06).

[ocaisa]

Argh, sorry, wasn't paying enough attention