[WIP] add possibility for generating zstd-compressed tarballs #60

bedroge · 2025-08-08T15:31:14Z

Still WIP, requires updated build node images EESSI/filesystem-layer#237, and requires a change in the bot scripts to provide a tarball filename with a .zst extension.

edit: could also stick to zstd automatically if it's available, but since we do provide that filename, you get a sort of unpredictable behavior.

bedroge · 2025-08-08T15:37:50Z

Just making sure that I didn't break anything yet for gzipped tarballs...

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:x86_64/amd/zen2

eessi-bot-aws · 2025-08-08T15:37:55Z

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2025.08/pr_60/81562

date	job status	comment
Aug 08 15:37:54 UTC 2025	submitted	job id `81562` awaits release by job manager
Aug 08 15:38:32 UTC 2025	released	job awaits launch by Slurm scheduler
Aug 08 15:39:46 UTC 2025	running	job `81562` is running
Aug 08 15:44:36 UTC 2025	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-81562.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts No artefacts were created or found.
Aug 08 15:44:36 UTC 2025	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:x86_64_amd_zen2+default P: perf: 432.01 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:x86_64_amd_zen2+default P: perf: 419.713 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /775175bf @BotBuildTests:x86_64_amd_zen2+default P: latency: 1.86 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /52707c40 @BotBuildTests:x86_64_amd_zen2+default P: latency: 1.89 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /b1aacda9 @BotBuildTests:x86_64_amd_zen2+default P: latency: 4.02 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /c6bad193 @BotBuildTests:x86_64_amd_zen2+default P: latency: 4.14 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:x86_64_amd_zen2+default P: latency: 0.63 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:x86_64_amd_zen2+default P: latency: 0.6 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:x86_64_amd_zen2+default P: bandwidth: 7383.75 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:x86_64_amd_zen2+default P: bandwidth: 7301.31 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-81562.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

Error:

tar: /eessi_bot_job/eessi-2023.06-software-linux-x86_64-amd-zen2-17546675870.tar.gz: Cannot stat: No such file or directory

bedroge · 2025-08-08T19:11:37Z

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:x86_64/amd/zen2

eessi-bot-aws · 2025-08-08T19:11:42Z

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2025.08/pr_60/81564

date	job status	comment
Aug 08 19:11:41 UTC 2025	submitted	job id `81564` awaits release by job manager
Aug 08 19:12:36 UTC 2025	released	job awaits launch by Slurm scheduler
Aug 08 19:17:38 UTC 2025	running	job `81564` is running
Aug 08 19:22:43 UTC 2025	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-81564.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-17546806890.tar.gz` size: 0 MiB (74046 bytes) entries: 79 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `cowsay/3.04.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `cowsay/3.04` reprod directories under 2023.06/software/linux/x86_64/amd/zen2/reprod no reprod directories in tarball other under 2023.06/software/linux/x86_64/amd/zen2 no other files in tarball
Aug 08 19:22:43 UTC 2025	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:x86_64_amd_zen2+default P: perf: 439.868 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:x86_64_amd_zen2+default P: perf: 444.017 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /775175bf @BotBuildTests:x86_64_amd_zen2+default P: latency: 1.8 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /52707c40 @BotBuildTests:x86_64_amd_zen2+default P: latency: 1.89 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /b1aacda9 @BotBuildTests:x86_64_amd_zen2+default P: latency: 3.89 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /c6bad193 @BotBuildTests:x86_64_amd_zen2+default P: latency: 4.04 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:x86_64_amd_zen2+default P: latency: 0.56 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:x86_64_amd_zen2+default P: latency: 0.54 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:x86_64_amd_zen2+default P: bandwidth: 7215.38 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:x86_64_amd_zen2+default P: bandwidth: 7079.11 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-81564.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

bedroge · 2025-08-26T13:09:03Z

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2

eessi-bot-aws · 2025-08-26T13:09:08Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2023.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.08/pr_60/85605

date	job status	comment
Aug 26 13:09:07 UTC 2025	submitted	job id `85605` awaits release by job manager
Aug 26 13:09:34 UTC 2025	released	job awaits launch by Slurm scheduler
Aug 26 13:17:41 UTC 2025	running	job `85605` is running
Aug 26 13:40:33 UTC 2025	finished	🤷 UNKNOWN (click triangle for detailed information) Job results file `_bot_job85605.result` does not exist in job directory or reading it failed. No artefacts were found/reported.
Aug 26 13:40:33 UTC 2025	test result	🤷 UNKNOWN (click triangle for detailed information) Job test file `_bot_job85605.test` does not exist in job directory or reading it failed.

eessi-bot-aws · 2025-08-26T13:09:12Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.08/pr_60/85606

date	job status	comment
Aug 26 13:09:11 UTC 2025	submitted	job id `85606` awaits release by job manager
Aug 26 13:09:32 UTC 2025	released	job awaits launch by Slurm scheduler
Aug 26 13:15:37 UTC 2025	running	job `85606` is running
Aug 26 13:40:32 UTC 2025	finished	🤷 UNKNOWN (click triangle for detailed information) Job results file `_bot_job85606.result` does not exist in job directory or reading it failed. No artefacts were found/reported.
Aug 26 13:40:32 UTC 2025	test result	🤷 UNKNOWN (click triangle for detailed information) Job test file `_bot_job85606.test` does not exist in job directory or reading it failed.

bedroge · 2025-08-26T13:39:51Z

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2

eessi-bot-aws · 2025-08-26T13:39:57Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2023.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.08/pr_60/85607

date	job status	comment
Aug 26 13:39:56 UTC 2025	submitted	job id `85607` awaits release by job manager
Aug 26 13:40:31 UTC 2025	released	job awaits launch by Slurm scheduler
Aug 26 13:41:37 UTC 2025	running	job `85607` is running
Aug 26 13:44:42 UTC 2025	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-85607.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-17562156880.tar.gz` size: 0 MiB (74875 bytes) entries: 79 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `cowsay/3.04.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `cowsay/3.04` reprod directories under 2023.06/software/linux/x86_64/amd/zen2/reprod no reprod directories in tarball other under 2023.06/software/linux/x86_64/amd/zen2 no other files in tarball
Aug 26 13:44:42 UTC 2025	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:x86_64_amd_zen2+default P: perf: 434.706 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:x86_64_amd_zen2+default P: perf: 431.443 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /775175bf @BotBuildTests:x86_64_amd_zen2+default P: latency: 1.81 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /52707c40 @BotBuildTests:x86_64_amd_zen2+default P: latency: 1.85 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /b1aacda9 @BotBuildTests:x86_64_amd_zen2+default P: latency: 4.02 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /c6bad193 @BotBuildTests:x86_64_amd_zen2+default P: latency: 4.17 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:x86_64_amd_zen2+default P: latency: 0.6 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:x86_64_amd_zen2+default P: latency: 0.56 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:x86_64_amd_zen2+default P: bandwidth: 7434.62 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:x86_64_amd_zen2+default P: bandwidth: 7180.52 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-85607.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

eessi-bot-aws · 2025-08-26T13:40:02Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.08/pr_60/85608

date	job status	comment
Aug 26 13:40:01 UTC 2025	submitted	job id `85608` awaits release by job manager
Aug 26 13:40:29 UTC 2025	released	job awaits launch by Slurm scheduler
Aug 26 13:41:38 UTC 2025	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-85608.out` ✅ no message matching `FATAL:` ❌ found message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2025.06-software-linux-x86_64-amd-zen2-17562156380.tar.gz` size: 0 MiB (45 bytes) entries: 0 modules under 2025.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2025.06/software/linux/x86_64/amd/zen2/software no software packages in tarball reprod directories under 2025.06/software/linux/x86_64/amd/zen2/reprod no reprod directories in tarball other under 2025.06/software/linux/x86_64/amd/zen2 no other files in tarball
Aug 26 13:41:38 UTC 2025	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite was not run, test step itself failed to execute. Details ✅ job output file `slurm-85608.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

…std_tarballs

bedroge · 2025-08-26T13:47:13Z

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2

eessi-bot-aws · 2025-08-26T13:47:19Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2023.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.08/pr_60/85609

date	job status	comment
Aug 26 13:47:18 UTC 2025	submitted	job id `85609` awaits release by job manager
Aug 26 13:47:48 UTC 2025	released	job awaits launch by Slurm scheduler
Aug 26 13:48:50 UTC 2025	running	job `85609` is running
Aug 26 13:51:58 UTC 2025	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-85609.out` ✅ no message matching `FATAL:` ❌ found message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-17562161250.tar.gz` size: 0 MiB (74811 bytes) entries: 79 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `cowsay/3.04.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `cowsay/3.04` reprod directories under 2023.06/software/linux/x86_64/amd/zen2/reprod no reprod directories in tarball other under 2023.06/software/linux/x86_64/amd/zen2 no other files in tarball
Aug 26 13:51:58 UTC 2025	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:x86_64_amd_zen2+default P: perf: 438.732 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:x86_64_amd_zen2+default P: perf: 442.031 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /775175bf @BotBuildTests:x86_64_amd_zen2+default P: latency: 1.83 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /52707c40 @BotBuildTests:x86_64_amd_zen2+default P: latency: 1.88 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /b1aacda9 @BotBuildTests:x86_64_amd_zen2+default P: latency: 4.65 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /c6bad193 @BotBuildTests:x86_64_amd_zen2+default P: latency: 4.14 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:x86_64_amd_zen2+default P: latency: 0.67 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:x86_64_amd_zen2+default P: latency: 0.58 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:x86_64_amd_zen2+default P: bandwidth: 7380.25 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:x86_64_amd_zen2+default P: bandwidth: 7229.99 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-85609.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

eessi-bot-aws · 2025-08-26T13:47:23Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.08/pr_60/85610

date	job status	comment
Aug 26 13:47:22 UTC 2025	submitted	job id `85610` awaits release by job manager
Aug 26 13:47:45 UTC 2025	released	job awaits launch by Slurm scheduler
Aug 26 13:48:51 UTC 2025	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-85610.out` ✅ no message matching `FATAL:` ❌ found message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2025.06-software-linux-x86_64-amd-zen2-17562160740.tar.gz` size: 0 MiB (45 bytes) entries: 0 modules under 2025.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2025.06/software/linux/x86_64/amd/zen2/software no software packages in tarball reprod directories under 2025.06/software/linux/x86_64/amd/zen2/reprod no reprod directories in tarball other under 2025.06/software/linux/x86_64/amd/zen2 no other files in tarball
Aug 26 13:48:51 UTC 2025	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite was not run, test step itself failed to execute. Details ✅ job output file `slurm-85610.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

bedroge · 2025-08-26T13:51:11Z

Building for two versions at the same time doesn't work.

bedroge · 2025-08-26T13:51:43Z

bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2

eessi-bot-aws · 2025-08-26T13:51:50Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.08/pr_60/85611

date	job status	comment
Aug 26 13:51:49 UTC 2025	submitted	job id `85611` awaits release by job manager
Aug 26 13:51:57 UTC 2025	released	job awaits launch by Slurm scheduler
Aug 26 13:53:00 UTC 2025	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-85611.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2025.06-software-linux-x86_64-amd-zen2-17562163470.tar.gz` size: 0 MiB (110802 bytes) entries: 92 modules under 2025.06/software/linux/x86_64/amd/zen2/modules/all `cowsay/3.04.lua` software under 2025.06/software/linux/x86_64/amd/zen2/software `cowsay/3.04` reprod directories under 2025.06/software/linux/x86_64/amd/zen2/reprod `cowsay/3.04/20250826_135221UTC` other under 2025.06/software/linux/x86_64/amd/zen2 no other files in tarball
Aug 26 13:53:00 UTC 2025	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite was not run, test step itself failed to execute. Details ✅ job output file `slurm-85611.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

bedroge · 2025-08-26T13:57:54Z

bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2

eessi-bot-aws · 2025-08-26T13:58:00Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.08/pr_60/85612

date	job status	comment
Aug 26 13:57:59 UTC 2025	submitted	job id `85612` awaits release by job manager
Aug 26 13:58:03 UTC 2025	released	job awaits launch by Slurm scheduler
Aug 26 13:59:04 UTC 2025	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-85612.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts No artefacts were created or found.
Aug 26 13:59:04 UTC 2025	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite was not run, test step itself failed to execute. Details ✅ job output file `slurm-85612.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

bedroge · 2025-08-26T14:03:41Z

bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2

eessi-bot-aws · 2025-08-26T14:03:47Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.08/pr_60/85613

date	job status	comment
Aug 26 14:03:45 UTC 2025	submitted	job id `85613` awaits release by job manager
Aug 26 14:04:07 UTC 2025	released	job awaits launch by Slurm scheduler
Aug 26 14:05:09 UTC 2025	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-85613.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.* created!` Artefacts `eessi-2025.06-software-linux-x86_64-amd-zen2-17562170790.tar.zst` size: 0 MiB (67556 bytes) entries: 0 modules under 2025.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2025.06/software/linux/x86_64/amd/zen2/software no software packages in tarball reprod directories under 2025.06/software/linux/x86_64/amd/zen2/reprod no reprod directories in tarball other under 2025.06/software/linux/x86_64/amd/zen2 no other files in tarball
Aug 26 14:05:09 UTC 2025	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite was not run, test step itself failed to execute. Details ✅ job output file `slurm-85613.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

bedroge · 2025-08-26T14:18:57Z

Just one small issue left, the tarball overview is not created because of:

$ tar tf eessi-2025.06-software-linux-x86_64-amd-zen2-17562170790.tar.zst 
tar: This does not look like a tar archive
tar: Skipping to next header
tar: Exiting with failure status due to previous errors

$ tar --version
tar (GNU tar) 1.30

$ zstd --version
*** zstd command line interface 64-bits v1.4.4, by Yann Collet ***

On my laptop it works fine:

$ tar tf eessi-2025.06-software-linux-x86_64-amd-zen2-17562170790.tar.zst  | head -n 3
2025.06/software/linux/x86_64/amd/zen2/modules/all/cowsay/3.04.lua
2025.06/software/linux/x86_64/amd/zen2/modules/tools/cowsay/3.04.lua
2025.06/software/linux/x86_64/amd/zen2/software/cowsay/3.04/

$ tar --version
tar (GNU tar) 1.35

$ zstd --version
*** Zstandard CLI (64-bit) v1.5.6, by Yann Collet ***

For some reason $ tar --use-compress-program=zstd -tf does work fine, though I wanted to avoid being explicit about the compression method. There's also an -a/--auto-compress option, which works fine for creating the tarball, but does not work for -t...

bedroge added 2 commits August 8, 2025 17:28

add possibility for generating zstd-compressed tarballs

3b8f6f5

add dummy easystack for testing

460cd1d

use correct options for tar command

0ba48f7

use tar's auto-compress option

f4e9fef

use correct var name

a9baa42

bedroge added 2 commits August 26, 2025 15:46

dummy easystack for 2025.06

55aacf6

Merge branch 'main' of github.com:EESSI/software-layer-scripts into z…

d00a90b

…std_tarballs

remove 2023.06 easystack

eeec4da

use zst instead of gz for tarballs

f9727e8

search for any kind of (compressed) tarball

fc5d5ad

bedroge mentioned this pull request Aug 26, 2025

only filter Autotools & co (build) dependencies for EESSI 2023.06 #74

Draft

[WIP] add possibility for generating zstd-compressed tarballs #60

Are you sure you want to change the base?

[WIP] add possibility for generating zstd-compressed tarballs #60

Uh oh!

Conversation

bedroge commented Aug 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bedroge commented Aug 8, 2025

Uh oh!

eessi-bot-aws bot commented Aug 8, 2025 • edited by bedroge Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bedroge commented Aug 8, 2025

Uh oh!

eessi-bot-aws bot commented Aug 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bedroge commented Aug 26, 2025

Uh oh!

eessi-bot-aws bot commented Aug 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-aws bot commented Aug 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bedroge commented Aug 26, 2025

Uh oh!

eessi-bot-aws bot commented Aug 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-aws bot commented Aug 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bedroge commented Aug 26, 2025

Uh oh!

eessi-bot-aws bot commented Aug 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-aws bot commented Aug 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bedroge commented Aug 26, 2025

Uh oh!

bedroge commented Aug 26, 2025

Uh oh!

eessi-bot-aws bot commented Aug 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bedroge commented Aug 26, 2025

Uh oh!

eessi-bot-aws bot commented Aug 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bedroge commented Aug 26, 2025

Uh oh!

eessi-bot-aws bot commented Aug 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bedroge commented Aug 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

bedroge commented Aug 8, 2025 •

edited

Loading

eessi-bot-aws bot commented Aug 8, 2025 •

edited by bedroge

Loading

eessi-bot-aws bot commented Aug 8, 2025 •

edited

Loading

eessi-bot-aws bot commented Aug 26, 2025 •

edited

Loading

eessi-bot-aws bot commented Aug 26, 2025 •

edited

Loading

eessi-bot-aws bot commented Aug 26, 2025 •

edited

Loading

eessi-bot-aws bot commented Aug 26, 2025 •

edited

Loading

eessi-bot-aws bot commented Aug 26, 2025 •

edited

Loading

eessi-bot-aws bot commented Aug 26, 2025 •

edited

Loading

eessi-bot-aws bot commented Aug 26, 2025 •

edited

Loading

eessi-bot-aws bot commented Aug 26, 2025 •

edited

Loading

eessi-bot-aws bot commented Aug 26, 2025 •

edited

Loading

bedroge commented Aug 26, 2025 •

edited

Loading