How to build

[kincl]

Clone both containers-libs and podman

git clone https://github.com/containers/podman.git

cd podman
echo "replace go.podman.io/storage => github.com/redhat-hpc/container-libs/storage feat-erofs" >> go.mod
make vendor
make bin/podman

Create storage.conf at $HOME/.config/containers/storage.conf

[storage]
driver = "overlay"

[storage.options.overlay]
use_erofs = "true"
erofs_force_ids = "false"

[kincl]

New branch based on newer version of c/storage with a focus on both erofs and squashfs

Clone podman, same as above.

echo "replace go.podman.io/storage => github.com/redhat-hpc/container-libs/storage new-imagefs-method" >> go.mod
make vendor
make bin/podman

storage.conf is different:

[storage]
driver = "overlay"

[storage.options.overlay]
mount_program = "/usr/bin/fuse-overlayfs"
force_mask = "700"
image_fs_type = "squashfs" # or erofs
#image_fs_create_command = "tar2sqfs {{.ImagePath}}" # optional way to specify the image create command

podman info shows what the commands are:

...
store:
  graphDriverName: overlay
  graphOptions:
    overlay.force_mask: "700"
    overlay.image_fs_type: erofs
...
  graphStatus:
    Backing Filesystem: xfs
    Imagefs create command: mkfs.erofs --tar=f -z lz4 {{.ImagePath}} {{.Tarball}}
    Imagefs mount program: erofsfuse
...

Test Slurm job I have been using:

#!/bin/bash
#SBATCH --nodes=5
#SBATCH --ntasks-per-node=1
#SBATCH --partition=debug

set +x

export XDG_RUNTIME_DIR="/tmp/run"
mkdir -p $XDG_RUNTIME_DIR
$HOME/containers/podman/bin/podman pull --runroot /tmp/run --root /tmp/root --imagestore /shared/store busybox

srun --ntasks=5 --ntasks-per-node=1 bash -c '
rm -rf /tmp/run /tmp/root
mkdir /tmp/run /tmp/root
$HOME/containers/podman/bin/podman run --runroot /tmp/run --root /tmp/root --imagestore /shared/store --env-host --rm busybox /bin/sh -c "echo hello world from $SLURMD_NODENAME"
'