Skip to content

[Issue] Jax test fails: ASan runtime not first in library list  #6210

Description

@TriveniTadapaneni

Context

  • Workflow: multi_arch_release_linux_jax_wheels.yml (ROCm/rockrel)
  • Failing run: Run 28355352077 (2026-06-29)
  • Platform: Linux
  • Impacted Python versions: 3.11, 3.12, 3.13, 3.14
  • JAX refs: rocm-jaxlib-v0.9.1, rocm-jaxlib-v0.10.0
  • Suspected Root cause commit: TheRock 66e7f19

Error

All 8 test matrix jobs fail at the first sanity check before any pytest runs:

+ python -c 'import jax; print(jax.local_devices())'
==747==ASan runtime does not come first in initial library list; you should either link runtime to your application or manually preload it with LD_PRELOAD.
##[error]Process completed with exit code 1.

Suspected Root Cause

trigger_release_jax_wheels in multi_arch_release_linux.yml lines 252–272 is missing a build_variant != 'asan' guard. Introduced by commit 66e7f19298

All 8 Test JAX Wheels jobs fail at python -c "import jax; print(jax.local_devices())". The JAX plugin wheels were built against an ASan-instrumented ROCm tarball produced by the ASAN nightly, so the plugin .so files are linked against libclang_rt.asan.so. At test time, ASan requires its runtime to be the first library loaded; it is not, causing an immediate abort.

The proximate cause: trigger_release_jax_wheels in multi_arch_release_linux.yml has no if: ${{ inputs.build_variant != 'asan' }} guard, so the ASAN nightly dispatches JAX wheel builds unconditionally.

AI Suggested Fix

Add if: ${{ inputs.build_variant != 'asan' }} to the trigger_release_jax_wheels job in multi_arch_release_linux.yml.

Metadata

Metadata

Assignees

Type

No type

Fields

No fields configured for issues without a type.

Projects

Status
TODO

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions