Skip to content

fix(SAMPLER-HOST-LOGITS-DEVICE-TAG): the on-device sampler was handed a host address, and the CUDA arm dereferences it - #1360

Merged
localai-bot merged 13 commits into
mainfrom
fix/sampler-host-logits-device-tag
Aug 22, 2026
Merged

fix(SAMPLER-HOST-LOGITS-DEVICE-TAG): the on-device sampler was handed a host address, and the CUDA arm dereferences it#1360
localai-bot merged 13 commits into
mainfrom
fix/sampler-host-logits-device-tag