fix(SAMPLER-HOST-LOGITS-DEVICE-TAG): the on-device sampler was handed a host address, and the CUDA arm dereferences it - #1360

fix(SAMPLER-HOST-LOGITS-DEVICE-TAG): the on-device sampler was handed a host address, and the CUDA arm dereferences it#1360

localai-bot merged 13 commits into

mainmudler/vllm.cpp:mainfrom

fix/sampler-host-logits-device-tagmudler/vllm.cpp:fix/sampler-host-logits-device-tagCopy head branch name to clipboard