Skip to content

Issues: bentoml/OpenLLM

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

18 Open 250 Closed
18 Open 250 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

bug: there is no reply from ai chat on Safari Mac OS but ok on Chrome browser
#1101 opened Oct 21, 2024 by YuriyGavrilov
bug: llama3.1:8B maximum context length
#1083 opened Sep 18, 2024 by GaetanBaert
2
bug: Can openllm run on k8s clusters without GPUs？
#1078 opened Sep 9, 2024 by Lucas-16
3
bug: openllm run phi3:3.8b-ggml-q4 build fails to find FOUNDATION_LIBRARY
#1064 opened Aug 16, 2024 by sij1nk
2
Can openllm support local path model?
#1044 opened Jul 18, 2024 by dsp6414
12
How to deploy a model using a single machine multi card approach?
#1026 opened Jun 25, 2024 by ttaop
1
feat: Include starcoder2
#1025 opened Jun 24, 2024 by kobiche
feat: Multimodal LLMs?
#972 opened Apr 30, 2024 by Trickster85
1
feat: any plan to support NPU
#951 opened Apr 13, 2024 by zhangxinyang97
1
Deploying LLM in On-Premises Server to Assist Users to Launch Locally in Work Laptop - Web Browser
#934 opened Mar 18, 2024 by sanket038
3
feat: support volta architecture GPUs for the vLLM backend
#930 opened Mar 12, 2024 by K-Mistele
feat: Document usage of request_id
#900 opened Feb 12, 2024 by AlexanderFillbrunn
How to run a docker image on multiple GPUs?
#872 opened Jan 30, 2024 by jeremyadamsfisher
Why change prompt_token_ids depending on encoder_decoder
#851 opened Jan 18, 2024 by meanwo
Docker image for version 0.4.41 not built
#827 opened Jan 4, 2024 by martinkozle
Question about multi-adapter
#656 opened Nov 15, 2023 by KyrieCui
1
feat(client): support wait time for serverless startup time
#607 opened Nov 10, 2023 by aarnphm
feat: support InternLM
#534 opened Oct 28, 2023 by vansin
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.