Replies: 1 comment 1 reply
-
Did you install it with CUDA enabled? You should seee |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi. I installed privateGPT with Mistral 7b on some powerfull (and expensive) servers proposed by Vultr.
I tested on :
All are >300$/month, but the perf are very poor (words per second < 4), far worse than the same mistral 7b installed on my mac Intel 2020 with Jan.
So I do not really understand ...
Is there settings I missed ?
Thank you.
Beta Was this translation helpful? Give feedback.
All reactions