How to convert phi3.5 mini for qualcomm NPU and run in foundry local? #301
Unanswered
jarodxiangliu
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I converted the phi3.5 mini model following with vscode ai-toolkit, but it could not run at qualcomm NPU with foundry local.
And there is different files compared to the model downloaded from foundry local catelog
How does foundry local convert the model?
Beta Was this translation helpful? Give feedback.
All reactions