Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CoreML not using GPU #341

Open
Jasonsey opened this issue Jan 24, 2025 · 0 comments
Open

CoreML not using GPU #341

Jasonsey opened this issue Jan 24, 2025 · 0 comments
Labels
help wanted Extra attention is needed os: macOS

Comments

@Jasonsey
Copy link

Hi there,

I'm running an onnx model useing CoreML. if I run this model in cargo I can see it's using gpu well, it spends about 40s to infer the model.

But If I build this model into Mac APP using cargo swfit crate, only cpu is used and it spends about 2min to infer the model. And also I try to infer the model using python onnxruntime, it spend about 10s.

this is a snapshot when I run this model in Mac APP.

Image

Any Idea that I can find why this happen or I can I solve this issue ?

@decahedron1 decahedron1 added help wanted Extra attention is needed os: macOS labels Jan 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed os: macOS
Projects
None yet
Development

No branches or pull requests

2 participants