Skip to content

Conversation

@nikhilJain17
Copy link
Contributor

Now that webgpu_context is per-thread, we can remove mutexes from pipeline caches. We cannot remove mutexes from webgpu_buf_pool since they are allocated and freed in callback threads, and we cannot remove the mutex from the memset buffer pool since it is shared by all ggml buffers.

@github-actions github-actions bot added the ggml changes relating to the ggml tensor library for machine learning label Jan 30, 2026
Copy link
Collaborator

@reeselevine reeselevine left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice!

@nikhilJain17 nikhilJain17 marked this pull request as ready for review January 30, 2026 20:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ggml changes relating to the ggml tensor library for machine learning

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants