Skip to content

Tiled worker thread control for SST-1 RSoXS#183

Merged
pbeaucage merged 12 commits intomainfrom
182-tiled-thread-control
Apr 1, 2025
Merged

Tiled worker thread control for SST-1 RSoXS#183
pbeaucage merged 12 commits intomainfrom
182-tiled-thread-control

Conversation

@pbeaucage
Copy link
Collaborator

Uses dask.config to limit the number of worker threads to either the number of cores on the machine or 12, so as to avoid overwhelming the Tiled server. Should fix #182 and associated trouble loading very large scans.

@pbeaucage pbeaucage requested a review from martintb April 1, 2025 21:47
Copy link
Collaborator

@martintb martintb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@pbeaucage pbeaucage merged commit 22e2e5d into main Apr 1, 2025
16 checks passed
@pbeaucage pbeaucage deleted the 182-tiled-thread-control branch April 21, 2025 14:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

bug/feature: Tiled-backed data loading performance and timeout issues

2 participants