Xiaoya add unified simulator for LSE #20
Draft
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
1. Unified Image Simulator for LSE
This PR introduces a unified simulator that consolidates:
Description:
A single simulator that supports three modes:
2. Temporary Tiled Ingestor
A temporary tiled ingestor is added for ingesting the 733 dataset, enabling testing of the LSE live mode.
This component will later be moved to a dedicated Tiled ingestor repository.
Besides, we want to develop a unified Tiled ingestor to load original images—such as SMI data (fetched from the NSLS-II Tiled server using given URLs saved in .db files) or 733 data (loaded from the local file system)—into a local Tiled server. This will enable us to run the unified simulator without requiring access to remote Tiled instances.
When ingesting data, we should aim to mimic the Tiled URL structure. For example, at NSLS-II, SMI data URLs typically look like the following:
Development:
http://tiled-dev.nsls2.bnl.gov/api/v1/array/full/79b18ce7-c6a9-4c25-8b7c-7d3c5a57a536/streams/primary/pil2M_image?slice=0:1,0:1679,0:1475Production:
http://tiled.nsls2.bnl.gov/api/v1/array/full/smi/raw/79b18ce7-c6a9-4c25-8b7c-7d3c5a57a536/streams/primary/pil2M_image?slice=0:1,0:1679,0:1475We should also ensure support for two saving modes:
into the container.
However, I’m not yet sure what the corresponding URL format looks like for the ALS 733 experiment.
3. XPS Websocket Simulator
We read TRS data from the local file system and send it via WebSocket to mimic the XPS Arroyo WebSocket implementation: link.
Companion PR:
mlexchange/mlex_latent_explorer#61
mlexchange/mlex_latent_explorer#66