Repository navigation

Bundle C2Cache, add CTable (.b2z) and hierarchical container support, chunked writes, and fancy coordinate indexing - #290

Merged

FrancescAlted merged 94 commits into

mainfrom

c2cache-monorepo

Sep 1, 2026

Merged

Bundle C2Cache, add CTable (.b2z) and hierarchical container support, chunked writes, and fancy coordinate indexing#290
FrancescAlted merged 94 commits into
mainfrom
c2cache-monorepo

Commits on Jun 30, 2026
- Add CTable .b2z support: metadata model, fetch pipeline via to_cframe(), Python client Table class
  FrancescAlted
  committed
  3f4748c
Commits on Jul 1, 2026
- Fix CTable whole-fetch bug, add Array/Table client hierarchy, and .b2z storage handling
  FrancescAlted
  committed
  32947e8
- Add web preview and CLI support for CTable (.b2z) datasets
  FrancescAlted
  committed
  6a45518
- Harden CTable (.b2z) row slicing, previews, and CLI edge cases
  FrancescAlted
  committed
  93d9e81
- Much cleaner error message for cat2-client on invalid commands
  FrancescAlted
  committed
  ebd52a8
- Much cleaner error message for cat2-client on invalid commands
  FrancescAlted
  committed
  86e850a
- Potential fix for pull request finding
  
  FrancescAlted
  and
  Copilot
  authored
  2adefd8
- Fix hardcoded suffix set in get_abspath() to use srv_utils.BLOSC2_NATIVE_SUFFIXES
  Copilot
  authored
  6ce34ca
- Potential fix for pull request finding
  
  FrancescAlted
  and
  Copilot
  authored
  e3fc9b3
- Add test for the table[-1] fix
  FrancescAlted
  committed
  e410ea3
- Support browsing TreeStore .b2z containers via virtual paths
  FrancescAlted
  committed
  8ee2af2
- Browse hierarchical .b2z (TreeStore) containers and directories
  FrancescAlted
  committed
  4a7e954
- Add plan for virtual descent for h5 too
  FrancescAlted
  committed
  af2cce6
Commits on Jul 2, 2026
Commits on Jul 3, 2026
Commits on Jul 4, 2026
- Initial plans for remote peer mounts
  FrancescAlted
  committed
  51773ec
- Initial implementation of plan
  FrancescAlted
  committed
  3ec12dd
- Fix peer-mounts review findings: correctness, error taxonomy, event-loop hygiene
  
  FrancescAlted
  and
  claude
  committed
  dbb67dd
Commits on Jul 5, 2026
- hdf5 required for the new server
  FrancescAlted
  committed
  a1c1987
- Add Docker/Apple-container tooling to manually exercise peer mounts
  FrancescAlted
  committed
  eab1d62
Commits on Jul 6, 2026
- Make peer roots fully browsable from the web UI
  
  FrancescAlted
  and
  claude
  committed
  19742ec
- Add missing files
  FrancescAlted
  committed
  161cb1b
- Add compiled static .js and .css files
  FrancescAlted
  committed
  64c5fea
- Decouple peer-mount capability into a c2cache provider plugin
  FrancescAlted
  committed
  e4d9ac2
- test_peers: add concurrency regression test for peer cache eviction
  FrancescAlted
  committed
  9f5aabb
Commits on Jul 8, 2026
- Replace peercache's global io_lock with per-cache locks
  FrancescAlted
  committed
  2f8eacb
- Updated instruction for the ongoing split
  FrancescAlted
  committed
  ecd6091
Commits on Jul 9, 2026
- blosc2 requirement updated to 4.8.0
  FrancescAlted
  committed
  81849e0
- c2cache: adopt blosc2's real async aget_chunk, drop the to_thread shim
  FrancescAlted
  committed
  2a31271
Commits on Jul 10, 2026
- New plan for allowing CTable mounted from remote peers
  FrancescAlted
  committed
  6a4ffc4
- Updated plan
  FrancescAlted
  committed
  ac417b7
- New simplified version for supporting .b2z files living in remote peers
  FrancescAlted
  committed
  768dac3
Commits on Jul 11, 2026
- Implements plans/caterva3-remote-peer-simplified.md:
  FrancescAlted
  committed
  bad3e68
- Require blosc2 >= 4.8.1 for zero-copy from_cframe safety
  FrancescAlted
  committed
  2711c73
- Add unit test: null sentinels survive the structured CTable cache
  FrancescAlted
  committed
  fb38325
- Add a todo list
  FrancescAlted
  committed
  f3ae633
- Retry peer chunk fetch once before marking the peer offline
  
  FrancescAlted
  and
  claude
  committed
  fac0787
- Enforce per-peer cache_quota with a scoped eviction pass
  
  FrancescAlted
  and
  claude
  committed
  8c1694d
- Relay whole-file api/download for peer paths
  
  FrancescAlted
  and
  claude
  committed
  99508ae
- Pin DictStore .b2z container browsing with a test
  
  FrancescAlted
  and
  claude
  committed
  0d782ee
- New plans for cache server and dynamic mounts
  FrancescAlted
  committed
  58b2199
Commits on Jul 12, 2026
- Some refinements on plans
  FrancescAlted
  committed
  5675997
Commits on Jul 14, 2026
- Cache whole-file .b2 entries for peer plain-file downloads
  FrancescAlted
  committed
  c98265f
Commits on Aug 17, 2026
- Say which responses serve byte ranges, and refuse the rest
  
  FrancescAlted
  and
  claude
  committed
  76b2854
Commits on Aug 18, 2026
- Serve chunks of a container leaf, and refuse the ones that are not stored
  
  FrancescAlted
  and
  claude
  committed
  735e90a
- Serve a container leaf from its window in the file
  
  FrancescAlted
  and
  claude
  committed
  3576fd4
Commits on Aug 20, 2026
- Merge pull request #289 from ironArray/range-honesty
  FrancescAlted
  authored
  42a958d
- Accept one chunk at a time into a slot that holds none
  
  FrancescAlted
  and
  claude
  committed
  542b7a5
- Publish an array once every one of its chunks has landed
  
  FrancescAlted
  and
  claude
  committed
  2585cfa
- Move a published array into place instead of streaming into it
  
  FrancescAlted
  and
  claude
  committed
  7f5510c
Commits on Aug 21, 2026
- Name a filled array by a nonce, and say when it is complete
  
  FrancescAlted
  and
  claude
  committed
  33d9f2a
- Reach the fill from the client, and say in the docs that it is there
  
  FrancescAlted
  and
  claude
  committed
  64f1bdf
Commits on Aug 22, 2026
- Say on api/info whether a dataset can be read in ranges
  
  FrancescAlted
  and
  claude
  committed
  d760c6f
- Gather scattered coordinates on the server, for clients that ask
  
  FrancescAlted
  and
  claude
  committed
  2aa1928
- Take a fetch's parameters in a body, for keys an URL cannot hold
  
  FrancescAlted
  and
  claude
  committed
  a45fe2a
- Let this client ask for coordinates too, not only boxes
  
  FrancescAlted
  and
  claude
  committed
  e230409
- Browse a DictStore .b2z, and stop caching nulls the cache cannot carry
  
  FrancescAlted
  and
  claude
  committed
  17f5527
- Carry a column's validity across the cache, so masked nulls stay cacheable
  
  FrancescAlted
  and
  claude
  committed
  47132ad
- Check what a small table's ratio is, not that it flatters the table
  
  FrancescAlted
  and
  claude
  committed
  91948b3
Commits on Aug 23, 2026
- Keep a write inside the root that let it in
  
  FrancescAlted
  and
  claude
  committed
  415b349
- Refuse a fetch parameter this server cannot narrow with
  
  FrancescAlted
  and
  claude
  committed
  36277e7
- Say of a dataset only what fetching it will really do
  
  FrancescAlted
  and
  claude
  committed
  3b727c3
- Check the whole of a chunk's geometry, and stage each publish apart
  
  FrancescAlted
  and
  claude
  committed
  6ed6665
- Spell a key the way the server will read it back
  
  FrancescAlted
  and
  claude
  committed
  b861f80
- Rebuild a peer cache whose format this code has outgrown
  
  FrancescAlted
  and
  claude
  committed
  3d86a68
- Say in the notes what these endpoints actually do now
  
  FrancescAlted
  and
  claude
  committed
  b984475
- Run the tests on every branch, not only on main
  
  FrancescAlted
  and
  claude
  committed
  9012f0a
- Ask for fsspec, which the fill path has needed all along
  
  FrancescAlted
  and
  claude
  committed
  1bc0fa2
- Rebuild a container leaf where blosc2 cannot say where it lies
  
  FrancescAlted
  and
  claude
  committed
  47a1cbe
- Stand down the tests that need a blosc2 nobody can install yet
  
  FrancescAlted
  and
  claude
  committed
  c22f20b
- Let the server import on a Python that reads its annotations eagerly
  
  FrancescAlted
  and
  claude
  committed
  bf4263f
Commits on Aug 28, 2026
- Publish @personal under the user it belongs to
  
  FrancescAlted
  and
  claude
  committed
  989d5b4
- Read a peer CTable's info as a CTable's
  
  FrancescAlted
  and
  claude
  committed
  244b13c
- Name a relayed download's file once
  
  FrancescAlted
  and
  claude
  committed
  29ecf93
- Keep one bad peer from raising out of the registry
  
  FrancescAlted
  and
  claude
  committed
  d0fdeda
- Normalize the path in get_chunk
  
  FrancescAlted
  and
  claude
  committed
  13d1c31
- List a container path that names one leaf as that leaf
  
  FrancescAlted
  and
  claude
  committed
  0ee135b
- Break the connection on a leaf window that ends early
  
  FrancescAlted
  and
  claude
  committed
  d88e2be
- Bound the POST api/fetch body at the request, not at the parse
  
  FrancescAlted
  and
  claude
  committed
  1ba07d4
- Gather eviction candidates only when a quota is exceeded
  
  FrancescAlted
  and
  claude
  committed
  438fbbd
- Hold the per-cache locks weakly
  
  FrancescAlted
  and
  claude
  committed
  1482598
- Share one filtered-array cache entry between callers
  
  FrancescAlted
  and
  claude
  committed
  42dc2f7
- Ship c2cache in the container image
  
  FrancescAlted
  and
  claude
  committed
  07b217c
Commits on Aug 31, 2026
- Fix the review findings on the c2cache branch
  
  FrancescAlted
  and
  claude
  committed
  d37c48b
- Pin ruff at 0.16.5, and select rules instead of extending them
  
  FrancescAlted
  and
  claude
  committed
  b06dd4f
- Bundle C2Cache inside Caterva2
  FrancescAlted
  committed
  bbbb5d4

Commits

Commits on Jun 30, 2026

Commits on Jul 1, 2026

Commits on Jul 2, 2026

Commits on Jul 3, 2026

Commits on Jul 4, 2026

Commits on Jul 5, 2026

Commits on Jul 6, 2026

Commits on Jul 8, 2026

Commits on Jul 9, 2026

Commits on Jul 10, 2026

Commits on Jul 11, 2026

Commits on Jul 12, 2026

Commits on Jul 14, 2026

Commits on Aug 17, 2026

Commits on Aug 18, 2026

Commits on Aug 20, 2026

Commits on Aug 21, 2026

Commits on Aug 22, 2026

Commits on Aug 23, 2026

Commits on Aug 28, 2026

Commits on Aug 31, 2026