Repository navigation

Batch store - #603

Merged

FrancescAlted merged 35 commits into

mainfrom

batch-store

Mar 20, 2026

Merged

Batch store#603
FrancescAlted merged 35 commits into
mainfrom
batch-store

Commits on Mar 16, 2026
- Initial implementation for BatchArray
  FrancescAlted
  committed
  d1bc0f4
Commits on Mar 17, 2026
- Add .info to BatchArray and VLArray; fancier .info for others too
  FrancescAlted
  committed
  37837d9
- Update to latest c-blosc2 in vlblocks branch
  FrancescAlted
  committed
  f3ef361
- Update to latest c-blosc2 in vlblocks branch
  FrancescAlted
  committed
  65ea44b
- Enable dicts by default in BatchArray and VLArray when using zstd
  FrancescAlted
  committed
  4172c3f
- Update to latest c-blosc2
  FrancescAlted
  committed
  e799739
- Update to latest c-blosc2
  FrancescAlted
  committed
  e640474
- Update the nthreads to the default value in this machine
  FrancescAlted
  committed
  07ec9d2
Commits on Mar 18, 2026
- New meanings for .chunksize and .blocksize properties
  FrancescAlted
  committed
  4fe44e8
- Fix for newer versions of torch
  FrancescAlted
  committed
  bad8411
- BatchArray -> ObjectArray
  FrancescAlted
  committed
  4fb6882
- Remove legacy fallback
  FrancescAlted
  committed
  bf1b935
- Update to latest c-blosc2
  FrancescAlted
  committed
  93378e5
- ObjectArray -> ObjectStore
  FrancescAlted
  committed
  99be797
- chunksize -> batchsize
  FrancescAlted
  committed
  244c86d
- batchsize is always constant
  FrancescAlted
  committed
  e999d1d
- ObjectStore -> BatchStore
  FrancescAlted
  committed
  afc8436
- More consistent naming
  FrancescAlted
  committed
  be41f85
Commits on Mar 19, 2026
Commits on Mar 20, 2026
- Revamped BatchStore. Add arrow as an optional serializer, and much more, including docs.
  FrancescAlted
  committed
  a65cb69
- Use metadata-based DictStore discovery and warn on leaf mismatches
  FrancescAlted
  committed
  0ab340d
- Add a BatchStore.items accessor
  FrancescAlted
  committed
  79cd7ab
- Undo an unneceesary workaround
  FrancescAlted
  committed
  c6cccdd
- Start using L2 cache size for clevel==5
  FrancescAlted
  committed
  20a958c
- Allow use a filename in .b2z as a single argument
  FrancescAlted
  committed
  c8c1632
- Adapt test to new blocksize thresholds
  FrancescAlted
  committed
  5a1cd0f
- Fix BatchStore metadata preservation paths
  FrancescAlted
  committed
  62dc717
- Update to latest c-blosc2
  FrancescAlted
  committed
  b379a2c
- Merge branch 'main' into batch-store
  FrancescAlted
  authored
  80f2b5f

Commits

Commits on Mar 16, 2026

Commits on Mar 17, 2026

Commits on Mar 18, 2026

Commits on Mar 19, 2026

Commits on Mar 20, 2026