Prepare Menudet 1.0 draft release certification

Author: FrancescAlted

.github/workflows/build.yml

@@ -108,6 +108,17 @@ jobs:
         PYTEST_DEADMAN_SECONDS: "300"
         PYTEST_DEADMAN_SESSION_SECONDS: "1500"
 
+    - name: Certify bounded Menudet math against independent references
+      run: python scripts/certify_menudet_math.py --report menudet-math.json
+
+    - name: Upload Menudet math certification
+      if: always()
+      uses: actions/upload-artifact@v4
+      with:
+        name: menudet-math-${{ matrix.os }}-py${{ matrix.python-version }}-np${{ matrix.numpy-version || 'default' }}
+        path: menudet-math.json
+        if-no-files-found: ignore
+
     # TUIs are timing-sensitive and only boot a headless terminal: one OS is
     # enough, and a flake here is feedback, not a release blocker.
     - name: Test TUI (non-blocking)

.github/workflows/cibuildwheels.yml

@@ -11,6 +11,18 @@ on:
 
 env:
   CIBW_BUILD_VERBOSITY: 1
+  # Every tested wheel checks portable descriptors/persistence and independent
+  # numeric references, not only whether the extension can be imported.
+  CIBW_TEST_COMMAND: >-
+    python -m pytest
+    {project}/tests/test_portable_artifact.py
+    {project}/tests/test_portable_descriptor.py
+    {project}/tests/test_portable_descriptor_host.py
+    {project}/tests/test_portable_lazy.py
+    {project}/tests/test_portable_policy.py
+    {project}/tests/test_portable_table_export.py
+    {project}/tests/test_dsl_portable.py -q -n 0 &&
+    python {project}/scripts/certify_menudet_math.py
   # Skip testing on aarch64 for now, as it is emulated on GitHub Actions and takes too long
   # Now that github provides native arm64 runners, we can enable tests again
   # CIBW_TEST_SKIP: "*linux*aarch64*"

.github/workflows/wasm-tests.yml

@@ -19,7 +19,9 @@ jobs:
       # WASM/Pyodide has no SIMD/runtime CPU detection; disable optimised paths
       CMAKE_ARGS: "-DWITH_ZLIB_OPTIM=OFF -DWITH_OPTIM=OFF -DWITH_RUNTIME_CPU_DETECTION=OFF"
       # cibuildwheel runs the suite automatically in the node/pyodide runtime
-      CIBW_TEST_COMMAND: "pytest {project}/tests"
+      CIBW_TEST_COMMAND: >-
+        pytest {project}/tests &&
+        python {project}/scripts/certify_menudet_math.py
     steps:
       - uses: actions/checkout@v7
       - uses: actions/setup-python@v7

CMakeLists.txt

@@ -142,7 +142,7 @@ endif()
 
 FetchContent_Declare(miniexpr
     GIT_REPOSITORY https://github.com/Blosc/miniexpr.git
-    GIT_TAG 55c882b238c4daf0523a52a44d5d84db56af24e4
+    GIT_TAG 3418cdce4b5c11e1661c8b6453e3d31d94b0b2b4
     # SOURCE_DIR ${CMAKE_CURRENT_SOURCE_DIR}/../miniexpr
 )
 FetchContent_MakeAvailable(miniexpr)

RELEASE_NOTES.md

@@ -1,5 +1,36 @@
 # Release notes
 
+## Changes from 4.14.2 to 4.15.0 (in development)
+
+### Introducing the Menudet 1.0 draft
+
+**Menudet — a little language for portable computation on arrays and tables.**
+
+- Export normalized `DSLKernel` authoring as validated, standalone JSON artifacts
+  with typed signatures and exact captured constants. Native miniexpr executes
+  imports without reconstructing Python functions or falling back to Python.
+- Support checked integer arithmetic, operand-typed floating computation, control
+  flow, fixed-width strings, logical array coordinates and ordered block reductions.
+- Keep logical reduction groups stable through persistence, partial reads and
+  output rechunking. True block-scalar results expose the logical block-grid shape.
+- Add portable CTable computed/generated transformers with an explicit
+  `row_domain="independent"` contract, including fixed-shape row reductions.
+- New compliant DSLKernel-backed LazyUDF saves export the draft automatically;
+  unsupported saves fail validation before writing the destination.
+- Historical Python-specific recipes require explicit `deserialize="full"`.
+  MessagePack decoding is safe by default, including nested containers.
+
+Menudet 1.0 is a **draft**, not a frozen compatibility promise. The existing
+`DSLKernel` and portable API names remain unchanged. This draft uses the typed
+interpreter; optional JIT requests fall back before execution, while required JIT
+rejects unsupported acceleration. Complex computation, callbacks, arbitrary
+memory access and non-strict floating-point modes are outside the portable contract.
+
+See the [Menudet reference](https://www.blosc.org/python-blosc2/reference/portable_dsl.html)
+for array/table examples, persistence policy and current limitations. Release
+certification is tracked separately; this development entry is not an announcement
+that 4.15.0 has been published.
+
 ## Changes from 4.14.1 to 4.14.2
 
 XXX version-specific blurb XXX

doc/conf.py

@@ -111,7 +111,14 @@ def genbody(f, func_list, lib="blosc2"):
     ],
 }
 
-exclude_patterns = ["_build", ".DS_Store", "**.ipynb_checkpoints", "tutorials/images/**"]
+exclude_patterns = [
+    "_build",
+    ".DS_Store",
+    "**.ipynb_checkpoints",
+    "tutorials/images/**",
+    "html/**",
+    "**/autofiles-stash/**",
+]
 
 html_show_sourcelink = False
 
@@ -306,7 +313,7 @@ def process_sig(app, what, name, obj, options, signature, return_annotation):
 # ``-W`` (as CI does) to turn that warning into a failure.
 
 _AUTODOC_DIRECTIVE = re.compile(
-    r"^\s*\.\.\s+(?:autoclass|autofunction|autodata|autoexception|autodecorator)::"
+    r"^\s*\.\.\s+(?:autoclass|autofunction|autodata|autoexception|autodecorator|py:class)::"
     r"\s*([\w.]+)"
 )
 _CURRENTMODULE = re.compile(r"^\s*\.\.\s+(?:currentmodule|module)::\s*([\w.]+)")

doc/getting_started/installation.rst

@@ -33,13 +33,13 @@ grouped into *extras* that you opt into with the ``blosc2[extra]`` syntax:
      - The :doc:`b2view <../guides/b2view>` terminal browser (``textual``,
        ``textual-plotext``), including its in-terminal braille plot (the
        ``p`` key).  Required by the ``b2view`` command.
-    * - ``hires``
+   * - ``hires``
      - The high-resolution image view in b2view (the ``h`` key), which
        renders a real ``matplotlib`` image in the terminal
-        (``textual-image``, ``matplotlib``).  Includes ``tui``.
-    * - ``images``
-      - JPEG/PNG ordinary-file previews in b2view (``Pillow``, ``textual-image``).
-        Includes ``tui`` without requiring matplotlib. ``hires`` includes this extra.
+       (``textual-image``, ``matplotlib``).  Includes ``tui``.
+   * - ``images``
+     - JPEG/PNG ordinary-file previews in b2view (``Pillow``, ``textual-image``).
+       Includes ``tui`` without requiring matplotlib. ``hires`` includes this extra.
    * - ``parquet``
      - The ``parquet-to-blosc2`` converter (``pyarrow``); see
        :doc:`../guides/parquet_to_blosc2`.

doc/reference/dsl_syntax.md

@@ -3,6 +3,10 @@
 This is the practical reference for the DSL used by `@blosc2.dsl_kernel`
 functions (and checked by `blosc2.validate_dsl()`).
 It focuses on what works today and the most common gotchas.
+The portable subset is named **Menudet**, a little language for portable
+computation on arrays and tables. See the [Menudet reference](portable_dsl.rst)
+for the 1.0 draft contract. This page also documents ordinary full-DSL features;
+acceptance here does not imply portability.
 For usage walkthroughs and end-to-end examples, see the
 [LazyArray UDF DSL kernels tutorial](../tutorials/03.lazyarray-udf-kernels.ipynb).
 

doc/reference/index.rst

@@ -13,4 +13,5 @@ API Reference
     utilities
     dsl_syntax
     portable_dsl
+    menudet_accuracy
     jit

doc/reference/menudet_accuracy.md

@@ -0,0 +1,52 @@
+# Menudet draft: numeric certification
+
+Menudet requires checked integer results and the stated floating-point type,
+domain, NaN, infinity, signed-zero and rounding rules. It does **not** promise
+bit-identical transcendental results across host math libraries or a universal
+ULP error bound. Native exact-anchor and exceptional-value tests remain separate
+from the bounded independent math check described here.
+
+## Reproducible independent references
+
+`scripts/menudet_math_vectors.json` contains 284 samples for 40 canonical
+operations, covering both float32 and float64. Inputs and expected results are
+stored as exact hexadecimal encodings. References were generated with mpmath
+1.3.0 at both 100 and 200 decimal digits; regeneration rejects disagreement
+between the two rounded results. The checker does not need mpmath and does not
+use NumPy or the executing host's libm as its mathematical reference.
+
+The finite domains include inverse-function endpoints, small arguments that
+exercise cancellation, mixed quadrants, gamma functions, and explicit fused
+multiply-add cancellation. Domain errors, NaNs/infinities, subnormal behavior,
+signed zeros, rounding functions, nextafter and aliases additionally have native
+conformance fixtures; they are not certified merely by these finite samples.
+
+| Operations | Maximum error for the checked samples |
+| --- | --- |
+| cospi, sinpi, exp10, lgamma, tgamma, logaddexp | 8 ULP |
+| Other sampled transcendental functions, sqrt, hypot, floating pow | 4 ULP |
+| fdim, fmin, fmax, copysign, fmod, remainder, ldexp, fma | Exact rounded value |
+
+These are **function-specific acceptance budgets for this finite corpus**, not
+new normative bounds over all possible inputs. ULP is measured using the smaller
+adjacent gap at the expected value, including at powers of two. Adding a new
+sample or changing a budget requires review; a failed platform must not silently
+skip a function or inflate its tolerance.
+
+## Running certification
+
+Against an installed package:
+
+```console
+python scripts/certify_menudet_math.py --report menudet-math.json
+```
+
+Reports identify the package path/version, platform, reference generator, sample
+count, per-function/per-precision maxima and individual failures. The process
+exits nonzero on failure. Use `--generate` only to regenerate the checked-in
+reference corpus in a development environment with mpmath installed.
+
+Native Python CI uploads the reports. The same corpus runs in Pyodide and in the
+installed-wheel test command, without adding a runtime reference-library
+dependency. Passing a local wheel certifies only that tested wheel and host;
+release readiness additionally requires the supported platform matrix to pass.