Skip to content

Doesn't work on python 3.14 #6

Description

@stephantul

Hello,

tokie pulls in an older version of pyo3, which does not support python 3.14. On a fresh uv python 3.14 environment, this happens. This breaks semble installs currently, see MinishLab/semble#80 and MinishLab/semble#81.

  × Failed to build `tokie==0.0.9`
  ├─▶ The build backend returned an error
  ╰─▶ Call to `maturin.build_wheel` failed (exit status: 1)

      [stdout]
      Running `maturin pep517 build-wheel -i /Users/a/.cache/uv/builds-v0/.tmpGnZHUZ/bin/python
      --compatibility off`

      [stderr]
          Updating crates.io index
       Downloading crates ...
        Downloaded anstyle v1.0.14
        Downloaded anyhow v1.0.102
        Downloaded anes v0.1.6
        Downloaded ahash v0.8.12
        Downloaded writeable v0.5.5
        Downloaded monostate-impl v0.1.18
        Downloaded fancy-regex v0.13.0
        Downloaded icu_properties v1.5.1
        Downloaded zerovec-derive v0.10.3
        Downloaded yoke-derive v0.7.5
        Downloaded wasm-bindgen-macro v0.2.115
        Downloaded libredox v0.1.15
        Downloaded wasm-bindgen-shared v0.2.115
        Downloaded icu_locid v1.5.0
        Downloaded webpki-roots v0.26.11
        Downloaded rustc-hash v1.1.0
        Downloaded oorandom v11.1.5
        Downloaded itoa v1.0.18
        Downloaded zmij v1.0.21
        Downloaded bit-set v0.5.3
        Downloaded write16 v1.0.0
        Downloaded yoke v0.7.5
        Downloaded memoffset v0.9.1
        Downloaded pyo3-macros v0.24.2
        Downloaded ciborium-ll v0.2.2
        Downloaded macro_rules_attribute-proc_macro v0.2.2
        Downloaded zerocopy-derive v0.8.48
        Downloaded utf16_iter v1.0.5
        Downloaded zerovec v0.10.4
        Downloaded plotters-svg v0.3.7
        Downloaded ident_case v1.0.1
        Downloaded rayon-cond v0.4.0
        Downloaded icu_provider_macros v1.5.0
        Downloaded clap_lex v1.1.0
        Downloaded plotters-backend v0.3.7
        Downloaded crunchy v0.2.4
        Downloaded unit-prefix v0.5.2
        Downloaded derive_builder_macro v0.20.2
        Downloaded ciborium-io v0.2.2
        Downloaded unindent v0.2.4
        Downloaded monostate v0.1.18
        Downloaded cast v0.3.0
        Downloaded zerocopy v0.8.48
        Downloaded castaway v0.2.4
        Downloaded quote v1.0.45
        Downloaded darling_macro v0.20.11
        Downloaded litemap v0.7.5
        Downloaded simd-adler32 v0.3.9
        Downloaded icu_locid_transform v1.5.0
        Downloaded criterion-plot v0.5.0
        Downloaded onig v6.5.1
        Downloaded icu_provider v1.5.0
        Downloaded ciborium v0.2.2
        Downloaded web-sys v0.3.92
        Downloaded tinystr v0.7.6
        Downloaded dary_heap v0.3.8
        Downloaded console v0.16.3
        Downloaded bit-vec v0.6.3
        Downloaded once_cell v1.21.4
        Downloaded pyo3-build-config v0.24.2
        Downloaded derive_builder v0.20.2
        Downloaded bitflags v2.11.0
        Downloaded icu_locid_transform_data v1.5.1
        Downloaded target-lexicon v0.13.5
        Downloaded tinytemplate v1.2.1
        Downloaded static_assertions v1.1.0
        Downloaded unicode-general-category v1.1.0
        Downloaded derive_builder_core v0.20.2
        Downloaded macro_rules_attribute v0.2.2
        Downloaded icu_normalizer v1.5.0
        Downloaded darling v0.20.11
        Downloaded hf-hub v0.4.3
        Downloaded clap v4.6.0
        Downloaded wasm-bindgen v0.2.115
        Downloaded base64 v0.13.1
        Downloaded ryu v1.0.23
        Downloaded wasm-bindgen-macro-support v0.2.115
        Downloaded unicode-ident v1.0.24
        Downloaded pretokie v0.0.4
        Downloaded pyo3-macros-backend v0.24.2
        Downloaded compact_str v0.9.0
        Downloaded half v2.7.1
        Downloaded icu_normalizer_data v1.5.1
        Downloaded darling_core v0.20.11
        Downloaded indicatif v0.18.4
        Downloaded pyo3-ffi v0.24.2
        Downloaded minimal-lexical v0.2.1
        Downloaded unicode_categories v0.1.1
        Downloaded icu_collections v1.5.0
        Downloaded unicode-normalization-alignments v0.1.12
        Downloaded cc v1.2.58
        Downloaded chunk v0.9.2
        Downloaded js-sys v0.3.92
        Downloaded unicode-segmentation v1.13.2
        Downloaded base64 v0.21.7
        Downloaded ureq v2.12.1
        Downloaded itertools v0.10.5
        Downloaded nom v7.1.3
        Downloaded criterion v0.5.1
        Downloaded bumpalo v3.20.2
        Downloaded plotters v0.3.7
        Downloaded daggrs v0.1.1
        Downloaded esaxx-rs v0.1.10
        Downloaded clap_builder v4.6.0
        Downloaded tokenizers v0.22.2
        Downloaded icu_properties_data v1.5.1
        Downloaded syn v2.0.117
        Downloaded regex-syntax v0.8.10
        Downloaded rustls v0.23.37
        Downloaded spm_precompiled v0.1.4
        Downloaded onig_sys v69.9.1
        Downloaded libc v0.2.183
        Downloaded pyo3 v0.24.2
        Downloaded tiktoken-rs v0.6.0
      🔗 Found pyo3 bindings
      🐍 Found CPython 3.14 at /Users/a/.cache/uv/builds-v0/.tmpGnZHUZ/bin/python
      📡 Using build options features from pyproject.toml
      💻 Using `MACOSX_DEPLOYMENT_TARGET=11.0` for aarch64-apple-darwin by default
         Compiling proc-macro2 v1.0.106
         Compiling quote v1.0.45
         Compiling unicode-ident v1.0.24
         Compiling stable_deref_trait v1.2.1
         Compiling libc v0.2.183
         Compiling target-lexicon v0.13.5
         Compiling cfg-if v1.0.4
         Compiling once_cell v1.21.4
         Compiling find-msvc-tools v0.1.9
         Compiling writeable v0.6.2
         Compiling litemap v0.8.1
         Compiling shlex v1.3.0
         Compiling icu_properties_data v2.1.2
         Compiling icu_normalizer_data v2.1.1
         Compiling memchr v2.8.0
         Compiling cc v1.2.58
         Compiling zeroize v1.8.2
         Compiling smallvec v1.15.1
         Compiling getrandom v0.3.4
         Compiling serde_core v1.0.228
         Compiling rustls-pki-types v1.14.0
         Compiling zerocopy v0.8.48
         Compiling writeable v0.5.5
         Compiling untrusted v0.9.0
         Compiling zmij v1.0.21
         Compiling crc32fast v1.5.0
         Compiling icu_locid_transform_data v1.5.1
         Compiling litemap v0.7.5
         Compiling utf8_iter v1.0.4
         Compiling portable-atomic v1.13.1
         Compiling simd-adler32 v0.3.9
         Compiling ring v0.17.14
         Compiling syn v2.0.117
         Compiling serde v1.0.228
         Compiling icu_properties_data v1.5.1
         Compiling pyo3-build-config v0.24.2
         Compiling getrandom v0.2.17
         Compiling adler2 v2.0.1
         Compiling serde_json v1.0.149
         Compiling rustls v0.23.37
         Compiling itoa v1.0.18
         Compiling percent-encoding v2.3.2
         Compiling rand_core v0.9.5
         Compiling form_urlencoded v1.2.2
         Compiling miniz_oxide v0.8.9
         Compiling webpki-roots v1.0.6
         Compiling option-ext v0.2.0
         Compiling icu_normalizer_data v1.5.1
         Compiling log v0.4.29
         Compiling unicode-general-category v1.1.0
         Compiling subtle v2.6.1
         Compiling autocfg v1.5.0
         Compiling byteorder v1.5.0
         Compiling thiserror v2.0.18
         Compiling unicode-width v0.2.2
         Compiling socks v0.3.4
         Compiling memoffset v0.9.1
         Compiling console v0.15.11
         Compiling dirs-sys v0.5.0
         Compiling webpki-roots v0.26.11
         Compiling flate2 v1.1.9
         Compiling aho-corasick v1.1.4
         Compiling synstructure v0.13.2
         Compiling regex-syntax v0.8.10
         Compiling pyo3-ffi v0.24.2
         Compiling pyo3-macros-backend v0.24.2
         Compiling number_prefix v0.4.0
         Compiling base64 v0.22.1
         Compiling bytes v1.11.1
         Compiling heck v0.5.0
      error: failed to run custom build command for `pyo3-ffi v0.24.2`

      Caused by:
        process didn't exit successfully:
      `/Users/a/.cache/uv/sdists-v9/pypi/tokie/0.0.9/hZ4nHwE7Cgp75raTq5U9v/src/target/release/build/pyo3-ffi-48c3ca277fda3013/build-script-build`
      (exit status: 1)
        --- stdout
        cargo:rustc-check-cfg=cfg(Py_LIMITED_API)
        cargo:rustc-check-cfg=cfg(Py_GIL_DISABLED)
        cargo:rustc-check-cfg=cfg(PyPy)
        cargo:rustc-check-cfg=cfg(GraalPy)
        cargo:rustc-check-cfg=cfg(py_sys_config, values("Py_DEBUG", "Py_REF_DEBUG", "Py_TRACE_REFS",
      "COUNT_ALLOCS"))
        cargo:rustc-check-cfg=cfg(pyo3_disable_reference_pool)
        cargo:rustc-check-cfg=cfg(pyo3_leak_on_drop_without_reference_pool)
        cargo:rustc-check-cfg=cfg(Py_3_7)
        cargo:rustc-check-cfg=cfg(Py_3_8)
        cargo:rustc-check-cfg=cfg(Py_3_9)
        cargo:rustc-check-cfg=cfg(Py_3_10)
        cargo:rustc-check-cfg=cfg(Py_3_11)
        cargo:rustc-check-cfg=cfg(Py_3_12)
        cargo:rustc-check-cfg=cfg(Py_3_13)
        cargo:rustc-check-cfg=cfg(Py_3_14)
        cargo:rerun-if-env-changed=PYO3_CROSS
        cargo:rerun-if-env-changed=PYO3_CROSS_LIB_DIR
        cargo:rerun-if-env-changed=PYO3_CROSS_PYTHON_VERSION
        cargo:rerun-if-env-changed=PYO3_CROSS_PYTHON_IMPLEMENTATION
        cargo:rerun-if-env-changed=PYO3_PRINT_CONFIG
        cargo:rerun-if-env-changed=PYO3_USE_ABI3_FORWARD_COMPATIBILITY

        --- stderr
        error: the configured Python interpreter version (3.14) is newer than PyO3's maximum supported version
      (3.13)
        = help: please check if an updated version of PyO3 is available. Current version: 0.24.2
        = help: set PYO3_USE_ABI3_FORWARD_COMPATIBILITY=1 to suppress this check and build anyway using the stable
      ABI
      warning: build failed, waiting for other jobs to finish...
      💥 maturin failed
        Caused by: Failed to build a native library through cargo
        Caused by: Cargo build finished with "exit status: 101": `env -u CARGO
      CARGO_ENCODED_RUSTFLAGS="-C\u{1f}link-arg=-undefined\u{1f}-C\u{1f}link-arg=dynamic_lookup"
      MACOSX_DEPLOYMENT_TARGET="11.0" PYO3_BUILD_EXTENSION_MODULE="1"
      PYO3_ENVIRONMENT_SIGNATURE="cpython-3.14-64bit"
      PYO3_PYTHON="/Users/a/.cache/uv/builds-v0/.tmpGnZHUZ/bin/python"
      PYTHON_SYS_EXECUTABLE="/Users/a/.cache/uv/builds-v0/.tmpGnZHUZ/bin/python"
      "cargo" "rustc" "--profile" "release" "--features" "pyo3/extension-module"
      "--message-format" "json-render-diagnostics" "--manifest-path"
      "/Users/a/.cache/uv/sdists-v9/pypi/tokie/0.0.9/hZ4nHwE7Cgp75raTq5U9v/src/crates/tokie-python/Cargo.toml"
      "--lib" "--" "-C" "link-args=-Wl,-install_name,@rpath/tokie.cpython-314-darwin.so"`
      Error: command ['maturin', 'pep517', 'build-wheel', '-i',
      '/Users/a/.cache/uv/builds-v0/.tmpGnZHUZ/bin/python', '--compatibility', 'off'] returned
      non-zero exit status 1

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions