Building wheel for dynet (pyproject.toml) did not run successfully.

[sihanyang-y]

Hi, I got an error when docker build image. My computer is Mac OS 14.5 with M2 chip. Python version is 3.8
Image and environment in docker is:
FROM ubuntu:20.04@sha256:8e5c4f0285ecbb4ead070431d29b576a530d3166df73ec44affc1cd27555141b ENV DEBIAN_FRONTEND=noninteractive
I tried commands with different versions:
RUN pip install dynet
RUN pip install dynet==2.1.1
This is error log:

[api 8/10] RUN pip install dynet==2.1.1:
0.292 Collecting dynet==2.1.1
0.333 Downloading dyNET-2.1.1.tar.gz (509 kB)
0.388 Installing build dependencies: started
1.602 Installing build dependencies: finished with status 'done'
1.603 Getting requirements to build wheel: started
1.691 Getting requirements to build wheel: finished with status 'done'
1.692 Preparing metadata (pyproject.toml): started
1.790 Preparing metadata (pyproject.toml): finished with status 'done'
1.893 Collecting cython (from dynet==2.1.1)
1.894 Using cached Cython-3.0.12-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (3.3 kB)
1.985 Collecting numpy (from dynet==2.1.1)
1.992 Downloading numpy-1.24.4-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (5.6 kB)
1.996 Using cached Cython-3.0.12-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.5 MB)
2.008 Downloading numpy-1.24.4-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (14.0 MB)
2.184 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.0/14.0 MB 79.4 MB/s eta 0:00:00
2.199 Building wheels for collected packages: dynet
2.200 Building wheel for dynet (pyproject.toml): started
7.767 Building wheel for dynet (pyproject.toml): finished with status 'error'
7.773 error: subprocess-exited-with-error
7.773
7.773 × Building wheel for dynet (pyproject.toml) did not run successfully.
7.773 │ exit code: 1
7.773 ╰─> [125 lines of output]
7.773 INFO:root:running bdist_wheel
7.773 INFO:root:running build
7.773 INFO:root:CMAKE_PATH='/usr/bin/cmake'
7.773 INFO:root:MAKE_PATH='/usr/bin/make'
7.773 INFO:root:MAKE_FLAGS='-j 10'
7.773 INFO:root:EIGEN3_INCLUDE_DIR='/tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3/build/py3.8-64bit/eigen'
7.773 INFO:root:EIGEN3_DOWNLOAD_URL='https://github.com/clab/dynet/releases/download/2.1/eigen-b2e267dc99d4.zip'
7.773 INFO:root:CC_PATH='/usr/bin/gcc'
7.773 INFO:root:CXX_PATH='/usr/bin/g++'
7.773 INFO:root:SCRIPT_DIR='/tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3'
7.773 INFO:root:BUILD_DIR='/tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3/build/py3.8-64bit'
7.773 INFO:root:INSTALL_PREFIX='/usr/lib/python3.8/site-packages/../../..'
7.773 INFO:root:PYTHON='/usr/bin/python3'
7.773 cmake version 3.16.3
7.773
7.773 CMake suite maintained and supported by Kitware (kitware.com/cmake).
7.773 g++ (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0
7.773 Copyright (C) 2019 Free Software Foundation, Inc.
7.773 This is free software; see the source for copying conditions. There is NO
7.773 warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
7.773
7.773 INFO:root:Creating build directory /tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3/build/py3.8-64bit
7.773 INFO:root:Fetching Eigen...
7.773 INFO:root:Unpacking Eigen...
7.773 INFO:root:Configuring...
7.773 -- The C compiler identification is GNU 9.4.0
7.773 -- The CXX compiler identification is GNU 9.4.0
7.773 -- Check for working C compiler: /usr/bin/gcc
7.773 -- Check for working C compiler: /usr/bin/gcc -- works
7.773 -- Detecting C compiler ABI info
7.773 -- Detecting C compiler ABI info - done
7.773 -- Detecting C compile features
7.773 -- Detecting C compile features - done
7.773 -- Check for working CXX compiler: /usr/bin/g++
7.773 -- Check for working CXX compiler: /usr/bin/g++ -- works
7.773 -- Detecting CXX compiler ABI info
7.773 -- Detecting CXX compiler ABI info - done
7.773 -- Detecting CXX compile features
7.773 -- Detecting CXX compile features - done
7.773 -- Optimization level: fast
7.773 -- BACKEND not specified, defaulting to eigen.
7.773 -- Eigen dir is /tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3/build/py3.8-64bit/eigen
7.773 -- Looking for pthread.h
7.773 -- Looking for pthread.h - found
7.773 -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
7.773 -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
7.773 -- Looking for pthread_create in pthreads
7.773 -- Looking for pthread_create in pthreads - not found
7.773 -- Looking for pthread_create in pthread
7.773 -- Looking for pthread_create in pthread - found
7.773 -- Found Threads: TRUE
7.773 -- Found Cython version 3.0.12
7.773
7.773 CMAKE_INSTALL_PREFIX="/usr"
7.773 PROJECT_SOURCE_DIR="/tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3"
7.773 PROJECT_BINARY_DIR="/tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3/build/py3.8-64bit"
7.773 LIBS="-lpthread"
7.773 EIGEN3_INCLUDE_DIR="/tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3/build/py3.8-64bit/eigen"
7.773 MKL_LINK_DIRS=""
7.773 WITH_CUDA_BACKEND=""
7.773 CUDA_RT_FILES=""
7.773 CUDA_RT_DIRS=""
7.773 CUDA_CUBLAS_FILES=""
7.773 CUDA_CUBLAS_DIRS=""
7.773 MSVC=""
7.773 -- Configuring done
7.773 -- Generating done
7.773 -- Build files have been written to: /tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3/build/py3.8-64bit
7.773 INFO:root:Compiling...
7.773 Scanning dependencies of target dynet
7.773 [ 1%] Building CXX object dynet/CMakeFiles/dynet.dir/deep-lstm.cc.o
7.773 [ 2%] Building CXX object dynet/CMakeFiles/dynet.dir/cfsm-builder.cc.o
7.773 [ 4%] Building CXX object dynet/CMakeFiles/dynet.dir/expr.cc.o
7.773 [ 5%] Building CXX object dynet/CMakeFiles/dynet.dir/aligned-mem-pool.cc.o
7.773 [ 7%] Building CXX object dynet/CMakeFiles/dynet.dir/fast-lstm.cc.o
7.773 [ 8%] Building CXX object dynet/CMakeFiles/dynet.dir/dict.cc.o
7.773 [ 11%] Building CXX object dynet/CMakeFiles/dynet.dir/dynet.cc.o
7.773 [ 11%] Building CXX object dynet/CMakeFiles/dynet.dir/devices.cc.o
7.773 [ 13%] Building CXX object dynet/CMakeFiles/dynet.dir/exec.cc.o
7.773 [ 14%] Building CXX object dynet/CMakeFiles/dynet.dir/dim.cc.o
7.773 [ 16%] Building CXX object dynet/CMakeFiles/dynet.dir/globals.cc.o
7.773 [ 17%] Building CXX object dynet/CMakeFiles/dynet.dir/grad-check.cc.o
7.773 /tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3/dynet/expr.cc: In function ‘dynet::Expression dynet::strided_select(const dynet::Expression&, const std::vector&, const std::vector&, const std::vector&)’:
7.773 /tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3/dynet/expr.cc:201:74: warning: comparison of integer expressions of different signedness: ‘const value_type’ {aka ‘const int’} and ‘unsigned int’ [-Wsign-compare]
7.773 201 | for(unsigned d=0;d<range_to.size() && d<x.dim().nd;d++){ if(range_to[d]!=x.dim()[d]) inplaced = false; }
7.773 [ 19%] Building CXX object dynet/CMakeFiles/dynet.dir/graph.cc.o
7.773 [ 20%] Building CXX object dynet/CMakeFiles/dynet.dir/gru.cc.o
7.773 [ 22%] Building CXX object dynet/CMakeFiles/dynet.dir/hsm-builder.cc.o
7.773 [ 23%] Building CXX object dynet/CMakeFiles/dynet.dir/init.cc.o
7.773 [ 25%] Building CXX object dynet/CMakeFiles/dynet.dir/io.cc.o
7.773 [ 26%] Building CXX object dynet/CMakeFiles/dynet.dir/lstm.cc.o
7.773 [ 28%] Building CXX object dynet/CMakeFiles/dynet.dir/model.cc.o
7.773 [ 29%] Building CXX object dynet/CMakeFiles/dynet.dir/mem.cc.o
7.773 /tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3/dynet/mem.cc:13:10: fatal error: mm_malloc.h: No such file or directory
7.773 13 | #include <mm_malloc.h>
7.773 | ^~~~~~~~~~~~~
7.773 compilation terminated.
7.773 make[2]: *** [dynet/CMakeFiles/dynet.dir/build.make:297: dynet/CMakeFiles/dynet.dir/mem.cc.o] Error 1
7.773 make[2]: *** Waiting for unfinished jobs....
7.773 /tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3/dynet/lstm.cc: In member function ‘void dynet::SparseLSTMBuilder::set_sparsity(float)’:
7.773 /tmp/pip-install-36wn87rg/dynet_8dd5d1f29c6143499f2bc62653f45ba3/dynet/lstm.cc:686:19: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare]
7.773 686 | for (int i=0;i<layers;i++){
7.773 | ~^~~~~~~
7.773 make[1]: *** [CMakeFiles/Makefile2:116: dynet/CMakeFiles/dynet.dir/all] Error 2
7.773 make: *** [Makefile:130: all] Error 2
7.773 :102: DeprecationWarning: Use shutil.which instead of find_executable
7.773 :103: DeprecationWarning: Use shutil.which instead of find_executable
7.773 :105: DeprecationWarning: Use shutil.which instead of find_executable
7.773 :106: DeprecationWarning: Use shutil.which instead of find_executable
7.773 /tmp/pip-build-env-sfiumuou/overlay/lib/python3.8/site-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options
7.773 !!
7.773
7.773 ********************************************************************************
7.773 Usage of dash-separated 'description-file' will not be supported in future
7.773 versions. Please use the underscore name 'description_file' instead.
7.773
7.773 By 2025-Mar-03, you need to update your project and remove deprecated calls
7.773 or your builds will no longer be supported.
7.773
7.773 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details.
7.773 ********************************************************************************
7.773
7.773 !!
7.773 opt = self.warn_dash_deprecation(opt, section)
7.773 error: /usr/bin/make -j 10
7.773 [end of output]
7.773
7.773 note: This error originates from a subprocess, and is likely not a problem with pip.
[+] Building 2/3ailed building wheel for dynet
✔ Service app Built 0.3s
✔ Service user-service Built 0.3s
⠙ Service api Building 8.1s
failed to solve: process "/bin/sh -c pip install dynet==2.1.1" did not complete successfully: exit code: 1