BUG REPORT : zlib dynamic references missing?

erdoukki · July 14, 2021, 1:30pm

We found a problem on zlib, and looks like on all shared libraries, when debugging pyinstaller package...

How can I report a bug/issue in OpenWrt ?

github.com/pyinstaller/pyinstaller

ARM64 ERROR: Could not build wheels for pyinstaller

opened 10:09AM - 14 Jul 21 UTC

erdoukki

state:need info triage

Already seen this issue : https://github.com/pyinstaller/pyinstaller/issues/5943… and this issue : https://github.com/pydata/bottleneck/issues/343#issuecomment-879711923 I am trying to install pyinstaller with pip on ARM64 on OpenWrt 21.02-RC3 and get error : ``` # python3 --version Python 3.9.6 ``` Here my tries : ``` root@ultra:~# pip uninstall pyinstaller WARNING: Skipping pyinstaller as it is not installed. WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv ``` ``` root@ultra:~# pip install pyinstaller Looking in indexes: https://pypi.org/simple Collecting pyinstaller Using cached pyinstaller-4.4.tar.gz (3.8 MB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing wheel metadata ... done Requirement already satisfied: pyinstaller-hooks-contrib>=2020.6 in /usr/lib/python3.9/site-packages (from pyinstaller) (2021.2) Requirement already satisfied: setuptools in /usr/lib/python3.9/site-packages (from pyinstaller) (57.1.0) Requirement already satisfied: altgraph in /usr/lib/python3.9/site-packages (from pyinstaller) (0.17) Building wheels for collected packages: pyinstaller Building wheel for pyinstaller (PEP 517) ... error ERROR: Failed building wheel for pyinstaller Failed to build pyinstaller ERROR: Could not build wheels for pyinstaller which use PEP 517 and cannot be installed directly ``` ``` root@ultra:~# pip install pyinstaller --no-binary :all: Looking in indexes: https://pypi.org/simple, https://packagecloud.io/crowdsec/crowdsec/pypi/simple Collecting pyinstaller Using cached pyinstaller-4.4.tar.gz (3.8 MB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing wheel metadata ... done Requirement already satisfied: altgraph in /usr/lib/python3.9/site-packages (from pyinstaller) (0.17) Requirement already satisfied: setuptools in /usr/lib/python3.9/site-packages (from pyinstaller) (57.1.0) Requirement already satisfied: pyinstaller-hooks-contrib>=2020.6 in /usr/lib/python3.9/site-packages (from pyinstaller) (2021.2) Building wheels for collected packages: pyinstaller Building wheel for pyinstaller (PEP 517) ... error ERROR: Failed building wheel for pyinstaller Failed to build pyinstaller ERROR: Could not build wheels for pyinstaller which use PEP 517 and cannot be installed directly ``` ``` root@ultra:~# pip install pyinstaller --no-use-pep517 --no-binary :all: Looking in indexes: https://pypi.org/simple, https://packagecloud.io/crowdsec/crowdsec/pypi/simple Collecting pyinstaller Using cached pyinstaller-4.4.tar.gz (3.8 MB) Requirement already satisfied: setuptools in /usr/lib/python3.9/site-packages (from pyinstaller) (57.1.0) Requirement already satisfied: altgraph in /usr/lib/python3.9/site-packages (from pyinstaller) (0.17) Requirement already satisfied: pyinstaller-hooks-contrib>=2020.6 in /usr/lib/python3.9/site-packages (from pyinstaller) (2021.2) Skipping wheel build for pyinstaller, due to binaries being disabled for it. Installing collected packages: pyinstaller Running setup.py install for pyinstaller ... error ERROR: Command errored out with exit status 1: /usr/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-0d09rimq/pyinstaller_e9e241982a6b4a3aa611ac37c2a5ca08/setup.py'"'"'; __file__='"'"'/tmp/pip-install-0d09rimq/pyinstaller_e9e241982a6b4a3aa611ac37c2a5ca08/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-vd2j3fzx/install-record.txt --single-version-externally-managed --compile --install-headers /usr/include/python3.9/pyinstaller Check the logs for full command output. ```

github.com/pyinstaller/pyinstaller

ARM64 ERROR: Could not build wheels for pyinstaller

opened 10:09AM - 14 Jul 21 UTC

erdoukki

state:need info triage

Already seen this issue : https://github.com/pyinstaller/pyinstaller/issues/5943… and this issue : https://github.com/pydata/bottleneck/issues/343#issuecomment-879711923 I am trying to install pyinstaller with pip on ARM64 on OpenWrt 21.02-RC3 and get error : ``` # python3 --version Python 3.9.6 ``` Here my tries : ``` root@ultra:~# pip uninstall pyinstaller WARNING: Skipping pyinstaller as it is not installed. WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv ``` ``` root@ultra:~# pip install pyinstaller Looking in indexes: https://pypi.org/simple Collecting pyinstaller Using cached pyinstaller-4.4.tar.gz (3.8 MB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing wheel metadata ... done Requirement already satisfied: pyinstaller-hooks-contrib>=2020.6 in /usr/lib/python3.9/site-packages (from pyinstaller) (2021.2) Requirement already satisfied: setuptools in /usr/lib/python3.9/site-packages (from pyinstaller) (57.1.0) Requirement already satisfied: altgraph in /usr/lib/python3.9/site-packages (from pyinstaller) (0.17) Building wheels for collected packages: pyinstaller Building wheel for pyinstaller (PEP 517) ... error ERROR: Failed building wheel for pyinstaller Failed to build pyinstaller ERROR: Could not build wheels for pyinstaller which use PEP 517 and cannot be installed directly ``` ``` root@ultra:~# pip install pyinstaller --no-binary :all: Looking in indexes: https://pypi.org/simple, https://packagecloud.io/crowdsec/crowdsec/pypi/simple Collecting pyinstaller Using cached pyinstaller-4.4.tar.gz (3.8 MB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing wheel metadata ... done Requirement already satisfied: altgraph in /usr/lib/python3.9/site-packages (from pyinstaller) (0.17) Requirement already satisfied: setuptools in /usr/lib/python3.9/site-packages (from pyinstaller) (57.1.0) Requirement already satisfied: pyinstaller-hooks-contrib>=2020.6 in /usr/lib/python3.9/site-packages (from pyinstaller) (2021.2) Building wheels for collected packages: pyinstaller Building wheel for pyinstaller (PEP 517) ... error ERROR: Failed building wheel for pyinstaller Failed to build pyinstaller ERROR: Could not build wheels for pyinstaller which use PEP 517 and cannot be installed directly ``` ``` root@ultra:~# pip install pyinstaller --no-use-pep517 --no-binary :all: Looking in indexes: https://pypi.org/simple, https://packagecloud.io/crowdsec/crowdsec/pypi/simple Collecting pyinstaller Using cached pyinstaller-4.4.tar.gz (3.8 MB) Requirement already satisfied: setuptools in /usr/lib/python3.9/site-packages (from pyinstaller) (57.1.0) Requirement already satisfied: altgraph in /usr/lib/python3.9/site-packages (from pyinstaller) (0.17) Requirement already satisfied: pyinstaller-hooks-contrib>=2020.6 in /usr/lib/python3.9/site-packages (from pyinstaller) (2021.2) Skipping wheel build for pyinstaller, due to binaries being disabled for it. Installing collected packages: pyinstaller Running setup.py install for pyinstaller ... error ERROR: Command errored out with exit status 1: /usr/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-0d09rimq/pyinstaller_e9e241982a6b4a3aa611ac37c2a5ca08/setup.py'"'"'; __file__='"'"'/tmp/pip-install-0d09rimq/pyinstaller_e9e241982a6b4a3aa611ac37c2a5ca08/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-vd2j3fzx/install-record.txt --single-version-externally-managed --compile --install-headers /usr/include/python3.9/pyinstaller Check the logs for full command output. ```

tmomas · July 14, 2021, 2:23pm

See https://openwrt.org/bugs

jow · July 14, 2021, 5:02pm

OpenWrt does not support on-target compilation. You can't link the system zlib due to OpenWrt using sstrip which agressively strips symbol table information from shared objects which makes them unsuitable for linking.

This isn't really a bug that can be solved but rather a consequence of a deliberate design decision (agressivly strip binaries to save space).

There's several solutions:

compile and install non stripped zlib on-target as well
rebuild your OpenWrt image without CONFIG_USE_SSTRIP
fix pyinstaller's (?) build system to only consider the system provided libz if it is linkable

erdoukki · July 14, 2021, 5:19pm

It is what I think ... thanks for the precision...

So useless to open a bug report !

I can also try to make a package to the problematic python package... and offer it for upstream !
A corrective solution is already proposed by the team of pyinstaller, and may help to fix the specific package installation issue...
I was wondering about others package which still get errors with linking libs...

I can still try crooscompile and packaged them...

system · July 24, 2021, 5:19pm

This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.