Error: no stdlib modules for Python3.11.7

[SapeNeCo]

Hello.
Today I decided to update the packages for my OpenWRT project with these commands:

./scripts/feeds update -a
./scripts/feeds install -a

Then during assembly the following error appeared:

The necessary bits to build these optional modules were not found:
readline                                                    
To find the necessary bits, look in setup.py in detect_modules() for the module's name.


The following modules found by detect_modules() in setup.py have not
been built, they are *disabled* by configure:
_ctypes_test         _testbuffer          _testcapi         
_testclinic          _testimportmultiple   _testinternalcapi 
_testmultiphase      _xxtestfuzz                            

Traceback (most recent call last):
  File "/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7/./setup.py", line 1621, in <module>
    main()
  File "/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7/./setup.py", line 1591, in main
    setup(# PyPI Metadata (PEP 301)
  File "/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7/Lib/distutils/core.py", line 148, in setup
    dist.run_commands()
  File "/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7/Lib/distutils/dist.py", line 966, in run_commands
    self.run_command(cmd)
  File "/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7/Lib/distutils/dist.py", line 985, in run_command
    cmd_obj.run()
  File "/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7/Lib/distutils/command/build.py", line 135, in run
    self.run_command(cmd_name)
  File "/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7/Lib/distutils/cmd.py", line 313, in run_command
    self.distribution.run_command(command)
  File "/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7/Lib/distutils/dist.py", line 985, in run_command
    cmd_obj.run()
  File "/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7/Lib/distutils/command/build_ext.py", line 343, in run
    self.build_extensions()
  File "/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7/./setup.py", line 522, in build_extensions
    self.summary(mods_built, mods_disabled)
  File "/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7/./setup.py", line 600, in summary
    raise RuntimeError("Failed to build some stdlib modules")
RuntimeError: Failed to build some stdlib modules
make[7]: *** [Makefile:868: sharedmods] Error 1
make[7]: Leaving directory '/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7'
make[6]: *** [Makefile:767: build_all_generate_profile] Error 2
make[6]: Leaving directory '/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7'
make[5]: *** [Makefile:743: profile-gen-stamp] Error 2
make[5]: Leaving directory '/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7'
make[4]: *** [Makefile:755: profile-run-stamp] Error 2
make[4]: Leaving directory '/home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7'
make[3]: *** [Makefile:354: /home/user/openwrt/build_dir/target-aarch64_generic_musl/Python-3.11.7/.built] Error 2
make[3]: Leaving directory '/home/user/openwrt/feeds/packages/lang/python/python3'
time: package/feeds/packages/python3/compile#297.17#19.66#307.53
    ERROR: package/feeds/packages/python3 failed to build.
make[2]: *** [package/Makefile:120: package/feeds/packages/python3/compile] Error 1
make[2]: Leaving directory '/home/user/openwrt'
make[1]: *** [package/Makefile:114: /home/user/openwrt/staging_dir/target-aarch64_generic_musl/stamp/.package_compile] Error 2
make[1]: Leaving directory '/home/user/openwrt'
make: *** [/home/user/openwrt/include/toplevel.mk:232: world] Ошибка 2

I tried to write make clean and searched the Internet for solutions to similar problems, but nothing works, the error remains. It asks for modules that have the word test everywhere, but there are none in menuconfig

[SapeNeCo]

Okay, I realized that the problem is frr. I need routing, and before frr was going smoothly, but now why does Python start cursing? This is strange, as I understand it, the package has been updated, but it is not supported on my system, which is also strange.

[crispyoz]

I have the same issue suddenly. Whenever I include nmap or ncat in my build. This has been working fine for months, suddenly today broken.

[liveonit]

Same issue here

[anomeome]

issue24598 might get more reaction than the forum

[SapeNeCo]

When you enable the use of python in OpenWRT (frr uses some of its modules and runs all of python), it pulls up the readline module:

As I understand it, some kind of package update was released yesterday, which is why the readline module is no longer working correctly.

[SapeNeCo]

I went to git packages and found these commits:

There is an assumption that it is them.
Especially the last one

[SapeNeCo]

YES!!
The problem was in this commit:
https://git.openwrt.org/?p=feed/packages.git;a=commit;h=d257ffe609e6e226d64139bb1b802cba852c6cfb
I downloaded all the packages and modified the python3 files, removing the changes from this commit.

[crispyoz]

Great work! I looked at the patch, but it seems to just be changing how it checks for readline. It seems it just need curses or ncurses libs which I have installed.

[SapeNeCo]

And everything started working for you with this commit after installing these packages?

[crispyoz]

@SapeNeCo Yes I deleted the patch and my system built fine. I already have ncurses and curse (lib/dev) installed, perhaps that makes a difference, I haven't dug into it much. I put the patch back and it broke, took the patch back out and it was un-broken.

[SapeNeCo]

Oh, sorry, I didn't understand correctly what you meant. I read your post that curses or ncurses libs fix this problem and there was no need to undo the patch

[crispyoz]

Yeah I wrote my comment badly, I just updated my earlier comment to make it more clear.

Yesterday I broke my build system trying to look at this issue and ended up with 10 other issues Overnight my build finally succeeded so I could test today. I added back nmap to my configuration, ran make and python3 package was broken, same as you had. I removed the patch from package/feeds/packages/python3/patches, ran make and the build succeeded. I then put the patch back and ran make again and the build failed with the same error. I took the patch back out, ran make and the build succeeded.

I'm using OpenWrt 23.05.3.

[SapeNeCo]

Well, everything is fine then, we’ll wait for a new commit to come out where this will be fixed.

If anything I use OpenWrt SNAPSHOT r0-77c2c3c