Bug 34021 - Wapiti is broken and python3-browser-cookie3 is missing some dependencies
Summary: Wapiti is broken and python3-browser-cookie3 is missing some dependencies
Status: RESOLVED DUPLICATE of bug 34144
Alias: None
Product: Mageia
Classification: Unclassified
Component: RPM Packages (show other bugs)
Version: 9
Hardware: All Linux
Priority: Normal normal
Target Milestone: ---
Assignee: QA Team
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2025-02-14 21:23 CET by Thomas Andrews
Modified: 2025-03-30 18:56 CEST (History)
4 users (show)

See Also:
Source RPM: wapiti-3.0.5-3.mga9,python-browser-cookie3-0.12.1-3.mga9,python-httpcore-0.15.0-1.mga9,python-httpx-socks-0.4.1-3.mga9
CVE:
Status comment: Package List in comment 53


Attachments

Description Thomas Andrews 2025-02-14 21:23:22 CET
Description of problem: While attempting to test a python3-zipp update, I installed wapiti and dependencies, including python3-zipp, in a VirtualBox Plasma guest. The installation had no issues, but when I ran the most basic of commands, I got this:

$ wapiti -h
Traceback (most recent call last):
  File "/usr/bin/wapiti", line 33, in <module>
    sys.exit(load_entry_point('wapiti3==3.0.5', 'console_scripts', 'wapiti')())
  File "/usr/bin/wapiti", line 25, in importlib_load_entry_point
    return next(matches).load()
  File "/usr/lib64/python3.10/importlib/metadata/__init__.py", line 171, in load
    module = import_module(match.group('module'))
  File "/usr/lib64/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/usr/lib/python3.10/site-packages/wapitiCore/main/wapiti.py", line 39, in <module>
    import browser_cookie3
  File "/usr/lib/python3.10/site-packages/browser_cookie3/__init__.py", line 10, in <module>
    import lz4.block
ModuleNotFoundError: No module named 'lz4'

I was informed that 'lz4' is provided by 'python3-lz4' so I installed that and tried again:

$ wapiti -h
Traceback (most recent call last):
  File "/usr/bin/wapiti", line 33, in <module>
    sys.exit(load_entry_point('wapiti3==3.0.5', 'console_scripts', 'wapiti')())
  File "/usr/bin/wapiti", line 25, in importlib_load_entry_point
    return next(matches).load()
  File "/usr/lib64/python3.10/importlib/metadata/__init__.py", line 171, in load
    module = import_module(match.group('module'))
  File "/usr/lib64/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/usr/lib/python3.10/site-packages/wapitiCore/main/wapiti.py", line 39, in <module>
    import browser_cookie3
  File "/usr/lib/python3.10/site-packages/browser_cookie3/__init__.py", line 14, in <module>
    from Crypto.Cipher import AES
ModuleNotFoundError: No module named 'Crypto'

That makes at least two missing dependencies. That's as far as I've gone, so there may be more.

I suspect Cauldron probably is affected as well, but I can't confirm it.
Comment 1 David GEIGER 2025-02-15 05:24:40 CET
It is not wapiti which is directly affected but python3-browser-cookie3 which missing some dependencies!

CC: (none) => geiger.david68210

Comment 2 Thomas Andrews 2025-02-15 17:36:25 CET
Well, urpmq says wapiti is the only package that seems to require it, so the result is the same.
Comment 3 Lewis Smith 2025-02-17 20:16:34 CET
Thank you for the report, TJ. And DavidG for his comment1.

$ urpmq --requires wapiti
python(abi)[== 3.10]
python3.10dist(browser-cookie3)[>= 0.11.4]
...
$ urpmq --whatrequires python3-browser-cookie3
wapiti
$ urpmq --requires python3-browser-cookie3
python(abi)[== 3.10]

(In reply to David GEIGER from comment #1)
> It is not wapiti which is directly affected but python3-browser-cookie3
> which missing some dependencies!
Do we know what? TJ has discovered at least 'lz4' and 'Crypto'.

Summary: Wapiti refuses to run, probably because of missing dependencies => Wapiti refuses to run because python3-browser-cookie3 is missing some dependencies
Assignee: bugsquad => python

Comment 4 katnatek 2025-03-26 01:10:04 CET
I start to work on update this on cauldron but requires a lot of new python-things and not yet see the end, perhaps need to drop and suggest alternatives to install ?

This already done but not yet imported until get opinions

python-aiomcache 
python-aiocache 
python-aiosqlite 
python-arsenic 
python-httpx-ntlm 
python-loguru 
python-openapi-schema-validator

python-prance still needs the next

python-openapi-spec-validator needs the next

python-jsonschema-path needs python3dist(pathable) >= 0.4.1

CC: (none) => j.alberto.vc

Comment 5 katnatek 2025-03-26 01:31:13 CET Comment hidden (obsolete)
Comment 6 katnatek 2025-03-26 02:53:51 CET Comment hidden (obsolete)
Comment 7 katnatek 2025-03-26 23:33:57 CET Comment hidden (obsolete)
Comment 8 katnatek 2025-03-26 23:37:11 CET Comment hidden (obsolete)
Comment 9 Thomas Andrews 2025-03-26 23:44:16 CET
Wish I could hep, but any coding skills I once had became obsolete before the turn of the century.
Comment 10 katnatek 2025-03-26 23:57:17 CET Comment hidden (obsolete)

CC: (none) => yvesbrungard

Comment 11 Dan Fandrich 2025-03-27 00:19:59 CET
It looks like httpcore.SyncConnectionPool() was removed from httpcore 4 years ago in version 0.14 with this commit https://github.com/encode/httpcore/commit/f9b93918a54a49a4e917824ad38cf5bd8da21450

I guess httpx_socks needs to be updated to handle that change.

CC: (none) => dan

Comment 12 katnatek 2025-03-27 00:42:29 CET
(In reply to Dan Fandrich from comment #11)
> It looks like httpcore.SyncConnectionPool() was removed from httpcore 4
> years ago in version 0.14 with this commit
> https://github.com/encode/httpcore/commit/
> f9b93918a54a49a4e917824ad38cf5bd8da21450
> 
> I guess httpx_socks needs to be updated to handle that change.


https://github.com/wapiti-scanner/wapiti/blob/3.0.5/setup.py
httpx==0.17.1 

So our httpx is newer than needed :P

And update wapiti even to next version could be a headche https://github.com/wapiti-scanner/wapiti/blob/3.0.7/setup.py

So what's the next with this bug ?
Comment 13 katnatek 2025-03-27 02:10:40 CET
(In reply to katnatek from comment #12)
> (In reply to Dan Fandrich from comment #11)
> > It looks like httpcore.SyncConnectionPool() was removed from httpcore 4
> > years ago in version 0.14 with this commit
> > https://github.com/encode/httpcore/commit/
> > f9b93918a54a49a4e917824ad38cf5bd8da21450
> > 
> > I guess httpx_socks needs to be updated to handle that change.
> 
> 
> https://github.com/wapiti-scanner/wapiti/blob/3.0.5/setup.py
> httpx==0.17.1 
> 
> So our httpx is newer than needed :P
> 
> And update wapiti even to next version could be a headche
> https://github.com/wapiti-scanner/wapiti/blob/3.0.7/setup.py
> 
After build that version and install packages that I build and needed by this version, still needs

python3dist(httpx[brotli])

I doubt that is all
katnatek 2025-03-27 02:48:23 CET

Summary: Wapiti refuses to run because python3-browser-cookie3 is missing some dependencies => Wapiti is broken and python3-browser-cookie3 is missing some dependencies

katnatek 2025-03-27 03:17:09 CET

Source RPM: (none) => wapiti-3.0.5-3.mga9,python-browser-cookie3-0.12.1-3.mga9

Comment 14 papoteur 2025-03-27 09:41:33 CET
Hi,
Some of python modules are indeed outdated.
We need to update:
python-browser-cookie3 to 0.20.1 (this remove the need for pyaes and  and pbkdf2)
python-httpx-socks to 0.10.0
python-httpcore to 1.0.7

I will update svn with my changes. I leave katnatek to manage the remainder. I have not checked Cauldron, we have to be sure that these releases are also in it.

Result:
wapiti

 ██╗    ██╗ █████╗ ██████╗ ██╗████████╗██╗██████╗
 ██║    ██║██╔══██╗██╔══██╗██║╚══██╔══╝██║╚════██╗
 ██║ █╗ ██║███████║██████╔╝██║   ██║   ██║ █████╔╝
 ██║███╗██║██╔══██║██╔═══╝ ██║   ██║   ██║ ╚═══██╗
 ╚███╔███╔╝██║  ██║██║     ██║   ██║   ██║██████╔╝
  ╚══╝╚══╝ ╚═╝  ╚═╝╚═╝     ╚═╝   ╚═╝   ╚═╝╚═════╝  
Wapiti-3.0.5 (wapiti.sourceforge.io)
[*] Soyez prudent ! Nouvelle lune ce soir.
usage: wapiti [-h] [-u URL] [--scope {page,folder,domain,url,punk}] [-m MODULES_LIST] [--list-modules] [--update] [-l LEVEL] [-p PROXY_URL] [--tor] [-a CREDENTIALS]
              [--auth-type {basic,digest,ntlm,post}] [-c COOKIE_FILE] [--drop-set-cookie] [--skip-crawl] [--resume-crawl] [--flush-attacks] [--flush-session] [--store-session PATH]
              [--store-config PATH] [-s URL] [-x URL] [-r PARAMETER] [--skip PARAMETER] [-d DEPTH] [--max-links-per-page MAX] [--max-files-per-dir MAX] [--max-scan-time SECONDS]
              [--max-attack-time SECONDS] [--max-parameters MAX] [-S FORCE] [--tasks tasks] [-t SECONDS] [-H HEADER] [-A AGENT] [--verify-ssl {0,1}] [--color] [-v LEVEL] [-f FORMAT]
              [-o OUTPUT_PATH] [--external-endpoint EXTERNAL_ENDPOINT_URL] [--internal-endpoint INTERNAL_ENDPOINT_URL] [--endpoint ENDPOINT_URL] [--no-bugreport] [--version]
wapiti: error: one of the arguments -u/--url --list-modules --update is required
Comment 15 papoteur 2025-03-27 09:49:46 CET
And for wapiti itself, it is enough to add:
BuildRequires: pyproject-rpm-macros
...
%generate_buildrequires
%pyproject_buildrequires
katnatek 2025-03-27 17:48:28 CET

Source RPM: wapiti-3.0.5-3.mga9,python-browser-cookie3-0.12.1-3.mga9 => wapiti-3.0.5-3.mga9,python-browser-cookie3-0.12.1-3.mga9,python-httpcore-0.15.0-1.mga9,python-httpx-socks-0.4.1-3.mga9

Comment 16 katnatek 2025-03-27 17:59:51 CET
I'm a few more worried by

urpmq --whatrequires-recursive python3-httpcore|uniq
mnemosyne
orange
python3-aioruuvigateway
python3-googletrans
python3-httpcore
python3-httpx
python3-httpx-socks
wapiti

That for
urpmq --whatrequires-recursive python3-httpx-socks
python3-httpx-socks
wapiti

urpmq --whatrequires-recursive python3-browser-cookie3|uniq
python3-browser-cookie3
wapiti

Well I guess the QA team need to make some work ;)

About cauldron versions:
python3-httpcore-1.0.7-2.mga10
python3-httpx-socks-0.8.1-2.mga10
python3-browser-cookie3-0.20.1-2.mga10

So need to update python3-httpx-socks in cauldrom too
Comment 17 katnatek 2025-03-27 19:23:32 CET
 python-httpx-socks-0.10.0-1.mga10 now in cauldron
working in updates for mageia 9
katnatek 2025-03-27 19:25:05 CET

Assignee: python => j.alberto.vc
CC: j.alberto.vc => (none)

Comment 18 katnatek 2025-03-27 20:27:41 CET Comment hidden (obsolete)

Assignee: j.alberto.vc => qa-bugs

Comment 19 katnatek 2025-03-27 20:51:38 CET Comment hidden (obsolete)
Comment 20 katnatek 2025-03-27 21:02:37 CET Comment hidden (obsolete)
Comment 21 Thomas Andrews 2025-03-27 21:18:20 CET
In the VM from comment 0, where I had installed wapiti and dependencies, followed by python3-lz4, I first got all other pending updates, then used qarepo to get the packages from comment 18, and installed them.

The command "wapiti" now gives me the same result as papoteur (except in English). "wapiti -h" shows the proper help advice, with no errors.

I will try in a VM with wapiti not already installed.
Comment 22 katnatek 2025-03-27 21:23:59 CET
Looking to test if packages requiring  the updated packages

install mnemosyne

Start but don't know how use

python3-googletrans geted as require from previous

translate -h
usage: translate [-h] [-d DEST] [-s SRC] [-c] text

Python Google Translator as a command-line tool

positional arguments:
  text                  The text you want to translate.

options:
  -h, --help            show this help message and exit
  -d DEST, --dest DEST  The destination language you want to translate. (Default: en)
  -s SRC, --src SRC     The source language you want to translate. (Default: auto)
  -c, --detect


translate "veritas lux mea" -s la -d en
Traceback (most recent call last):
  File "/usr/bin/translate", line 40, in <module>
    main()
  File "/usr/bin/translate", line 29, in main
    result = translator.translate(args.text, dest=args.dest, src=args.src)
  File "/usr/lib/python3.10/site-packages/googletrans/client.py", line 182, in translate
    data = self._translate(text, dest, src, kwargs)
  File "/usr/lib/python3.10/site-packages/googletrans/client.py", line 78, in _translate
    token = self.token_acquirer.do(text)
  File "/usr/lib/python3.10/site-packages/googletrans/gtoken.py", line 194, in do
    self._update()
  File "/usr/lib/python3.10/site-packages/googletrans/gtoken.py", line 62, in _update
    code = self.RE_TKK.search(r.text).group(1).replace('var ', '')
AttributeError: 'NoneType' object has no attribute 'group'

and the same with current packages :(
Comment 23 katnatek 2025-03-27 21:32:39 CET
(In reply to Thomas Andrews from comment #21)
> In the VM from comment 0, where I had installed wapiti and dependencies,
> followed by python3-lz4, I first got all other pending updates, then used
> qarepo to get the packages from comment 18, and installed them.
> 
> The command "wapiti" now gives me the same result as papoteur (except in
> English). "wapiti -h" shows the proper help advice, with no errors.
> 
> I will try in a VM with wapiti not already installed.

The issue was updated python3-httpcore not was installed after update I get the package and now works


If somebody can confirm python3-aioruuvigateway and orange works (or not) before and after the update we can give this OK
Comment 24 Thomas Andrews 2025-03-27 22:39:44 CET
I ran into the same problem in my second VM, until I realized the new python3-httpcore had to be an update. I installed, and the help command works.

But, we still have a problem, a new one. I tried to do a scan of a test site from 
http://www.vulnweb.com/ and got another error:

$ wapiti -u http://testhtml5.vulnweb.com/

     __      __               .__  __  .__________
    /  \    /  \_____  ______ |__|/  |_|__\_____  \
    \   \/\/   /\__  \ \____ \|  \   __\  | _(__  <
     \        /  / __ \|  |_> >  ||  | |  |/       \
      \__/\  /  (____  /   __/|__||__| |__/______  /
           \/        \/|__|                      \/
Wapiti-3.0.5 (wapiti.sourceforge.io)
[*] Be careful! New moon tonight.
GET http://testhtml5.vulnweb.com/ (0) generated an exception: AsyncClient.send() got an unexpected keyword argument 'allow_redirects'
[*] Saving scan state, please wait...

 Note
========
This scan has been saved in the file /home/tom/.wapiti/scans/testhtml5.vulnweb.com_folder_210851b2.db
[*] Wapiti found 0 URLs and forms during the scan
[*] Loading modules:
         backup, brute_login_form, buster, cookieflags, crlf, csp, csrf, drupal_enum, exec, file, htaccess, http_headers, methods, nikto, permanentxss, redirect, shellshock, sql, ssrf, timesql, wapp, wp_enum, xss, xxe

[*] Launching module csp

[*] Launching module http_headers

[*] Launching module cookieflags

[*] Launching module exec

[*] Launching module file

[*] Launching module sql

[*] Launching module xss

[*] Launching module ssrf
[*] Asking endpoint URL https://wapiti3.ovh/get_ssrf.php?session_id=2uroxl for results, please wait...
Traceback (most recent call last):
  File "/usr/bin/wapiti", line 33, in <module>
    sys.exit(load_entry_point('wapiti3==3.0.5', 'console_scripts', 'wapiti')())
  File "/usr/lib/python3.10/site-packages/wapitiCore/main/wapiti.py", line 1297, in wapiti_asyncio_wrapper
    asyncio.run(wapiti_main())
  File "/usr/lib64/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib64/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
  File "/usr/lib/python3.10/site-packages/wapitiCore/main/wapiti.py", line 1286, in wapiti_main
    await wap.attack(stop_event)
  File "/usr/lib/python3.10/site-packages/wapitiCore/main/wapiti.py", line 484, in attack
    await attack_module.finish()
  File "/usr/lib/python3.10/site-packages/wapitiCore/attack/mod_ssrf.py", line 194, in finish
    response = await self.crawler.async_send(endpoint_request)
  File "/usr/lib/python3.10/site-packages/wapitiCore/net/crawler.py", line 555, in async_send
    page = await self.async_get(resource, headers=headers, follow_redirects=follow_redirects)
  File "/usr/lib/python3.10/site-packages/wapitiCore/net/crawler.py", line 117, in inner_wrapper
    value = await function(*args, **kwargs)
  File "/usr/lib/python3.10/site-packages/wapitiCore/net/crawler.py", line 429, in async_get
    response = await self.client.send(
TypeError: AsyncClient.send() got an unexpected keyword argument 'allow_redirects'

Other URLs, not related to the one above, generated the same exception.
Comment 25 katnatek 2025-03-27 22:53:09 CET
Looks like orange/python3-httpx need rebuild/update

orange-canvas 
Traceback (most recent call last):
  File "/usr/lib/python3.10/site-packages/pkg_resources/__init__.py", line 581, in _build_master
    ws.require(__requires__)
  File "/usr/lib/python3.10/site-packages/pkg_resources/__init__.py", line 909, in require
    needed = self.resolve(parse_requirements(requirements))
  File "/usr/lib/python3.10/site-packages/pkg_resources/__init__.py", line 800, in resolve
    raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.ContextualVersionConflict: (httpcore 1.0.7 (/usr/lib/python3.10/site-packages), Requirement.parse('httpcore<0.16.0,>=0.15.0'), {'httpx'})

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/bin/orange-canvas", line 33, in <module>
    sys.exit(load_entry_point('Orange3==3.31.1', 'gui_scripts', 'orange-canvas')())
  File "/usr/bin/orange-canvas", line 25, in importlib_load_entry_point
    return next(matches).load()
  File "/usr/lib64/python3.10/importlib/metadata/__init__.py", line 171, in load
    module = import_module(match.group('module'))
  File "/usr/lib64/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 992, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 992, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/usr/lib64/python3.10/site-packages/Orange/__init__.py", line 4, in <module>
    from Orange import data
  File "/usr/lib64/python3.10/site-packages/Orange/data/__init__.py", line 4, in <module>
    from .variable import *
  File "/usr/lib64/python3.10/site-packages/Orange/data/variable.py", line 14, in <module>
    from Orange.util import Registry, Reprable, OrangeDeprecationWarning
  File "/usr/lib64/python3.10/site-packages/Orange/util.py", line 8, in <module>
    import pkg_resources
  File "/usr/lib/python3.10/site-packages/pkg_resources/__init__.py", line 3260, in <module>
    def _initialize_master_working_set():
  File "/usr/lib/python3.10/site-packages/pkg_resources/__init__.py", line 3234, in _call_aside
    f(*args, **kwargs)
  File "/usr/lib/python3.10/site-packages/pkg_resources/__init__.py", line 3272, in _initialize_master_working_set
    working_set = WorkingSet._build_master()
  File "/usr/lib/python3.10/site-packages/pkg_resources/__init__.py", line 583, in _build_master
    return cls._build_from_requirements(__requires__)
  File "/usr/lib/python3.10/site-packages/pkg_resources/__init__.py", line 596, in _build_from_requirements
    dists = ws.resolve(reqs, Environment())
  File "/usr/lib/python3.10/site-packages/pkg_resources/__init__.py", line 795, in resolve
    raise DistributionNotFound(req, requirers)
pkg_resources.DistributionNotFound: The 'httpcore<0.16.0,>=0.15.0' distribution was not found and is required by httpx
Comment 26 katnatek 2025-03-28 03:39:29 CET
Can somebody confirm orange core dumps with the current packages?

orange-canvas 
/usr/lib64/python3.10/site-packages/Orange/widgets/data/owpythonscript.py:538: UserWarning: register 'summarize' function for type object. To silence this warning, set auto_summary of 'Object' to False.
  object = MultiInput(
/usr/lib64/python3.10/site-packages/Orange/widgets/data/owpythonscript.py:542: UserWarning: register 'summarize' function for type object. To silence this warning, set auto_summary of 'Object' to False.
  class Outputs:
Instrucción ilegal (`core' generado)

dmesg shows 

[ 6971.175569] traps: orange-canvas[24914] trap invalid opcode ip:7f8502fb66bb sp:7fffe8922400 error:0 in _tsne.cpython-310-x86_64-linux-gnu.so[7f8502fb3000+58000]
Comment 27 papoteur 2025-03-28 09:35:19 CET
(In reply to katnatek from comment #26)
> Can somebody confirm orange core dumps with the current packages?
> 
No, after updating python3-httpx to 0.28.1, it runs fine (at least I get the interface).
Do you want I push python-httpx 0.28.1?

All my tests are in Mageia 9.
Comment 28 katnatek 2025-03-28 10:21:18 CET Comment hidden (obsolete)
Comment 29 katnatek 2025-03-28 10:28:12 CET
(In reply to katnatek from comment #28)
> (In reply to papoteur from comment #27)
> I also have new Python googlechat
> should be included as part of this bug?
I mean Python googletrans
Comment 30 Herman Viaene 2025-03-28 14:40:21 CET
MGA9-64 Plasma Wayland on Compaq H000SB
On request of José I installed the current version + its python dependencies
Not much joy:

$ wapiti
Traceback (most recent call last):
  File "/usr/bin/wapiti", line 33, in <module>
    sys.exit(load_entry_point('wapiti3==3.0.5', 'console_scripts', 'wapiti')())
  File "/usr/bin/wapiti", line 25, in importlib_load_entry_point
    return next(matches).load()
  File "/usr/lib64/python3.10/importlib/metadata/__init__.py", line 171, in load
    module = import_module(match.group('module'))
  File "/usr/lib64/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/usr/lib/python3.10/site-packages/wapitiCore/main/wapiti.py", line 39, in <module>
    import browser_cookie3
  File "/usr/lib/python3.10/site-packages/browser_cookie3/__init__.py", line 10, in <module>
    import lz4.block
ModuleNotFoundError: No module named 'lz4'
Installed lz4 and python3-lz4

$ wapiti
Traceback (most recent call last):
  File "/usr/bin/wapiti", line 33, in <module>
    sys.exit(load_entry_point('wapiti3==3.0.5', 'console_scripts', 'wapiti')())
  File "/usr/bin/wapiti", line 25, in importlib_load_entry_point
    return next(matches).load()
  File "/usr/lib64/python3.10/importlib/metadata/__init__.py", line 171, in load
    module = import_module(match.group('module'))
  File "/usr/lib64/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/usr/lib/python3.10/site-packages/wapitiCore/main/wapiti.py", line 39, in <module>
    import browser_cookie3
  File "/usr/lib/python3.10/site-packages/browser_cookie3/__init__.py", line 14, in <module>
    from Crypto.Cipher import AES
ModuleNotFoundError: No module named 'Crypto'
There is a whole bunch of python3 packages with "crypto" in its name.....

CC: (none) => herman.viaene

Comment 31 Thomas Andrews 2025-03-28 16:34:25 CET
I installed Orange plus dependencies in the VM from comment 24, then ran 'orange-canvas', getting similar results to those of comment 25. 

Then I restored that VM to the state where wapiti had not yet been installed, and none of the packages above had been updated. I installed orange plus dependencies (without wapiti):

# urpmi orange
To satisfy dependencies, the following packages are going to be installed:
  Package                        Version      Release       Arch    
(medium "Core Release")
  gcr                            3.41.1       1.mga9        x86_64  (recommended)
  lib64gcr-ui3_1                 3.41.1       1.mga9        x86_64  (recommended)
  lib64gnome-keyring-gir1.0      3.12.0       13.mga9       x86_64  
  lib64gnome-keyring0            3.12.0       13.mga9       x86_64  
  libgnome-keyring-i18n          3.12.0       13.mga9       noarch  
  orange                         3.31.1       1.mga9        x86_64  
  pinentry-gnome3                1.2.1        1.mga9        x86_64  (recommended)
  python-pygraphviz-doc          1.10         1.mga9        noarch  (recommended)
  python3-anyqt                  0.1.0        1.mga9        noarch  
  python3-async-timeout          4.0.2        2.mga9        noarch  (recommended)
  python3-baycomp                1.0.2        6.mga9        noarch  
  python3-bottleneck             1.3.7        1.mga9        x86_64  
  python3-cachecontrol           0.12.10      4.mga9        noarch  
  python3-cachecontrol+filecache 0.12.10      4.mga9        noarch  
  python3-cachecontrol+redis     0.12.10      4.mga9        noarch  (recommended)
  python3-commonmark             0.9.1        3.mga9        noarch  
  python3-deprecated             1.2.13       4.mga9        noarch  (recommended)
  python3-dictdiffer             0.9.0        1.mga9        noarch  
  python3-docutils               0.19         1.mga9        noarch  
  python3-et_xmlfile             1.1.0        2.mga9        noarch  
  python3-future                 0.18.3       1.mga9        noarch  
  python3-gdal                   3.6.1        2.mga9        x86_64  (recommended)
  python3-h5py                   3.7.0        2.mga9        x86_64  (recommended)
  python3-jeepney                0.8.0        1.mga9        noarch  
  python3-joblib                 1.2.0        1.mga9        noarch  
  python3-jupyter-qtconsole      5.3.2        2.mga9        noarch  
  python3-keyring                23.9.3       1.mga9        noarch  
  python3-keyrings.alt           4.0.2        3.mga9        noarch  
  python3-lockfile               0.12.2       10.mga9       noarch  
  python3-louvain                0.16         2.mga9        noarch  
  python3-msgpack                1.0.4        1.mga9        x86_64  
  python3-openTSNE               0.6.2        1.mga9        x86_64  
  python3-openpyxl               3.0.10       1.mga9        noarch  
  python3-orange-canvas-core     0.1.24       1.mga9        noarch  
  python3-orange-widget-base     4.16.1       1.mga9        noarch  
  python3-pandas-datareader      0.10.0       3.mga9        noarch  (recommended)
  python3-pydot                  1.4.2        3.mga9        noarch  (recommended)
  python3-pygraphviz             1.10         1.mga9        x86_64  (recommended)
  python3-pyqtgraph              0.13.1       1.mga9        noarch  
  python3-qasync                 0.23.0       1.mga9        noarch  
  python3-qt5-webengine          5.15.6       2.mga9        x86_64  
  python3-qtpy                   2.3.0        1.mga9        noarch  
  python3-redis                  4.3.4        1.mga9        noarch  (recommended)
  python3-secretstorage          3.3.3        1.mga9        noarch  
  python3-serverfiles            0.3.1        3.mga9        noarch  
  python3-threadpoolctl          3.1.0        1.mga9        noarch  
  python3-wrapt                  1.14.1       1.mga9        x86_64  (recommended)
  python3-xlrd                   2.0.1        4.mga9        noarch  
  python3-xlsxwriter             3.0.3        1.mga9        noarch  
  python3-xlwt                   1.3.0        3.mga9        noarch  (recommended)
  seahorse                       43.0         1.mga9        x86_64  (recommended)
(medium "Core Updates")
  gnome-keyring                  42.1         1.1.mga9      x86_64  (recommended)
  lib64gnome-keyring             42.1         1.1.mga9      x86_64  (recommended)
  python3-networkx               2.8.8        1.1.mga9      noarch  
  python3-pandas                 1.4.1        2.1.mga9      x86_64  
  python3-pip                    23.0.1       1.1.mga9      noarch  
  python3-scikit-learn           1.1.2        2.1.mga9      x86_64  
209MB of additional disk space will be used.
44MB of packages will be retrieved.
Proceed with the installation of the 57 packages? (Y/n) 

No installation issues. 'orange-canvas' starts a GUI with no issues that I can see, so it would appear that something about installing wapiti and/or the pending updates breaks it - sometimes.

@katnatek: Now what?
Comment 32 papoteur 2025-03-28 16:48:22 CET
(In reply to papoteur from comment #15)
> And for wapiti itself, it is enough to add:
> BuildRequires: pyproject-rpm-macros
> ...
> %generate_buildrequires
> %pyproject_buildrequires

This has still to be done, to be sure that all requested modules are pulled and avoid the problems of comment 30.
Comment 33 papoteur 2025-03-28 16:57:20 CET
(In reply to katnatek from comment #29)
> (In reply to katnatek from comment #28)
> > (In reply to papoteur from comment #27)
> > I also have new Python googlechat
> > should be included as part of this bug?
> I mean Python googletrans

I think it has to be moved out of this report which is already complex.
Comment 34 katnatek 2025-03-28 22:14:53 CET
(In reply to Thomas Andrews from comment #31)
> I installed Orange plus dependencies in the VM from comment 24, then ran
> 'orange-canvas', getting similar results to those of comment 25. 
> 
> Then I restored that VM to the state where wapiti had not yet been
> installed, and none of the packages above had been updated. I installed
> orange plus dependencies (without wapiti):
> 
> # urpmi orange
> To satisfy dependencies, the following packages are going to be installed:
>   Package                        Version      Release       Arch    
> (medium "Core Release")
>   gcr                            3.41.1       1.mga9        x86_64 
> (recommended)
>   lib64gcr-ui3_1                 3.41.1       1.mga9        x86_64 
> (recommended)
>   lib64gnome-keyring-gir1.0      3.12.0       13.mga9       x86_64  
>   lib64gnome-keyring0            3.12.0       13.mga9       x86_64  
>   libgnome-keyring-i18n          3.12.0       13.mga9       noarch  
>   orange                         3.31.1       1.mga9        x86_64  
>   pinentry-gnome3                1.2.1        1.mga9        x86_64 
> (recommended)
>   python-pygraphviz-doc          1.10         1.mga9        noarch 
> (recommended)
>   python3-anyqt                  0.1.0        1.mga9        noarch  
>   python3-async-timeout          4.0.2        2.mga9        noarch 
> (recommended)
>   python3-baycomp                1.0.2        6.mga9        noarch  
>   python3-bottleneck             1.3.7        1.mga9        x86_64  
>   python3-cachecontrol           0.12.10      4.mga9        noarch  
>   python3-cachecontrol+filecache 0.12.10      4.mga9        noarch  
>   python3-cachecontrol+redis     0.12.10      4.mga9        noarch 
> (recommended)
>   python3-commonmark             0.9.1        3.mga9        noarch  
>   python3-deprecated             1.2.13       4.mga9        noarch 
> (recommended)
>   python3-dictdiffer             0.9.0        1.mga9        noarch  
>   python3-docutils               0.19         1.mga9        noarch  
>   python3-et_xmlfile             1.1.0        2.mga9        noarch  
>   python3-future                 0.18.3       1.mga9        noarch  
>   python3-gdal                   3.6.1        2.mga9        x86_64 
> (recommended)
>   python3-h5py                   3.7.0        2.mga9        x86_64 
> (recommended)
>   python3-jeepney                0.8.0        1.mga9        noarch  
>   python3-joblib                 1.2.0        1.mga9        noarch  
>   python3-jupyter-qtconsole      5.3.2        2.mga9        noarch  
>   python3-keyring                23.9.3       1.mga9        noarch  
>   python3-keyrings.alt           4.0.2        3.mga9        noarch  
>   python3-lockfile               0.12.2       10.mga9       noarch  
>   python3-louvain                0.16         2.mga9        noarch  
>   python3-msgpack                1.0.4        1.mga9        x86_64  
>   python3-openTSNE               0.6.2        1.mga9        x86_64  
>   python3-openpyxl               3.0.10       1.mga9        noarch  
>   python3-orange-canvas-core     0.1.24       1.mga9        noarch  
>   python3-orange-widget-base     4.16.1       1.mga9        noarch  
>   python3-pandas-datareader      0.10.0       3.mga9        noarch 
> (recommended)
>   python3-pydot                  1.4.2        3.mga9        noarch 
> (recommended)
>   python3-pygraphviz             1.10         1.mga9        x86_64 
> (recommended)
>   python3-pyqtgraph              0.13.1       1.mga9        noarch  
>   python3-qasync                 0.23.0       1.mga9        noarch  
>   python3-qt5-webengine          5.15.6       2.mga9        x86_64  
>   python3-qtpy                   2.3.0        1.mga9        noarch  
>   python3-redis                  4.3.4        1.mga9        noarch 
> (recommended)
>   python3-secretstorage          3.3.3        1.mga9        noarch  
>   python3-serverfiles            0.3.1        3.mga9        noarch  
>   python3-threadpoolctl          3.1.0        1.mga9        noarch  
>   python3-wrapt                  1.14.1       1.mga9        x86_64 
> (recommended)
>   python3-xlrd                   2.0.1        4.mga9        noarch  
>   python3-xlsxwriter             3.0.3        1.mga9        noarch  
>   python3-xlwt                   1.3.0        3.mga9        noarch 
> (recommended)
>   seahorse                       43.0         1.mga9        x86_64 
> (recommended)
> (medium "Core Updates")
>   gnome-keyring                  42.1         1.1.mga9      x86_64 
> (recommended)
>   lib64gnome-keyring             42.1         1.1.mga9      x86_64 
> (recommended)
>   python3-networkx               2.8.8        1.1.mga9      noarch  
>   python3-pandas                 1.4.1        2.1.mga9      x86_64  
>   python3-pip                    23.0.1       1.1.mga9      noarch  
>   python3-scikit-learn           1.1.2        2.1.mga9      x86_64  
> 209MB of additional disk space will be used.
> 44MB of packages will be retrieved.
> Proceed with the installation of the 57 packages? (Y/n) 
> 
> No installation issues. 'orange-canvas' starts a GUI with no issues that I
> can see, so it would appear that something about installing wapiti and/or
> the pending updates breaks it - sometimes.
> 
> @katnatek: Now what?

Now I have to import the new packages and when ready I ask you to test again
Thank you for this looks like a hardware issue like ffmpegmulticonverter :S
Comment 35 katnatek 2025-03-29 02:08:43 CET Comment hidden (obsolete)
katnatek 2025-03-29 02:09:14 CET

Status comment: (none) => Package List in comment 35

Comment 36 katnatek 2025-03-29 02:38:15 CET Comment hidden (obsolete)
Comment 37 katnatek 2025-03-29 02:43:16 CET
mnemosyne starts but that is all what I can test and as requires python3-googletrans something must not works
Comment 38 katnatek 2025-03-29 02:49:34 CET Comment hidden (obsolete)
Comment 39 Thomas Andrews 2025-03-29 04:23:54 CET
"Thomas can you confirm not issues with orange-canvas after the update please?"

Will see what I can do, but it will have to wait until tomorrow afternoon. Too late tonight, Lord knows I need my beauty sleep. Busy with my brother in the morning.
Comment 40 Jani Välimaa 2025-03-29 07:19:13 CET
(In reply to katnatek from comment #35)
> Packages:
> 
> python3-httpcore-1.0.7-1.mga9
> python3-httpx-socks-0.10.0-1.mga9
> python3-browser-cookie3-0.20.1-1.mga9
> python3-flit-core-3.11.0-1.mga9
> python3-socksio-1.0.0-1.mga9
> python3-httpx+brotli-0.28.1-1.mga9
> python3-httpx+cli-0.28.1-1.mga9
> python3-httpx+http2-0.28.1-1.mga9
> python3-httpx+socks-0.28.1-1.mga9
> python3-httpx-0.28.1-1.mga9
> wapiti-3.0.5-3.1.mga9
> 
> 
> 
> SRPMS
> python-httpcore-1.0.7-1.mga9
> python-httpx-socks-0.10.0-1.mga9
> python-browser-cookie3-0.20.1-1.mga9
> python-flit-core-3.11.0-1.mga9
> python-socksio-1.0.0-1.mga9
> python-httpx-0.28.1-1.mga9
> wapiti-3.0.5-3.1.mga9

$ urpmq --sourcerpm python3-flit-core --media 'Core Release'
python3-flit-core: python-flit-3.8.0-2.mga9.src.rpm

In mga9 python3-flit-core is coming from python-flit SRPM. This update makes possible future python-flit update rejected due to a newer pkg exists in repo.

Was python-flit-core import and update from Cauldron really needed? If so, python-flit needs to be also fixed to not ship python3-flit-core.
Comment 41 katnatek 2025-03-29 08:02:41 CET
(In reply to Jani Välimaa from comment #40)
> $ urpmq --sourcerpm python3-flit-core --media 'Core Release'
> python3-flit-core: python-flit-3.8.0-2.mga9.src.rpm
> 
> In mga9 python3-flit-core is coming from python-flit SRPM. This update makes
> possible future python-flit update rejected due to a newer pkg exists in
> repo.
> 
> Was python-flit-core import and update from Cauldron really needed? If so,
> python-flit needs to be also fixed to not ship python3-flit-core.

oython-socksio build was failing with error related to flit
The exactt message will be posted latter
I have to make a rebuild without updates_testing enabled
Comment 42 katnatek 2025-03-29 08:07:02 CET Comment hidden (obsolete)
Comment 43 papoteur 2025-03-29 08:21:10 CET
Hello katnatek.
What is also the need to update python-socksio?
Comment 44 katnatek 2025-03-29 08:28:44 CET
(In reply to papoteur from comment #43)
> Hello katnatek.
> What is also the need to update python-socksio?

New httox, did you get it without that?
Comment 45 katnatek 2025-03-29 08:44:36 CET
(In reply to katnatek from comment #41)
> (In reply to Jani Välimaa from comment #40)
> > $ urpmq --sourcerpm python3-flit-core --media 'Core Release'
> > python3-flit-core: python-flit-3.8.0-2.mga9.src.rpm
> > 
> > In mga9 python3-flit-core is coming from python-flit SRPM. This update makes
> > possible future python-flit update rejected due to a newer pkg exists in
> > repo.
> > 
> > Was python-flit-core import and update from Cauldron really needed? If so,
> > python-flit needs to be also fixed to not ship python3-flit-core.
> 
> oython-socksio build was failing with error related to flit
> The exactt message will be posted latter
> I have to make a rebuild without updates_testing enabled
when try to build socksio from mga 10

Problem: nothing provides requested (python3dist(flit-core) < 3~~ with python3dist(flit-core) >= 2)

I accept no deep check, how to fix
That issue because building from modified
socksio for mageia 9 build OK

So remove new flit & make new socksio build
or what suggest?
Comment 46 Jani Välimaa 2025-03-29 09:34:51 CET
(In reply to katnatek from comment #45)
> (In reply to katnatek from comment #41)
> > (In reply to Jani Välimaa from comment #40)
> > > $ urpmq --sourcerpm python3-flit-core --media 'Core Release'
> > > python3-flit-core: python-flit-3.8.0-2.mga9.src.rpm
> > > 
> > > In mga9 python3-flit-core is coming from python-flit SRPM. This update makes
> > > possible future python-flit update rejected due to a newer pkg exists in
> > > repo.
> > > 
> > > Was python-flit-core import and update from Cauldron really needed? If so,
> > > python-flit needs to be also fixed to not ship python3-flit-core.
> > 
> > oython-socksio build was failing with error related to flit
> > The exactt message will be posted latter
> > I have to make a rebuild without updates_testing enabled
> when try to build socksio from mga 10
> 
> Problem: nothing provides requested (python3dist(flit-core) < 3~~ with
> python3dist(flit-core) >= 2)
> 
> I accept no deep check, how to fix
> That issue because building from modified
> socksio for mageia 9 build OK
> 
> So remove new flit & make new socksio build
> or what suggest?

Python packages building in Cauldron doesn't necessarily build in mga9 as is. Urpmi doesn't handle RPM's boolean dependencies [1] so we tweak python BRs automatic in %generate_buildrequires with %pyproject_buildrequires macro. This feature was introduced in Cauldron only after mga9. In mga9 one needs to fix boolean deps by hand either in %pre via sed magic or with a patch.

Looks like python-flit-core import from Cauldron was completely unneeded, and should be reverted. Please, always check what pkgs we already have available. 'urpmq -Yf' or 'urpmf --provides' is your friend.

[1] https://rpm-software-management.github.io/rpm/manual/boolean_dependencies.html
Comment 47 Herman Viaene 2025-03-29 11:42:13 CET
Installed packages from Comment , then
$ wapiti

     __    __            _ _   _ _____
    / / /\ \ \__ _ _ __ (_) |_(_)___ /
    \ \/  \/ / _` | '_ \| | __| | |_ \
     \  /\  / (_| | |_) | | |_| |___) |
      \/  \/ \__,_| .__/|_|\__|_|____/
                  |_|                 
Wapiti-3.0.5 (wapiti.sourceforge.io)
[*] Be careful! New moon tonight.
usage: wapiti [-h] [-u URL] [--scope {page,folder,domain,url,punk}] [-m MODULES_LIST] [--list-modules] [--update] [-l LEVEL] [-p PROXY_URL] [--tor]
              [-a CREDENTIALS] [--auth-type {basic,digest,ntlm,post}] [-c COOKIE_FILE] [--drop-set-cookie] [--skip-crawl] [--resume-crawl]
              [--flush-attacks] [--flush-session] [--store-session PATH] [--store-config PATH] [-s URL] [-x URL] [-r PARAMETER] [--skip PARAMETER]
              [-d DEPTH] [--max-links-per-page MAX] [--max-files-per-dir MAX] [--max-scan-time SECONDS] [--max-attack-time SECONDS] [--max-parameters MAX]
              [-S FORCE] [--tasks tasks] [-t SECONDS] [-H HEADER] [-A AGENT] [--verify-ssl {0,1}] [--color] [-v LEVEL] [-f FORMAT] [-o OUTPUT_PATH]
              [--external-endpoint EXTERNAL_ENDPOINT_URL] [--internal-endpoint INTERNAL_ENDPOINT_URL] [--endpoint ENDPOINT_URL] [--no-bugreport]
              [--version]
wapiti: error: one of the arguments -u/--url --list-modules --update is required

$ wapiti -u https:<own site on desktop>
     __      __               .__  __  .__________
    /  \    /  \_____  ______ |__|/  |_|__\_____  \
    \   \/\/   /\__  \ \____ \|  \   __\  | _(__  <
     \        /  / __ \|  |_> >  ||  | |  |/       \
      \__/\  /  (____  /   __/|__||__| |__/______  /
           \/        \/|__|                      \/
Wapiti-3.0.5 (wapiti.sourceforge.io)
[*] Be careful! New moon tonight.
GET https:<own site on desktop> (0) generated an exception: AsyncClient.__init__() got an unexpected keyword argument 'proxies'
[*] Saving scan state, please wait...

 Note
========
This scan has been saved in the file /home/tester9/.wapiti/scans/<own site on desktop>_folder_961ada5f.db
[*] Wapiti found 0 URLs and forms during the scan
[*] Loading modules:
         backup, brute_login_form, buster, cookieflags, crlf, csp, csrf, drupal_enum, exec, file, htaccess, http_headers, methods, nikto, permanentxss, redirect, shellshock, sql, ssrf, timesql, wapp, wp_enum, xss, xxe

[*] Launching module csp

[*] Launching module http_headers

[*] Launching module cookieflags

[*] Launching module exec

[*] Launching module file

[*] Launching module sql

[*] Launching module xss

[*] Launching module ssrf
[*] Asking endpoint URL https://wapiti3.ovh/get_ssrf.php?session_id=d2ioku for results, please wait...
Traceback (most recent call last):
  File "/usr/bin/wapiti", line 33, in <module>
    sys.exit(load_entry_point('wapiti3==3.0.5', 'console_scripts', 'wapiti')())
  File "/usr/lib/python3.10/site-packages/wapitiCore/main/wapiti.py", line 1297, in wapiti_asyncio_wrapper
    asyncio.run(wapiti_main())
  File "/usr/lib64/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib64/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
  File "/usr/lib/python3.10/site-packages/wapitiCore/main/wapiti.py", line 1286, in wapiti_main
    await wap.attack(stop_event)
  File "/usr/lib/python3.10/site-packages/wapitiCore/main/wapiti.py", line 484, in attack
    await attack_module.finish()
  File "/usr/lib/python3.10/site-packages/wapitiCore/attack/mod_ssrf.py", line 194, in finish
    response = await self.crawler.async_send(endpoint_request)
  File "/usr/lib/python3.10/site-packages/wapitiCore/net/crawler.py", line 555, in async_send
    page = await self.async_get(resource, headers=headers, follow_redirects=follow_redirects)
  File "/usr/lib/python3.10/site-packages/wapitiCore/net/crawler.py", line 117, in inner_wrapper
    value = await function(*args, **kwargs)
  File "/usr/lib/python3.10/site-packages/wapitiCore/net/crawler.py", line 427, in async_get
    request = self.client.build_request("GET", resource.url, headers=headers)
  File "/usr/lib/python3.10/site-packages/wapitiCore/net/crawler.py", line 203, in client
    self._client = httpx.AsyncClient(
TypeError: AsyncClient.__init__() got an unexpected keyword argument 'proxies'
Comment 48 Herman Viaene 2025-03-29 11:46:21 CET
To a simple QA-tester like me, this bug seems to try to handle multiple issues all at once. Could it be wiser/easier/handier/.... to close this one and open a bug for each issue??? As far as I remember, one bug could be blocked by another one to form a chain that can be handled.
Just a thought.
Comment 49 katnatek 2025-03-29 17:24:57 CET
(In reply to Jani Välimaa from comment #46)
> (In reply to katnatek from comment #45)
> > (In reply to katnatek from comment #41)
> > > (In reply to Jani Välimaa from comment #40)
> > > > $ urpmq --sourcerpm python3-flit-core --media 'Core Release'
> > > > python3-flit-core: python-flit-3.8.0-2.mga9.src.rpm
> > > > 
> > > > In mga9 python3-flit-core is coming from python-flit SRPM. This update makes
> > > > possible future python-flit update rejected due to a newer pkg exists in
> > > > repo.
> > > > 
> > > > Was python-flit-core import and update from Cauldron really needed? If so,
> > > > python-flit needs to be also fixed to not ship python3-flit-core.
> > > 
> > > oython-socksio build was failing with error related to flit
> > > The exactt message will be posted latter
> > > I have to make a rebuild without updates_testing enabled
> > when try to build socksio from mga 10
> > 
> > Problem: nothing provides requested (python3dist(flit-core) < 3~~ with
> > python3dist(flit-core) >= 2)
> > 
> > I accept no deep check, how to fix
> > That issue because building from modified
> > socksio for mageia 9 build OK
> > 
> > So remove new flit & make new socksio build
> > or what suggest?
> 
> Python packages building in Cauldron doesn't necessarily build in mga9 as
> is. Urpmi doesn't handle RPM's boolean dependencies [1] so we tweak python
> BRs automatic in %generate_buildrequires with %pyproject_buildrequires
> macro. This feature was introduced in Cauldron only after mga9. In mga9 one
> needs to fix boolean deps by hand either in %pre via sed magic or with a
> patch.
> 
> Looks like python-flit-core import from Cauldron was completely unneeded,
> and should be reverted. Please, always check what pkgs we already have
> available. 'urpmq -Yf' or 'urpmf --provides' is your friend.
> 
> [1]
> https://rpm-software-management.github.io/rpm/manual/boolean_dependencies.
> html
Was a build in copr so urpmi not is in the equation, but yes I find things that build in copr and need extra work for mageia's BS and viceversa
Comment 50 Thomas Andrews 2025-03-29 18:48:34 CET
I was about to try testing the new packages from comment 35, but after reading subsequent comments I'm holding off until the situation is more, um, settled.
Comment 51 katnatek 2025-03-30 05:08:41 CEST Comment hidden (obsolete)
katnatek 2025-03-30 05:09:05 CEST

Status comment: Package List in comment 35 => Package List in comment 51

Comment 52 katnatek 2025-03-30 05:17:51 CEST
RH x86_64

Now clean install also get the updated httpx

 LC_ALL=C urpmi wapiti
To satisfy dependencies, the following packages are going to be installed:
  Package                        Version      Release       Arch    
(medium "Core Release (Installer) (DVD1)")
  python3-beaker                 1.12.1       1.mga9        noarch  
  python3-mako                   1.2.2        1.mga9        noarch  
(medium "QA Testing (64-bit)")
  python3-browser-cookie3        0.20.1       1.mga9        noarch  
  python3-httpx                  0.28.1       1.1.mga9      noarch  
  python3-httpx-socks            0.10.0       1.mga9        noarch  
  wapiti                         3.0.5        3.2.mga9      noarch  
(medium "Core Release")
  python3-importlib-metadata     6.0.0        1.mga9        noarch  
  python3-socks                  2.0.3        2.mga9        noarch  
  python3-tld                    0.12.6       3.mga9        noarch  
  python3-yaswfp                 0.9.3        5.mga9        noarch  
(medium "Core Updates")
  python3-zipp                   3.8.1        3.1.mga9      noarch  
6.3MB of additional disk space will be used.
1.5MB of packages will be retrieved.
Proceed with the installation of the 11 packages? (Y/n)y

wapiti still need to get updated httpcore :S
Comment 53 katnatek 2025-03-30 05:24:27 CEST
Packages:

python3-httpcore-1.0.7-1.mga9
python3-httpx-socks-0.10.0-1.mga9
python3-browser-cookie3-0.20.1-1.mga9
python3-socksio-1.0.0-1.1.mga9
python3-httpx+brotli-0.28.1-1.1.mga9
python3-httpx+cli-0.28.1-1.1.mga9
python3-httpx+http2-0.28.1-1.1.mga9
python3-httpx+socks-0.28.1-1.1.mga9
python3-httpx-0.28.1-1.1.mga9
wapiti-3.0.5-3.3.mga9


SRPMS
python-httpcore-1.0.7-1.mga9
python-httpx-socks-0.10.0-1.mga9
python-browser-cookie3-0.20.1-1.mga9
python-socksio-1.0.0-1.1.mga9
python-httpx-0.28.1-1.1.mga9
wapiti-3.0.5-3.3.mga9

Status comment: Package List in comment 51 => Package List in comment 52

katnatek 2025-03-30 05:24:47 CEST

Status comment: Package List in comment 52 => Package List in comment 53

Comment 54 katnatek 2025-03-30 06:11:29 CEST
For motive unknown to me I lost the updated python3-httpx and don't know why not get the updated httpcore

LC_ALL=C urpmi wapiti
To satisfy dependencies, the following packages are going to be installed:
  Package                        Version      Release       Arch    
(medium "Core Release (Installer) (DVD1)")
  python3-beaker                 1.12.1       1.mga9        noarch  
  python3-mako                   1.2.2        1.mga9        noarch  
(medium "QA Testing (64-bit)")
  python3-browser-cookie3        0.20.1       1.mga9        noarch  
  python3-httpx-socks            0.10.0       1.mga9        noarch  
  wapiti                         3.0.5        3.3.mga9      noarch  
(medium "Core Release")
  python3-importlib-metadata     6.0.0        1.mga9        noarch  
  python3-socks                  2.0.3        2.mga9        noarch  
  python3-tld                    0.12.6       3.mga9        noarch  
  python3-yaswfp                 0.9.3        5.mga9        noarch  
(medium "Core Updates")
  python3-zipp                   3.8.1        3.1.mga9      noarch  
6.3MB of additional disk space will be used.
1.3MB of packages will be retrieved.
Proceed with the installation of the 10 packages? (Y/n)

Tired for now tomorrow Wil see
Comment 55 papoteur 2025-03-30 11:23:09 CEST
(In reply to Herman Viaene from comment #47)
>     self._client = httpx.AsyncClient(
> TypeError: AsyncClient.__init__() got an unexpected keyword argument
> 'proxies'

This argument disappears from 0.28 release of python3-httpx.
We have to reverse to 0.27.2
wapiti is not yet ready for 0.28+ releases.
https://github.com/encode/httpx/issues/3424

This will be an issue in Cauldron.
katnatek 2025-03-30 18:55:35 CEST

See Also: (none) => https://bugs.mageia.org/show_bug.cgi?id=34144

Comment 56 katnatek 2025-03-30 18:56:57 CEST
(In reply to papoteur from comment #55)
> (In reply to Herman Viaene from comment #47)
> >     self._client = httpx.AsyncClient(
> > TypeError: AsyncClient.__init__() got an unexpected keyword argument
> > 'proxies'
> 
> This argument disappears from 0.28 release of python3-httpx.
> We have to reverse to 0.27.2
> wapiti is not yet ready for 0.28+ releases.
> https://github.com/encode/httpx/issues/3424
> 
> This will be an issue in Cauldron.

I ask to remove 0.28.1 I'll close this and open new one as is too long now

*** This bug has been marked as a duplicate of bug 34144 ***

Resolution: (none) => DUPLICATE
Status: NEW => RESOLVED


Note You need to log in before you can comment on or make changes to this bug.