Support PyTest container test suite for Python Container. #768

phracek · 2025-11-11T14:49:18Z

This pull request migrates bash test suite
to container-ci-suite stored here: https://github.org/sclorg/container-ci-suite

Introduce PyTest suite migrated from test/run bash suite.
Migration matrix is:

build_s2i_app is fixture that takes Path test-app from conftest.py
file.

test_container_application.py tests all test-app directories.

test_container_basics.py tests only basics w/o application.
It also tests test_dockerfile and test_minimal_dockerfile

Signed-off-by: Petr "Stone" Hracek [email protected]

This blocks: sclorg#768 Signed-off-by: Petr "Stone" Hracek <[email protected]>

This blocks: #768 Signed-off-by: Petr "Stone" Hracek <[email protected]>

Also VARS.* variables are used during the migration. Signed-off-by: Petr "Stone" Hracek <[email protected]>

Migration matrix is: `build_s2i_app` is fixture that takes `Path` test-app from `conftest.py` file. test_container_application.py tests all test-app directories. test_container_basics.py tests only basics w/o application. It also tests test_dockerfile and test_minimal_dockerfile Signed-off-by: Petr "Stone" Hracek <[email protected]>

Signed-off-by: Petr "Stone" Hracek <[email protected]>

phracek · 2025-11-11T15:00:18Z

Rebased against master. Let's run first round of tests.
[test][test-pytest][test-openshift-pytest]

github-actions · 2025-11-11T15:36:26Z

Testing Farm results

name	compose	arch	status	started (UTC)	time	logs
RHEL8 - PyTest - OpenShift 4 - 3.12	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:28:00	27min 36s	test pipeline
RHEL8 - PyTest - OpenShift 4 - 3.9	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:28:33	24min 45s	test pipeline
RHEL8 - 3.9-minimal	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:36:08	25min 52s	test pipeline
RHEL8 - PyTest - 3.11	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:05:23	37min 57s	test pipeline
RHEL8 - PyTest - OpenShift 4 - 3.12-minimal	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:49:14	24min 53s	test pipeline
RHEL8 - PyTest - 3.9	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:05:25	37min 59s	test pipeline
RHEL8 - PyTest - 3.12-minimal	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:05:25	30min 25s	test pipeline
RHEL10 - PyTest - OpenShift 4 - 3.12-minimal	RHEL-10-Nightly	x86_64	✅ passed	13.11.2025 10:44:08	22min 53s	test pipeline
RHEL8 - PyTest - OpenShift 4 - 3.11	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:56:22	25min 25s	test pipeline
RHEL10 - PyTest - 3.12-minimal	RHEL-10-Nightly	x86_64	✅ passed	13.11.2025 10:05:26	24min 13s	test pipeline
RHEL8 - PyTest - 3.9-minimal	RHEL-8.10.0-Nightly	x86_64	✅ passed	12.11.2025 12:51:57	27min 12s	test pipeline
RHEL9 - PyTest - OpenShift 4 - 3.12	RHEL-9.6.0-Nightly	x86_64	❌ error	13.11.2025 12:44:35	16min 21s	test pipeline
RHEL8 - PyTest - 3.11-minimal	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:39:48	27min 29s	test pipeline
RHEL9 - 3.9	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 10:25:47	29min 32s	test pipeline
RHEL9 - 3.12-minimal	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 10:34:20	29min 37s	test pipeline
RHEL9 - PyTest - 3.12-minimal	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 10:05:24	33min 41s	test pipeline
RHEL9 - PyTest - OpenShift 4 - 3.12-minimal	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 10:06:00	32min 31s	test pipeline
RHEL9 - PyTest - OpenShift 4 - 3.11	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 10:56:38	31min 9s	test pipeline
RHEL8 - 3.11	RHEL-8.10.0-Nightly	x86_64	❌ error	13.11.2025 10:31:57	26min 12s	test pipeline
RHEL9 - PyTest - 3.9	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 10:37:53	38min 32s	test pipeline
RHEL9 - PyTest - OpenShift 4 - 3.9	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 10:05:55	33min 47s	test pipeline
RHEL9 - PyTest - 3.11	RHEL-9.6.0-Nightly	x86_64	❌ error	13.11.2025 10:36:08	40min	test pipeline
RHEL8 - 3.12	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 11:00:47	27min 29s	test pipeline
RHEL8 - 3.12-minimal	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:05:47	27min 40s	test pipeline
RHEL10 - 3.12-minimal	RHEL-10-Nightly	x86_64	✅ passed	13.11.2025 10:44:16	21min 50s	test pipeline
CentOS Stream 9 - PyTest - 3.9	CentOS-Stream-9	x86_64	✅ passed	13.11.2025 10:05:25	30min 11s	test pipeline
CentOS Stream 10 - PyTest - 3.12-minimal	CentOS-Stream-10	x86_64	❌ error	13.11.2025 10:05:33	17min 20s	test pipeline
CentOS Stream 9 - PyTest - 3.11-minimal	CentOS-Stream-9	x86_64	✅ passed	13.11.2025 10:05:35	20min 45s	test pipeline
CentOS Stream 9 - PyTest - 3.12-minimal	CentOS-Stream-9	x86_64	✅ passed	13.11.2025 10:05:24	18min 60s	test pipeline
CentOS Stream 10 - 3.12	CentOS-Stream-10	x86_64	✅ passed	13.11.2025 10:05:49	21min 1s	test pipeline
RHEL9 - PyTest - 3.12	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 10:38:00	40min 17s	test pipeline
RHEL8 - PyTest - 3.12	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:40:26	34min 2s	test pipeline
RHEL8 - 3.11-minimal	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:37:58	25min 37s	test pipeline
RHEL8 - 3.9	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:55:00	27min 41s	test pipeline
Fedora - PyTest - 3.13	Fedora-latest	x86_64	❌ error	13.11.2025 10:05:34	29min 52s	test pipeline
CentOS Stream 9 - PyTest - 3.9-minimal	CentOS-Stream-9	x86_64	✅ passed	13.11.2025 10:05:24	20min 2s	test pipeline
CentOS Stream 10 - PyTest - 3.12	CentOS-Stream-10	x86_64	✅ passed	13.11.2025 10:05:26	29min 46s	test pipeline
CentOS Stream 9 - 3.12-minimal	CentOS-Stream-9	x86_64	✅ passed	12.11.2025 12:08:29	3h 6min 22s	test pipeline
RHEL9 - 3.11	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 10:23:53	30min 37s	test pipeline
RHEL9 - 3.12	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 11:02:31	34min 7s	test pipeline
CentOS Stream 9 - PyTest - 3.11	CentOS-Stream-9	x86_64	✅ passed	13.11.2025 10:05:25	30min 29s	test pipeline
CentOS Stream 9 - PyTest - 3.12	CentOS-Stream-9	x86_64	✅ passed	13.11.2025 10:05:35	30min 53s	test pipeline
CentOS Stream 9 - 3.9-minimal	CentOS-Stream-9	x86_64	✅ passed	13.11.2025 10:28:06	20min 13s	test pipeline
CentOS Stream 9 - 3.12	CentOS-Stream-9	x86_64	✅ passed	13.11.2025 10:40:22	21min 53s	test pipeline
CentOS Stream 9 - 3.11	CentOS-Stream-9	x86_64	✅ passed	13.11.2025 10:50:28	20min 56s	test pipeline
CentOS Stream 10 - 3.12-minimal	CentOS-Stream-10	x86_64	✅ passed	13.11.2025 10:05:46	18min 58s	test pipeline
CentOS Stream 9 - 3.9	CentOS-Stream-9	x86_64	✅ passed	13.11.2025 11:04:19	21min 43s	test pipeline
Fedora - 3.13	Fedora-latest	x86_64	✅ passed	13.11.2025 11:07:03	24min 15s	test pipeline
RHEL9 - OpenShift 4 - 3.12-minimal	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 11:02:52	27min 40s	test pipeline
RHEL10 - OpenShift 4 - 3.12-minimal	RHEL-10-Nightly	x86_64	✅ passed	13.11.2025 11:08:24	20min 25s	test pipeline
RHEL8 - OpenShift 4 - 3.9	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 11:04:57	24min 50s	test pipeline
RHEL9 - OpenShift 4 - 3.9	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 11:14:32	26min 41s	test pipeline
RHEL9 - OpenShift 4 - 3.12	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 10:25:42	27min 23s	test pipeline
RHEL9 - OpenShift 4 - 3.11	RHEL-9.6.0-Nightly	x86_64	✅ passed	13.11.2025 11:13:16	27min 56s	test pipeline
RHEL8 - OpenShift 4 - 3.12-minimal	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:54:02	19min 6s	test pipeline
RHEL8 - OpenShift 4 - 3.12	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 11:08:33	20min 16s	test pipeline
RHEL8 - OpenShift 4 - 3.11	RHEL-8.10.0-Nightly	x86_64	✅ passed	13.11.2025 10:26:40	21min 11s	test pipeline
CentOS Stream 9 - 3.11-minimal	CentOS-Stream-9	x86_64	✅ passed	13.11.2025 10:05:34	21min 20s	test pipeline

phracek · 2025-11-11T15:38:15Z

RHEL8 failures are caused by CDN errors:

[MIRROR] libffi-devel-3.1-24.el8.x86_64.rpm: Curl error (28): Timeout was reached for https://stagecdn.redhat.com/content/dist/rhel8/8/x86_64/baseos/os/Packages/l/libffi-devel-3.1-24.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 30 seconds]
[MIRROR] hunspell-en-0.20140811.1-12.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for https://stagecdn.redhat.com/content/dist/rhel8/8/x86_64/appstream/os/Packages/h/hunspell-en-0.20140811.1-12.el8.noarch.rpm [Received HTTP code 503 from proxy after CONNECT]
[MIRROR] libtalloc-2.4.1-0.el8.x86_64.rpm: Curl error (28): Timeout was reached for https://stagecdn.redhat.com/content/dist/rhel8/8/x86_64/baseos/os/Packages/l/libtalloc-2.4.1-0.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 30 seconds]
[MIRROR] openldap-devel-2.4.46-21.el8_10.x86_64.rpm: Curl error (28): Timeout was reached for https://stagecdn.redhat.com/content/dist/rhel8/8/x86_64/baseos/os/Packages/o/openldap-devel-2.4.46-21.el8_10.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 30 seconds]
[MIRROR] hunspell-en-GB-0.20140811.1-12.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for https://stagecdn.redhat.com/content/dist/rhel8/8/x86_64/appstream/os/Packages/h/hunspell-en-GB-0.20140811.1-12.el8.noarch.rpm [Received HTTP code 503 from proxy after CONNECT]
[MIRROR] libffi-devel-3.1-24.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for https://stagecdn.redhat.com/content/dist/rhel8/8/x86_64/baseos/os/Packages/l/libffi-devel-3.1-24.el8.x86_64.rpm [Received HTTP code 503 from proxy after CONNECT]
[FAILED] libffi-devel-3.1-24.el8.x86_64.rpm: No more mirrors to try - All mirrors were already tried without success

The downloaded packages were saved in cache until the next successful t

Add distgen generated files Signed-off-by: Petr "Stone" Hracek <[email protected]>

phracek · 2025-11-12T10:58:36Z

[test][test-all]

phracek · 2025-11-13T10:04:29Z

The new container-ci-suite was released. Let's re-test it.

[test-all]

phracek · 2025-11-13T12:55:37Z

Python failures are:

C10S - PyTest - 3.12-minimal:

[notice] A new release of pip is available: 24.2 -> 25.3
[notice] To update, run: pip install --upgrade pip
--> 04db29fbc4be
[2/2] STEP 1/6: FROM quay.io/sclorg/python-312-minimal-c10s:3.12-minimal
[2/2] STEP 2/6: COPY --from=builder $APP_ROOT $APP_ROOT
--> 8b1aba1b0f19
[2/2] STEP 3/6: USER 0
--> 8f0c8050bef9
[2/2] STEP 4/6: RUN microdnf install -y httpd enchant
Downloading metadata...
Downloading metadata...
Downloading metadata...
error: No package matches 'enchant'
Error: building at STEP "RUN microdnf install -y httpd enchant": while running runtime: exit status 1

It caused, I guess, main image should not be pulled. C10S - 3.12 should not be exists in quay.io/sclorg/python-312-c10s. RHEL10 does not exists.

Fedora PyTest - 3.13 - test_container_basics.py::TestS2IPythonContainer::test_dockerfiles[Dockerfile.tpl] INFO:Image name to test: quay.io/fedora/python3-313:3.13

Downloading setuptools-80.9.0-py3-none-any.whl (1.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 428.5 MB/s eta 0:00:00
Building wheels for collected packages: psycopg2-binary
  Building wheel for psycopg2-binary (pyproject.toml): started
  Building wheel for psycopg2-binary (pyproject.toml): finished with status 'error'
  error: subprocess-exited-with-error
  
  × Building wheel for psycopg2-binary (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [115 lines of output]
      /tmp/pip-build-env-jyymjeu8/overlay/lib/python3.13/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated.
      !!
      
              ********************************************************************************
              Please consider removing the following classifiers in favor of a SPDX license expression:
      
              License :: OSI Approved :: GNU Library or Lesser General Public License (LGPL)
      
              See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
              ********************************************************************************
      
      !!
        self._finalize_license_expression()
      running bdist_wheel
      running build
      running build_py
      creating build/lib.linux-x86_64-cpython-313/psycopg2

RHEL8 - 3.11 and RHEL9-PyTest-3.11

[notice] To update, run: python3.11 -m pip install --upgrade pip
---> Installing dependencies via pipenv ...
Courtesy Notice:
Pipenv found itself running within a virtual environment,  so it will 
automatically use that environment, instead of  creating its own for any 
project. You can set
PIPENV_IGNORE_VIRTUALENVS=1 to force pipenv to ignore that environment and 
create  its own instead.
You can set PIPENV_VERBOSITY=-1 to suppress this warning.
Installing dependencies from Pipfile.lock (63c7a0)...
Looking in indexes: https://pypi.python.org/simple
Obtaining file:///opt/app-root/src (from -r 
/tmp/pipenv-48jubp3a-requirements/pipenv-7im0x6ci-reqs.txt (line 1))
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Checking if build backend supports build_editable: started
  Checking if build backend supports build_editable: finished with status 'done'
ERROR: Exception:
Traceback (most recent call last):
  File 
"/opt/app-root/src/.local/venvs/pipenv/lib/python3.11/site-packages/pipenv/patch
ed/pip/_internal/cli/base_command.py", line 105, in _run_wrapper
    status = _inner_run()
             ^^^^^^^^^^^^
  File 
"/opt/app-root/src/.local/venvs/pipenv/lib/python3.11/site-packages/pipenv/patch
ed/pip/_internal/cli/base_command.py", line 96, in _inner_run
    return self.run(options, args)
           ^^^^^^^^^^^^^^^^^^^^^^^
  File 
"/opt/app-root/src/.local/venvs/pipenv/lib/python3.11/site-packages/pipenv/patch
ed/pip/_internal/cli/req_command.py", line 68, in wrapper
    return func(self, options, args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File

frenzymadness · 2025-11-14T09:47:29Z

It caused, I guess, main image should not be pulled. C10S - 3.12 should not be exists in quay.io/sclorg/python-312-c10s. RHEL10 does not exists.

I don't understand this sentence, sorry. We have dockerfiles here for 3.12 and 3.12-minimal based on C10S.

Fedora PyTest - 3.13 - test_container_basics.py::TestS2IPythonContainer::test_dockerfiles[Dockerfile.tpl] INFO:Image name to test: quay.io/fedora/python3-313:3.13

The version of psycopg2-binary I see in the logs indicates that this test used django-ex branch 3.2.x and that's incorrect. New Pythons like 3.13 should use Django version/branch 4.2.x that has newer psycopg2-binary dependency and that new version provides wheels for Python 3.13.

RHEL8 - 3.11 and RHEL9-PyTest-3.11

I need more time to investigate the last one. I'm not able to reproduce locally so I need to build the container image first.

phracek added a commit to phracek/s2i-python-container that referenced this pull request Nov 11, 2025

Enables testing s2i-python-container by PyTest suite.

a0ea5da

This blocks: sclorg#768 Signed-off-by: Petr "Stone" Hracek <[email protected]>

phracek mentioned this pull request Nov 11, 2025

Enables testing s2i-python-container by PyTest suite #769

Merged

phracek added a commit that referenced this pull request Nov 11, 2025

Enables testing s2i-python-container by PyTest suite.

6d0f7d4

This blocks: #768 Signed-off-by: Petr "Stone" Hracek <[email protected]>

phracek added 3 commits November 11, 2025 15:59

Rename test_* python files for OpenShift to test_ocp.

1ef68a0

Also VARS.* variables are used during the migration. Signed-off-by: Petr "Stone" Hracek <[email protected]>

Add dist-gen generated files

cf7da90

Signed-off-by: Petr "Stone" Hracek <[email protected]>

phracek force-pushed the container_pytests branch from 5866b10 to cf7da90 Compare November 11, 2025 14:59

phracek requested a review from frenzymadness November 11, 2025 16:24

phracek added the ready for review label Nov 11, 2025

Run all tests and not only test_container_basics.py

e2004a5

Add distgen generated files Signed-off-by: Petr "Stone" Hracek <[email protected]>

phracek force-pushed the container_pytests branch from 6a695bd to e2004a5 Compare November 12, 2025 10:46

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Support PyTest container test suite for Python Container. #768

Support PyTest container test suite for Python Container. #768

phracek commented Nov 11, 2025 •

edited by github-actions bot

Loading

Uh oh!

phracek commented Nov 11, 2025

Uh oh!

github-actions bot commented Nov 11, 2025 •

edited

Loading

Uh oh!

phracek commented Nov 11, 2025

Uh oh!

phracek commented Nov 12, 2025

Uh oh!

phracek commented Nov 13, 2025

Uh oh!

phracek commented Nov 13, 2025

Uh oh!

frenzymadness commented Nov 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Support PyTest container test suite for Python Container. #768

Are you sure you want to change the base?

Support PyTest container test suite for Python Container. #768

Conversation

phracek commented Nov 11, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

phracek commented Nov 11, 2025

Uh oh!

github-actions bot commented Nov 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Testing Farm results

Uh oh!

phracek commented Nov 11, 2025

Uh oh!

phracek commented Nov 12, 2025

Uh oh!

phracek commented Nov 13, 2025

Uh oh!

phracek commented Nov 13, 2025

Uh oh!

frenzymadness commented Nov 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

phracek commented Nov 11, 2025 •

edited by github-actions bot

Loading

github-actions bot commented Nov 11, 2025 •

edited

Loading