Skip to content

Conversation

@Xia-Zhao-rh
Copy link

@Xia-Zhao-rh Xia-Zhao-rh commented Oct 16, 2025

This commit migrates 15 clustercatalog-related test cases from openshift-tests-private to the OpenShift Tests Extension (OTE) framework, following the migration guidelines in test/qe/README.md.

Files Modified:

  • openshift/tests-extension/test/qe/specs/olmv1_cc.go: Added 15 new test cases
  • openshift/tests-extension/.openshift-tests-extension/openshift_payload_olmv1.json: Updated test metadata

Testing:

xzha@xzha1-mac origin % ./openshift-tests run olmv1/extended/candidate/clustercatalog --monitor watch-namespaces

started: 0/1/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:74948-[Skipped:Disconnected]catalog offer the operator content through https server"

started: 0/2/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75124-[Skipped:Disconnected]CRD upgrade checks for changes in default values"

started: 0/3/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69242-[Skipped:Disconnected]Catalogd deprecated package/bundlemetadata/catalogmetadata from clustercatalog CR"

started: 0/4/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75441-[Skipped:Disconnected]Catalogd supports compression and jsonlines format"

started: 0/5/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69069-[Skipped:Disconnected]Replace pod-based image unpacker with an image registry client"

started: 0/6/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75516-[Skipped:Disconnected][Skipped:SNO]CRD upgrade checks for the field maximum minimum changes"

started: 0/7/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:74978-[Skipped:Disconnected]CRD upgrade will be prevented if the Scope is switched between Namespaced and Cluster"

started: 0/8/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69202-[Skipped:Disconnected][Skipped:Proxy]Catalogd clustercatalog offer the operator content through http server off cluster"

started: 0/9/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75122-[Skipped:Disconnected]CRD upgrade check Removing an existing stored version and add a new CRD with no modifications to existing versions"

started: 0/10/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75515-[Skipped:Disconnected]CRD upgrade checks for changes in enumeration values"

passed: (16.8s) 2025-10-16T06:46:38 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69242-[Skipped:Disconnected]Catalogd deprecated package/bundlemetadata/catalogmetadata from clustercatalog CR"

started: 0/11/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75123-[Skipped:Disconnected]CRD upgrade checks for changes in required field and field type"

passed: (1m8s) 2025-10-16T06:47:29 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69202-[Skipped:Disconnected][Skipped:Proxy]Catalogd clustercatalog offer the operator content through http server off cluster"

started: 0/12/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75218-[Skipped:Disconnected]Disabling the CRD Upgrade Safety preflight checks"

passed: (1m25s) 2025-10-16T06:47:46 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75441-[Skipped:Disconnected]Catalogd supports compression and jsonlines format"

started: 0/13/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69869-[Skipped:Disconnected]Catalogd Add metrics to the Storage implementation"

passed: (1m32s) 2025-10-16T06:47:52 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69069-[Skipped:Disconnected]Replace pod-based image unpacker with an image registry client"

started: 0/14/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:73219-[Skipped:Disconnected]Fetch deprecation data from the catalogd http server"

passed: (2m8s) 2025-10-16T06:48:29 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:74948-[Skipped:Disconnected]catalog offer the operator content through https server"

started: 0/15/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:73289-[Skipped:Disconnected]Check the deprecation conditions and messages"

passed: (37.5s) 2025-10-16T06:48:34 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:73219-[Skipped:Disconnected]Fetch deprecation data from the catalogd http server"

started: 0/16/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69123-[Skipped:Disconnected]Catalogd clustercatalog offer the operator content through http server"

passed: (50.8s) 2025-10-16T06:48:41 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69869-[Skipped:Disconnected]Catalogd Add metrics to the Storage implementation"

passed: (2m54s) 2025-10-16T06:49:14 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75124-[Skipped:Disconnected]CRD upgrade checks for changes in default values"

passed: (35.7s) 2025-10-16T06:49:15 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69123-[Skipped:Disconnected]Catalogd clustercatalog offer the operator content through http server"

passed: (3m14s) 2025-10-16T06:49:35 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:74978-[Skipped:Disconnected]CRD upgrade will be prevented if the Scope is switched between Namespaced and Cluster"

passed: (3m28s) 2025-10-16T06:49:48 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75122-[Skipped:Disconnected]CRD upgrade check Removing an existing stored version and add a new CRD with no modifications to existing versions"

passed: (3m55s) 2025-10-16T06:50:15 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75515-[Skipped:Disconnected]CRD upgrade checks for changes in enumeration values"

passed: (3m47s) 2025-10-16T06:50:29 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75123-[Skipped:Disconnected]CRD upgrade checks for changes in required field and field type"

passed: (4m44s) 2025-10-16T06:51:05 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75516-[Skipped:Disconnected][Skipped:SNO]CRD upgrade checks for the field maximum minimum changes"

passed: (3m45s) 2025-10-16T06:51:18 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75218-[Skipped:Disconnected]Disabling the CRD Upgrade Safety preflight checks"

passed: (3m46s) 2025-10-16T06:52:23 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:73289-[Skipped:Disconnected]Check the deprecation conditions and messages"

Assisted-by: Claude Code

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Oct 16, 2025
@openshift-ci-robot
Copy link

openshift-ci-robot commented Oct 16, 2025

@Xia-Zhao-rh: This pull request references OCPQE-30673 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the sub-task to target the "4.21.0" version, but no target version was set.

In response to this:

This commit migrates 15 clustercatalog-related test cases from openshift-tests-private to the OpenShift Tests Extension (OTE) framework, following the migration guidelines in test/qe/README.md.

Files Modified:

  • openshift/tests-extension/test/qe/specs/olmv1_cc.go: Added 15 new test cases
  • openshift/tests-extension/.openshift-tests-extension/openshift_payload_olmv1.json: Updated test metadata
  • openshift/tests-extension/cmd/main.go: Updated test registration

Testing:

xzha@xzha1-mac origin % ./openshift-tests run olmv1/extended/candidate/clustercatalog --monitor watch-namespaces

started: 0/1/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:74948-[Skipped:Disconnected]catalog offer the operator content through https server"

started: 0/2/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75124-[Skipped:Disconnected]CRD upgrade checks for changes in default values"

started: 0/3/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69242-[Skipped:Disconnected]Catalogd deprecated package/bundlemetadata/catalogmetadata from clustercatalog CR"

started: 0/4/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75441-[Skipped:Disconnected]Catalogd supports compression and jsonlines format"

started: 0/5/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69069-[Skipped:Disconnected]Replace pod-based image unpacker with an image registry client"

started: 0/6/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75516-[Skipped:Disconnected][Skipped:SNO]CRD upgrade checks for the field maximum minimum changes"

started: 0/7/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:74978-[Skipped:Disconnected]CRD upgrade will be prevented if the Scope is switched between Namespaced and Cluster"

started: 0/8/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69202-[Skipped:Disconnected][Skipped:Proxy]Catalogd clustercatalog offer the operator content through http server off cluster"

started: 0/9/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75122-[Skipped:Disconnected]CRD upgrade check Removing an existing stored version and add a new CRD with no modifications to existing versions"

started: 0/10/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75515-[Skipped:Disconnected]CRD upgrade checks for changes in enumeration values"

passed: (16.8s) 2025-10-16T06:46:38 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69242-[Skipped:Disconnected]Catalogd deprecated package/bundlemetadata/catalogmetadata from clustercatalog CR"

started: 0/11/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75123-[Skipped:Disconnected]CRD upgrade checks for changes in required field and field type"

passed: (1m8s) 2025-10-16T06:47:29 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69202-[Skipped:Disconnected][Skipped:Proxy]Catalogd clustercatalog offer the operator content through http server off cluster"

started: 0/12/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75218-[Skipped:Disconnected]Disabling the CRD Upgrade Safety preflight checks"

passed: (1m25s) 2025-10-16T06:47:46 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75441-[Skipped:Disconnected]Catalogd supports compression and jsonlines format"

started: 0/13/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69869-[Skipped:Disconnected]Catalogd Add metrics to the Storage implementation"

passed: (1m32s) 2025-10-16T06:47:52 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69069-[Skipped:Disconnected]Replace pod-based image unpacker with an image registry client"

started: 0/14/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:73219-[Skipped:Disconnected]Fetch deprecation data from the catalogd http server"

passed: (2m8s) 2025-10-16T06:48:29 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:74948-[Skipped:Disconnected]catalog offer the operator content through https server"

started: 0/15/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:73289-[Skipped:Disconnected]Check the deprecation conditions and messages"

passed: (37.5s) 2025-10-16T06:48:34 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:73219-[Skipped:Disconnected]Fetch deprecation data from the catalogd http server"

started: 0/16/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69123-[Skipped:Disconnected]Catalogd clustercatalog offer the operator content through http server"

passed: (50.8s) 2025-10-16T06:48:41 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69869-[Skipped:Disconnected]Catalogd Add metrics to the Storage implementation"

passed: (2m54s) 2025-10-16T06:49:14 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75124-[Skipped:Disconnected]CRD upgrade checks for changes in default values"

passed: (35.7s) 2025-10-16T06:49:15 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69123-[Skipped:Disconnected]Catalogd clustercatalog offer the operator content through http server"

passed: (3m14s) 2025-10-16T06:49:35 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:74978-[Skipped:Disconnected]CRD upgrade will be prevented if the Scope is switched between Namespaced and Cluster"

passed: (3m28s) 2025-10-16T06:49:48 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75122-[Skipped:Disconnected]CRD upgrade check Removing an existing stored version and add a new CRD with no modifications to existing versions"

passed: (3m55s) 2025-10-16T06:50:15 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75515-[Skipped:Disconnected]CRD upgrade checks for changes in enumeration values"

passed: (3m47s) 2025-10-16T06:50:29 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75123-[Skipped:Disconnected]CRD upgrade checks for changes in required field and field type"

passed: (4m44s) 2025-10-16T06:51:05 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75516-[Skipped:Disconnected][Skipped:SNO]CRD upgrade checks for the field maximum minimum changes"

passed: (3m45s) 2025-10-16T06:51:18 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75218-[Skipped:Disconnected]Disabling the CRD Upgrade Safety preflight checks"

passed: (3m46s) 2025-10-16T06:52:23 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:73289-[Skipped:Disconnected]Check the deprecation conditions and messages"

Assisted-by: Claude Code

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci bot requested review from anik120 and oceanc80 October 16, 2025 07:06
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Oct 16, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: Xia-Zhao-rh
Once this PR has been reviewed and has the lgtm label, please assign joelanford for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@kuiwang02
Copy link
Contributor

please run the cases with /payload-aggregate mentioned in guide.

@openshift-ci-robot
Copy link

openshift-ci-robot commented Oct 16, 2025

@Xia-Zhao-rh: This pull request references OCPQE-30673 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the sub-task to target the "4.21.0" version, but no target version was set.

In response to this:

This commit migrates 15 clustercatalog-related test cases from openshift-tests-private to the OpenShift Tests Extension (OTE) framework, following the migration guidelines in test/qe/README.md.

Files Modified:

  • openshift/tests-extension/test/qe/specs/olmv1_cc.go: Added 15 new test cases
  • openshift/tests-extension/.openshift-tests-extension/openshift_payload_olmv1.json: Updated test metadata

Testing:

xzha@xzha1-mac origin % ./openshift-tests run olmv1/extended/candidate/clustercatalog --monitor watch-namespaces

started: 0/1/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:74948-[Skipped:Disconnected]catalog offer the operator content through https server"

started: 0/2/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75124-[Skipped:Disconnected]CRD upgrade checks for changes in default values"

started: 0/3/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69242-[Skipped:Disconnected]Catalogd deprecated package/bundlemetadata/catalogmetadata from clustercatalog CR"

started: 0/4/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75441-[Skipped:Disconnected]Catalogd supports compression and jsonlines format"

started: 0/5/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69069-[Skipped:Disconnected]Replace pod-based image unpacker with an image registry client"

started: 0/6/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75516-[Skipped:Disconnected][Skipped:SNO]CRD upgrade checks for the field maximum minimum changes"

started: 0/7/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:74978-[Skipped:Disconnected]CRD upgrade will be prevented if the Scope is switched between Namespaced and Cluster"

started: 0/8/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69202-[Skipped:Disconnected][Skipped:Proxy]Catalogd clustercatalog offer the operator content through http server off cluster"

started: 0/9/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75122-[Skipped:Disconnected]CRD upgrade check Removing an existing stored version and add a new CRD with no modifications to existing versions"

started: 0/10/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75515-[Skipped:Disconnected]CRD upgrade checks for changes in enumeration values"

passed: (16.8s) 2025-10-16T06:46:38 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69242-[Skipped:Disconnected]Catalogd deprecated package/bundlemetadata/catalogmetadata from clustercatalog CR"

started: 0/11/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75123-[Skipped:Disconnected]CRD upgrade checks for changes in required field and field type"

passed: (1m8s) 2025-10-16T06:47:29 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69202-[Skipped:Disconnected][Skipped:Proxy]Catalogd clustercatalog offer the operator content through http server off cluster"

started: 0/12/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75218-[Skipped:Disconnected]Disabling the CRD Upgrade Safety preflight checks"

passed: (1m25s) 2025-10-16T06:47:46 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75441-[Skipped:Disconnected]Catalogd supports compression and jsonlines format"

started: 0/13/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69869-[Skipped:Disconnected]Catalogd Add metrics to the Storage implementation"

passed: (1m32s) 2025-10-16T06:47:52 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69069-[Skipped:Disconnected]Replace pod-based image unpacker with an image registry client"

started: 0/14/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:73219-[Skipped:Disconnected]Fetch deprecation data from the catalogd http server"

passed: (2m8s) 2025-10-16T06:48:29 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:74948-[Skipped:Disconnected]catalog offer the operator content through https server"

started: 0/15/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:73289-[Skipped:Disconnected]Check the deprecation conditions and messages"

passed: (37.5s) 2025-10-16T06:48:34 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:73219-[Skipped:Disconnected]Fetch deprecation data from the catalogd http server"

started: 0/16/16 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69123-[Skipped:Disconnected]Catalogd clustercatalog offer the operator content through http server"

passed: (50.8s) 2025-10-16T06:48:41 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69869-[Skipped:Disconnected]Catalogd Add metrics to the Storage implementation"

passed: (2m54s) 2025-10-16T06:49:14 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75124-[Skipped:Disconnected]CRD upgrade checks for changes in default values"

passed: (35.7s) 2025-10-16T06:49:15 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:69123-[Skipped:Disconnected]Catalogd clustercatalog offer the operator content through http server"

passed: (3m14s) 2025-10-16T06:49:35 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:74978-[Skipped:Disconnected]CRD upgrade will be prevented if the Scope is switched between Namespaced and Cluster"

passed: (3m28s) 2025-10-16T06:49:48 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75122-[Skipped:Disconnected]CRD upgrade check Removing an existing stored version and add a new CRD with no modifications to existing versions"

passed: (3m55s) 2025-10-16T06:50:15 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75515-[Skipped:Disconnected]CRD upgrade checks for changes in enumeration values"

passed: (3m47s) 2025-10-16T06:50:29 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75123-[Skipped:Disconnected]CRD upgrade checks for changes in required field and field type"

passed: (4m44s) 2025-10-16T06:51:05 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75516-[Skipped:Disconnected][Skipped:SNO]CRD upgrade checks for the field maximum minimum changes"

passed: (3m45s) 2025-10-16T06:51:18 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:75218-[Skipped:Disconnected]Disabling the CRD Upgrade Safety preflight checks"

passed: (3m46s) 2025-10-16T06:52:23 "[sig-olmv1][Jira:OLM] clustercatalog PolarionID:73289-[Skipped:Disconnected]Check the deprecation conditions and messages"

Assisted-by: Claude Code

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@Xia-Zhao-rh
Copy link
Author

/payload-aggregate periodic-ci-openshift-release-master-ci-4.21-e2e-gcp-ovn-techpreview 5

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Oct 16, 2025

@Xia-Zhao-rh: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-e2e-gcp-ovn-techpreview

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/3ad72d70-aa63-11f0-88de-a85375f57e42-0

@Xia-Zhao-rh
Copy link
Author

Status
2025-10-16 10:40:23 +0000 UTC: AllJobsFinished: AllJobsFinished: All jobs have finished.
2025-10-16 07:39:23 +0000 UTC: AllJobsTriggered: AllJobsTriggered: All jobs triggered successfully

@tmshort
Copy link
Contributor

tmshort commented Oct 16, 2025

/hold
This should not have passed verify-commits!

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Oct 16, 2025
@tmshort
Copy link
Contributor

tmshort commented Oct 16, 2025

/test verify-commits

@tmshort
Copy link
Contributor

tmshort commented Oct 16, 2025

/retest verify-commits

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Oct 16, 2025

@tmshort: The /retest command does not accept any targets.
The following commands are available to trigger required jobs:

/test check-sync-pr-valid
/test default-catalog-consistency
/test e2e-aws-techpreview-olmv1-ext
/test images
/test okd-scos-images
/test openshift-e2e-aws
/test tests-extension
/test unit
/test verify
/test verify-commits
/test verify-deps

The following commands are available to trigger optional jobs:

/test okd-scos-e2e-aws-ovn
/test openshift-e2e-aws-techpreview

Use /test all to run the following jobs that were automatically triggered:

pull-ci-openshift-operator-framework-operator-controller-main-check-sync-pr-valid
pull-ci-openshift-operator-framework-operator-controller-main-e2e-aws-techpreview-olmv1-ext
pull-ci-openshift-operator-framework-operator-controller-main-images
pull-ci-openshift-operator-framework-operator-controller-main-okd-scos-e2e-aws-ovn
pull-ci-openshift-operator-framework-operator-controller-main-okd-scos-images
pull-ci-openshift-operator-framework-operator-controller-main-openshift-e2e-aws
pull-ci-openshift-operator-framework-operator-controller-main-tests-extension
pull-ci-openshift-operator-framework-operator-controller-main-unit
pull-ci-openshift-operator-framework-operator-controller-main-verify
pull-ci-openshift-operator-framework-operator-controller-main-verify-commits
pull-ci-openshift-operator-framework-operator-controller-main-verify-deps

In response to this:

/retest verify-commits

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@tmshort
Copy link
Contributor

tmshort commented Oct 16, 2025

Interesting... verify-commits is passing‽‽

@tmshort
Copy link
Contributor

tmshort commented Oct 16, 2025

/test verify-commits

1 similar comment
@tmshort
Copy link
Contributor

tmshort commented Oct 16, 2025

/test verify-commits


})

g.It("PolarionID:69123-[Skipped:Disconnected]Catalogd clustercatalog offer the operator content through http server", g.Label("LEVEL0"), func() {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we need this "PolarionID:69123"
Those tests are not sending a signal to the Sippy
Also, I understand that they are not using the old system anymore

So, could we remove it and keep the names meaningful?

Copy link
Contributor

@camilamacedo86 camilamacedo86 Oct 17, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why are we adding g.Label("LEVEL0") ?
Are we setting this one not to run those and produce data for Sippy?

Comment on lines +47 to +58
var (
baseDir = exutil.FixturePath("testdata", "olm")
clustercatalogTemplate = filepath.Join(baseDir, "clustercatalog.yaml")
clustercatalog = olmv1util.ClusterCatalogDescription{
Name: "clustercatalog-69123",
Imageref: "quay.io/olmqe/olmtest-operator-index:nginxolm69123",
Template: clustercatalogTemplate,
}
)
g.By("Create clustercatalog")
defer clustercatalog.Delete(oc)
clustercatalog.Create(oc)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
var (
baseDir = exutil.FixturePath("testdata", "olm")
clustercatalogTemplate = filepath.Join(baseDir, "clustercatalog.yaml")
clustercatalog = olmv1util.ClusterCatalogDescription{
Name: "clustercatalog-69123",
Imageref: "quay.io/olmqe/olmtest-operator-index:nginxolm69123",
Template: clustercatalogTemplate,
}
)
g.By("Create clustercatalog")
defer clustercatalog.Delete(oc)
clustercatalog.Create(oc)
unique := rand.String(4)
catName := "catalog-" + unique
imageRef := "quay.io/olmqe/olmtest-operator-index:nginxolm69123"
By("creating catalog with ....") // WHAT 69123 means?
cleanup, err := helpers.CreateClusterCatalog(ctx, catName, imageRef)
Expect(err).NotTo(HaveOccurred(), "failed to create ClusterCatalog")
DeferCleanup(cleanup)

I noticed we already have helpers to create and clean up Cluster Catalogues with an image: https://github.com/openshift/operator-framework-operator-controller/blob/main/openshift/tests-extension/pkg/helpers/cluster_catalog.go#L24-L52

Could we please use those helpers here instead?
It’ll help reduce extra dependencies and make the code easier to maintain long term.
(When we spread similar logic in different places, it gets harder to keep things consistent.)

Example for reference:
🔗

It("should fail to install if it has an invalid reference", func(ctx SpecContext) {
unique := rand.String(4)
catName := "bad-catalog-" + unique
imageRef := "example.com/does-not-exist:latest"
By("creating the malformed catalog with an invalid image ref")
cleanup, err := helpers.CreateClusterCatalog(ctx, catName, imageRef)
Expect(err).NotTo(HaveOccurred(), "failed to create ClusterCatalog")
DeferCleanup(cleanup)

Thanks a lot 🙏

o.Expect(channelData[0].Name).To(o.ContainSubstring("candidate-v0.0"))

bundlesName := olmv1util.GetBundlesNameByPakcage(unmarshalContent.Bundles, "nginx69123")
o.Expect(bundlesName[0]).To(o.ContainSubstring("nginx69123.v0.0.1"))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This tests is not using OLM at all.
What it is testing out?
What is the goal of this tests?

@camilamacedo86
Copy link
Contributor

Hi @Xia-Zhao-rh,

You can ignore my comments on this PR — I understand you’re consolidating everything under the QE directory now.
I added them just to share how we’ve been approaching things. At some point, it would be great if we could:

  • Review all tests under the QE directory
  • Identify those that are relevant for testing OLM and could be part of the test extension producing signals for Sippy
  • Refactor them to use the centralised code and move them there so that we can start to use those to validate the quality of OLM for releases.

Anyway, this is probably already part of your plan — I’m just putting it into words. 😊

@Xia-Zhao-rh
Copy link
Author

Hi, @camilamacedo86
Thanks for sharing your thoughts! Yes, our first step is to migrate all existing QE cases under the QE directory. After that, we may consider refactoring and other improvements. Thanks for your suggestions!

@jsafrane
Copy link

jsafrane commented Oct 17, 2025

/test verify-commits
edit: that ran the old one, 622c037.

@jsafrane
Copy link

jsafrane commented Oct 17, 2025

/test verify-commits
edit: Still the old image...
registry.ci.openshift.org/ci/commitchecker:latest has the new one, but quay-proxy.ci.openshift.org/openshift/ci:ci_commitchecker_latest or the CI cache still has the old one

@jsafrane
Copy link

/test verify-commits

@Xia-Zhao-rh Xia-Zhao-rh force-pushed the add_clustercatalog_cases branch from 5596607 to 54cedd7 Compare October 17, 2025 09:41
@Xia-Zhao-rh
Copy link
Author

/retest

@Xia-Zhao-rh Xia-Zhao-rh force-pushed the add_clustercatalog_cases branch from 54cedd7 to 8263114 Compare October 22, 2025 02:18
@Xia-Zhao-rh
Copy link
Author

/retest

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Oct 22, 2025

@Xia-Zhao-rh: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/okd-scos-e2e-aws-ovn 8263114 link false /test okd-scos-e2e-aws-ovn

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants