Skip to content

ROX-19064: Scanner V4 CI Testing (WIP)#19236

Draft
dcaravel wants to merge 13 commits intomasterfrom
dc/scannerv4-ci-exp
Draft

ROX-19064: Scanner V4 CI Testing (WIP)#19236
dcaravel wants to merge 13 commits intomasterfrom
dc/scannerv4-ci-exp

Conversation

@dcaravel
Copy link
Copy Markdown
Contributor

@dcaravel dcaravel commented Feb 27, 2026

Description

change me!

User-facing documentation

Testing and quality

  • the change is production ready: the change is GA, or otherwise the functionality is gated by a feature flag
  • CI results are inspected

Automated testing

  • added unit tests
  • added e2e tests
  • added regression tests
  • added compatibility tests
  • modified existing tests

How I validated my change

change me!

@openshift-ci
Copy link
Copy Markdown

openshift-ci bot commented Feb 27, 2026

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@rhacs-bot
Copy link
Copy Markdown
Contributor

rhacs-bot commented Feb 27, 2026 •
edited
Loading

Images are ready for the commit at cc7574a.

To use with deploy scripts, first export MAIN_IMAGE_TAG=4.11.x-517-gcc7574afc1.

@dcaravel dcaravel added the ci-all-qa-tests Tells CI to run all API tests (not just BAT). label Feb 27, 2026
@dcaravel dcaravel changed the title [DO NOT MERGE/REVEIW] Scanner V4 CI Testing Analysis ROX-19064: Scanner V4 CI Testing (WIP) Feb 27, 2026
@codecov
Copy link
Copy Markdown

codecov bot commented Feb 28, 2026 •
edited
Loading

Codecov Report

❌ Patch coverage is 32.43243% with 25 lines in your changes missing coverage. Please review.
✅ Project coverage is 49.56%. Comparing base (a1fe1e9) to head (59f732a).
⚠️ Report is 3 commits behind head on master.

Files with missing lines Patch % Lines
scanner/matcher/updater/vuln/updater.go 32.43% 24 Missing and 1 partial ⚠️
Additional details and impacted files 
@@            Coverage Diff             @@
##           master   #19236      +/-   ##
==========================================
- Coverage   49.56%   49.56%   -0.01%     
==========================================
  Files        2764     2764              
  Lines      208357   208389      +32     
==========================================
+ Hits       103269   103281      +12     
- Misses      97436    97456      +20     
  Partials     7652     7652
Flag Coverage Δ
go-unit-tests 49.56% <32.43%> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@dcaravel dcaravel force-pushed the dc/scannerv4-ci-exp branch 2 times, most recently from 7d1142c to cbdc9bb Compare March 5, 2026 15:39
@dcaravel dcaravel force-pushed the dc/scannerv4-ci-exp branch from 9cfb727 to f9c5f91 Compare March 18, 2026 04:53
@dcaravel dcaravel force-pushed the dc/scannerv4-ci-exp branch from 91b845d to 3fd6f0a Compare March 20, 2026 23:31
@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 24, 2026

/retest

2 similar comments
@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 24, 2026

/retest

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 24, 2026

/retest

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 25, 2026

/test ocp-4-21-qa-e2e-tests

1 similar comment
@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 25, 2026

/test ocp-4-21-qa-e2e-tests

@dcaravel dcaravel mentioned this pull request Mar 26, 2026
Merged
5 tasks
@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 26, 2026

/test aro-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 26, 2026

/test osd-aws-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 26, 2026

/test osd-gcp-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 26, 2026

/test rosa-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 26, 2026

/test osd-gcp-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 26, 2026

/test aks-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 26, 2026

/test eks-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Mar 26, 2026

/test osd-aws-qa-e2e-tests

This was referenced Mar 26, 2026
Closed
Merged
dcaravel added 11 commits April 10, 2026 15:01
@dcaravel
SCANNER V4 ENABLE: for all tests
7fda0d7 
move v4 enable flag to more consistent location with default vs. hardcode

hardcode scanner v4 to enabled for now until openshift/release fixed
@dcaravel
Disable autoscaling and limit replicas
bbb5b1e 
CI servers do not have sufficient resources to run 2 replicas of matcher and indexer, this settings aligns with Scanner V2

explict hpa replicas, disable not working

try patching because ci-values not working

add whitespace to end of patch file to fix style

Patch V4 HPA on help deploys

Because autoscaling.disable is not working in ci-values.yaml

remove replica setting, unnecessary

re-order helm values file loading
@dcaravel
reduces v4 resources
15bb6ac 
reduce db resources

increase memory limit to avoid scanner v4 ooms

bump operator scanner v4 db mem limit to help w/ oomkills
@dcaravel
WAIT for vulns via Central API for scanner_v4_vulns
f7d9dd0 
add ability to detect via central api that vulns have been loaded

extend status update check interval

Parse non-json message api output
@dcaravel
STORAGE CLASS: pipe storage class and set it for various jobs
8b36514 
sync storage classes
@dcaravel
speed up initial vuln load
52af06b 
by ensuring not sleeping needlessly for 10+ mins
@dcaravel
debug: log avail storage classes
4b80cba 
debug: move log avail storage classes
@dcaravel
filter loaded bundles
86d5ff4
@dcaravel
VULN BUNDLE ALLOW LIST: CI env var plumbing
17a7736
@dcaravel
VULN BUNDLE ALLOW LIST: enable for all tests
680e0f0 
add storage class for osd tests
@dcaravel
REMOVE: mem requests and resource limits
a10e7c8
@dcaravel dcaravel force-pushed the dc/scannerv4-ci-exp branch from 8c8670e to 8b13f4c Compare April 10, 2026 20:17
@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test all

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026 •
edited
Loading

for memory:

Test name Commit Details Required Rerun command
ci/prow/ibmcloudz-4-17-qa-e2e-tests 8c8670e link false /test ibmcloudz-4-17-qa-e2e-tests
ci/prow/powervs-4-21-qa-corebpf-e2e-tests 8c8670e link false /test powervs-4-21-qa-corebpf-e2e-tests
ci/prow/eks-qa-e2e-tests 8c8670e link false /test eks-qa-e2e-tests
ci/prow/aks-qa-e2e-tests 8c8670e link false /test aks-qa-e2e-tests 
/test aks-qa-e2e-tests

/test aro-qa-e2e-tests

/test eks-qa-e2e-tests

/test ibmcloudz-4-17-qa-e2e-tests

/test osd-aws-qa-e2e-tests

/test osd-gcp-qa-e2e-tests

/test powervs-4-21-qa-corebpf-e2e-tests

/test rosa-hcp-qa-e2e-tests

/test rosa-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test aks-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test aro-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test eks-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test ibmcloudz-4-17-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test osd-aws-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test osd-gcp-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test powervs-4-21-qa-corebpf-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test rosa-hcp-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test rosa-qa-e2e-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test gke-upgrade-tests

@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test gke-nongroovy-e2e-tests

@dcaravel dcaravel force-pushed the dc/scannerv4-ci-exp branch from 8b13f4c to 59f732a Compare April 10, 2026 21:27
@dcaravel
Copy link
Copy Markdown
Contributor Author

dcaravel commented Apr 10, 2026

/test all

@openshift-ci
Copy link
Copy Markdown

openshift-ci bot commented Apr 11, 2026

@dcaravel: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/powervs-4-21-qa-corebpf-e2e-tests 8c8670e link false /test powervs-4-21-qa-corebpf-e2e-tests
ci/prow/eks-qa-e2e-tests 8c8670e link false /test eks-qa-e2e-tests
ci/prow/aro-qa-e2e-tests 8b13f4c link false /test aro-qa-e2e-tests
ci/prow/ibmcloudz-4-17-qa-e2e-tests 8b13f4c link false /test ibmcloudz-4-17-qa-e2e-tests
ci/prow/aks-qa-e2e-tests 8b13f4c link false /test aks-qa-e2e-tests
ci/prow/ocp-4-12-qa-e2e-tests 59f732a link false /test ocp-4-12-qa-e2e-tests
ci/prow/ocp-4-21-qa-e2e-tests 59f732a link false /test ocp-4-21-qa-e2e-tests

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

area/scanner area/ui ci-all-qa-tests Tells CI to run all API tests (not just BAT). do-not-merge/work-in-progress

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@dcaravel @rhacs-bot