Skip to content

Leave the redhat containers out of the test matrix when the secrets are missing - #508

Merged
gaborcsardi merged 3 commits into
r-lib:mainfrom
kevinushey:developer/skip-rhel-tests-without-secrets
Nov 7, 2026
Merged

gaborcsardi merged 3 commits into
r-lib:mainfrom
kevinushey:developer/skip-rhel-tests-without-secrets

Conversation

@kevinushey

Copy link
Copy Markdown
Contributor

The redhat/ubi8, redhat/ubi9 and redhat/ubi10 test jobs register the container with subscription-manager, using the REDHAT_ORG and REDHAT_ACTIVATION_KEY_RHEL* secrets (the ENVS block in the Makefile, read by tests/test-linux-docker.sh). A pull request from a fork gets no repository secrets, so on every fork PR all six of those jobs stop before running a single test:

subscription-manager: error: argument --org: expected one argument

That is what happened on #490, #492 and #507.

This leaves the redhat/* containers out of the matrix when REDHAT_ORG is empty, in both the x86_64 and the aarch64 matrix setup steps, so the jobs are absent rather than red. Pushes, scheduled runs, workflow_dispatch and in-repo branches have the secret and keep running them.

Since this PR comes from a fork, its own run shows the effect: the Linux container jobs should list the other fifteen containers and no redhat/* ones, and the setup step logs REDHAT_ORG is not available, leaving out the redhat/* containers.

The redhat/ubi* test jobs register the container with
subscription-manager, using the REDHAT_* secrets. A pull request from a
fork gets no secrets, so those six jobs failed before running a test,
on every fork PR (r-lib#490, r-lib#492, r-lib#507). The matrix setup now leaves the
redhat/* containers out when REDHAT_ORG is empty; pushes, scheduled runs
and in-repo branches still run them.
@codecov

codecov Bot commented Nov 6, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 65.48%. Comparing base (5230497) to head (0014a4b).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #508   +/-   ##
=======================================
  Coverage   65.48%   65.48%           
=======================================
  Files          91       91           
  Lines       47600    47600           
=======================================
  Hits        31169    31169           
  Misses      16431    16431           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

gaborcsardi and others added 2 commits November 7, 2026 13:21
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@gaborcsardi

Copy link
Copy Markdown
Member

Thanks! In general I suggest to push to a branch inside the repo if you have write access to r-lib, then there is no issue with secrets.

@gaborcsardi
gaborcsardi merged commit f219c84 into r-lib:main Nov 7, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants