Completes the WIP preserved in the previous commit. `MERGE GATE: PASS` + exit 0 now means
what it says: every stage that was SUPPOSED to run ran, and was green.
THE DEFECT. In gate.sh's decision section a FAILED stage set BLOCK=1 but a SKIPPED stage only
warned, so the gate printed `l0: skipped (unwired seam / missing tool) — not green` and then
`MERGE GATE: PASS`, exit 0. Seen twice for real: `prom-rules` skipped because promtool was
absent, and `l0` skipped because the pinned kyverno CLI was. Exit 0 is what CI and every
`||`-chained script read as merge-approved, so the one component whose entire job is to fail
closed was failing OPEN — in a repo whose stated principle is that SKIPPED IS NOT GREEN, and
whose history already contains the 2026-08-31 "local false green" that UNDECIDED was added to
prevent. The offline stages simply never used that vocabulary.
A SKIP IS NOT ONE THING — the per-stage rule, with the justification in the file header:
* lint / l0 / render-golden / l1 — COULD NOT RUN (a pinned tool absent, a seam unwired).
BLOCKED under strict skips (a CI runner has the toolchain installed for it by
install-tools.sh, so a skip there is a defect); UNDETERMINED (exit 3) otherwise — a
workstation missing a tool is a real local condition, still non-zero, still never a pass.
* spec-immutability — the spec repo is not checked out, so R-TEST-06 COULD NOT BE VERIFIED:
UNDETERMINED. Deliberately NOT upgraded to a block by strictness, because the live runner
does not check the spec repo out at all and blocking would leave the only enforced status
check permanently red for a reason no PR can clear. It is the ONE skip a caller may
knowingly tolerate; REQUIRE_SPEC_VERIFICATION=true makes it hard once wired.
* conformance L2/L3 — CLUSTER_AVAILABLE!=true is the environment DECLARING the capability
absent, not a stage failing to run where it could have. A declared-inapplicable stage was
never "supposed to run", so it does not deny a PASS — but it is now NAMED in the PASS
headline and the step summary, so PASS never implies more than was verified. A skip
DESPITE CLUSTER_AVAILABLE=true still blocks.
declared-not-applicable may pass; could-not-run may not.
STRICTNESS IS DECLARED, NOT SNIFFED. .gitea/workflows/gate.yml sets GATE_STRICT_SKIPS=true on
the gate step — the workflow is the thing that knows it is CI — with GITHUB_ACTIONS/CI (set by
the runner itself) only as the `auto` fallback. No hostname/path/tool-availability heuristic.
A wrong answer in either direction cannot fail open: both branches are non-zero and neither is
a PASS. That step now calls ./ci/gate.sh directly and tolerates exit 3 in one visible line,
because under strict skips exit 3 can ONLY mean the unverifiable spec repo — a missing tool is
exit 1 and untolerated. Tolerating a non-answer is a reviewed choice in the CALLER; there is
deliberately no knob inside gate.sh that turns UNDETERMINED into exit 0.
ALSO, from the unlanded fix/touched-requirements-fail-closed (47068ee), whose reasoning is
carried over rather than its tree: gate.sh special-cased only exit 3 from
touched-requirements.sh, so ANY other non-zero exit left the touched set empty and printed PASS
having applied no coverage gate at all. An unusable subset is not an empty subset: it BLOCKS.
Latent today (the script exits only 0 or 3) and wired now so the hole is already closed when a
fail-closed path map makes exit 1 reachable — the measured state of that map is in the PM report.
TESTED — ci/tests/gate-decision.test.sh, 47 assertions over the whole decision table: the real
gate.sh and lib.sh run in a throwaway CI_DIR against STUB stage scripts whose exit codes the
suite dictates, so it asserts how the gate REASONS, with no tools, no cluster, no network. All
stages green -> PASS/0; each stage FAILED -> BLOCKED/1; each stage SKIPPED -> never PASS and
non-zero; strict skips -> BLOCKED/1; the spec exception; the declared-gap PASS; the
undetermined-touched-subset paths unchanged (on-base -> NOT APPLICABLE/0, no-base and
diff-failed -> BLOCKED/1); UNDETERMINED outranking NOT APPLICABLE; an unusable subset ->
BLOCKED/1; truthy()'s misspelling direction. 32 of the 47 FAIL against the pre-change gate,
including "l0 SKIPPED: printed 'MERGE GATE: PASS'" — the suite is falsifiable, not decorative.
lib.sh: truthy() is now the one spelling of "is this switch on" and cluster_available() uses it
(the comment claimed that; now it is true), and load_touched_requirements' rc!=0 branch says
what actually happened instead of "proceeding with the full layer".
Refs R-TEST-02, R-TEST-03, R-TEST-06.
Co-Authored-By: Claude Opus 5 <[email protected]>
131 lines
7.8 KiB
YAML
131 lines
7.8 KiB
YAML
# .gitea/workflows/gate.yml — the ENFORCED PR merge gate (Phase 6, WS-GITOSS).
|
|
#
|
|
# This is the LIVE gate wired to the in-cluster Gitea Actions runner (ns gitea-actions,
|
|
# Docker executor + DinD). It invokes the AGGREGATE merge gate — `./ci/gate.sh`, which is
|
|
# exactly what `make -C ci gate` runs, so CI and the devcontainer gate the same way
|
|
# (R-TEST-02): the runner just installs the pinned tools from ci/versions.env first (and see
|
|
# below for why the script, not `make`, is invoked here). It runs every stage in order —
|
|
# spec-immutability, lint, Kyverno L0, render==golden, L1 offline render — and then applies the
|
|
# R-TEST-03 decision, printing
|
|
# "MERGE GATE: PASS" (0) / "BLOCKED" (1) / "UNDETERMINED" (3) / "NOT APPLICABLE" (0). It is the
|
|
# single required status check on `main` (see branch protection). A non-zero exit fails the job,
|
|
# so a BLOCKED gate blocks the merge.
|
|
#
|
|
# WHY THIS STEP DECLARES GATE_STRICT_SKIPS AND TOLERATES EXIT 3 (2026-09-13). A SKIPPED stage is
|
|
# never green, and since 2026-09-13 gate.sh refuses to print PASS when one did not run (it used to
|
|
# print "— not green" and then "MERGE GATE: PASS", exit 0 — fail-open in the gate itself). Two
|
|
# kinds of non-run must be told apart HERE, in the caller, because only the caller knows which
|
|
# environment it is:
|
|
# * a pinned tool missing or a seam unwired ON THIS RUNNER is a DEFECT — the toolchain is
|
|
# installed for us two steps up. GATE_STRICT_SKIPS=true DECLARES that (no env sniffing, no
|
|
# "does this look like CI?" heuristic) and makes those skips exit 1: untolerated, job fails.
|
|
# * spec-immutability CANNOT be verified here at all: the spec repo is a separate repo and is
|
|
# not checked out into this runner (SPEC_REPO_SLUG unwired; blueprint in merge-gate.yaml). It
|
|
# is the ONLY skip that can still reach exit 3 under strict skips, which is what makes
|
|
# `|| [ "$?" -eq 3 ]` a narrow, reviewed tolerance rather than a blanket one. The log still
|
|
# says UNDETERMINED and names R-TEST-06 as unverified. Wire the spec checkout (or set
|
|
# REQUIRE_SPEC_VERIFICATION=true) and this tolerance should be deleted.
|
|
# Called DIRECTLY, not through `make`: GNU make reports any recipe failure as its own exit 2, so
|
|
# `make -C ci gate || [ "$?" -eq 3 ]` would see 2 and fail the job. Same reason the
|
|
# spec-immutability pre-step below calls the script directly.
|
|
#
|
|
# The cluster-gated L2/L3 conformance stage SKIPS honestly here (exit 3, surfaced not faked
|
|
# — HARD RULE 4) because this runner declares no cluster: nothing here sets CLUSTER_AVAILABLE,
|
|
# so gate.sh reports the touched requirements UNVERIFIED — and NAMES that declared gap in its
|
|
# PASS headline — without blocking Phase-0/6 static work. L2/L3 run as an IN-CLUSTER Chainsaw Job (its own scoped SA; CI holds
|
|
# no broad kubeconfig) driven by the separate `conformance` job below.
|
|
#
|
|
# NOTE (R-TEST-06 / gate-semantics): spec-immutability is ALSO surfaced as its own explicit
|
|
# early step (below) so its result is a distinct, tolerant status in the Gitea UI; gate.sh
|
|
# re-runs it as its first stage, which is the authoritative one. The gate step below is the
|
|
# same script the laptop runs; the extra pre-step is a read-only git-diff check and is
|
|
# purely additive. The full pipeline blueprint (spec-checkout, per-layer jobs, decision job)
|
|
# is retained dormant in merge-gate.yaml.
|
|
---
|
|
name: gate
|
|
|
|
on:
|
|
pull_request:
|
|
branches: [main]
|
|
push:
|
|
branches:
|
|
- main
|
|
- 'feature/**'
|
|
- 'fix/**'
|
|
- 'docs/**'
|
|
- 'chore/**'
|
|
|
|
concurrency:
|
|
group: gate-${{ github.ref }}
|
|
cancel-in-progress: true
|
|
|
|
jobs:
|
|
# Single required status check: the static merge gate.
|
|
gate:
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- name: Checkout
|
|
uses: actions/checkout@v4
|
|
with:
|
|
fetch-depth: 0 # full history so ci/touched-requirements.sh can diff vs main
|
|
|
|
- name: Install pinned CI toolchain (ci/versions.env)
|
|
run: |
|
|
./.gitea/workflows/scripts/install-tools.sh l0
|
|
./.gitea/workflows/scripts/install-tools.sh l1
|
|
|
|
# R-TEST-06: the spec is read-only to agents. An EXPLICIT early surfacing of the
|
|
# spec-immutability check, so its result is a distinct, tolerant status line in the
|
|
# Gitea UI before the (longer) aggregate gate log. The spec repo is NOT checked out
|
|
# into CI here (separate repo; SPEC_REPO_SLUG not wired into this runner), so the guard
|
|
# honestly SKIPS (exit 3) rather than faking green; a real drift/edit of a co-located
|
|
# spec exits 1 and fails. Tolerated: exit 3 only. Call the script DIRECTLY, not via
|
|
# `make spec-immutability`: GNU make masks a recipe's exit code as its own 2, so
|
|
# `make spec-immutability || [ $? -eq 3 ]` would see 2 and fail. The AUTHORITATIVE
|
|
# spec-immutability run is the FIRST stage of `make -C ci gate` below (gate.sh calls
|
|
# the script directly, so it sees exit 3 → SKIP, not a mask); this pre-step is a cheap,
|
|
# read-only git-diff duplicate that only adds early UI signal.
|
|
- name: Spec immutability (R-TEST-06, skips if spec repo absent)
|
|
run: ./ci/spec-immutability.sh || [ "$?" -eq 3 ]
|
|
|
|
# Aggregate merge gate: the same script a human runs in the devcontainer via
|
|
# `make -C ci gate`. Runs spec-immutability, lint, Kyverno L0, render==golden and L1
|
|
# render, then the R-TEST-03 decision. Exits non-zero on a BLOCKED gate, which fails this
|
|
# job. The cluster-gated L2/L3 stage SKIPS here (no CLUSTER_AVAILABLE) — surfaced as
|
|
# UNVERIFIED and NAMED in the PASS headline, never faked green. GATE_STRICT_SKIPS + the
|
|
# tolerated exit 3 are explained in the file header; the tolerance covers exactly one
|
|
# thing, the unverifiable spec repo, and nothing else can produce a 3 here.
|
|
- name: Merge gate — ci/gate.sh (what `make -C ci gate` runs)
|
|
env:
|
|
GATE_STRICT_SKIPS: "true"
|
|
run: ./ci/gate.sh || [ "$?" -eq 3 ]
|
|
|
|
# NOTE: no actions/upload-artifact step. Gitea Actions rejects upload-artifact@v4
|
|
# ("not supported on GHES" — Gitea does not implement the artifact-v2 backend), which
|
|
# would fail the job even on a green gate. JUnit + coverage are written under
|
|
# conformance/_artifacts/ in the job workspace; wire artifact upload later via the
|
|
# Gitea-compatible @v3 action or Gitea's own artifact backend if retention is wanted.
|
|
|
|
# ───────────────────────────────────────────────────────────────────────────
|
|
# PLACEHOLDER — NOT WIRED (deferred; concrete plan written, awaiting operator decision).
|
|
# L2/L3 conformance (Chainsaw behavioural + fault-injection) needs a LIVE cluster and is
|
|
# gated behind vars.CLUSTER_AVAILABLE + a narrow secrets.CONFORMANCE_TRIGGER_KUBECONFIG.
|
|
# The intended model: an in-cluster Chainsaw Job (conformance/incluster/) under its OWN
|
|
# scoped ServiceAccount — CI holds NO broad kubeconfig, only a trigger credential. The
|
|
# blocker is a real privilege-escalation design question (a `create jobs` credential can
|
|
# create a Job running as the privileged runner SA), plus a runner image + repo-clone +
|
|
# results-collection that don't exist yet. Full analysis + step sequence:
|
|
# docs/plans/l2-l3-conformance-ci-wiring.md
|
|
# The blueprint job shape is retained dormant in merge-gate.yaml.
|
|
# Kept `if: false` so it never runs (shows skipped, never fakes green — HARD RULE 4).
|
|
# ───────────────────────────────────────────────────────────────────────────
|
|
conformance:
|
|
runs-on: ubuntu-latest
|
|
needs: [gate]
|
|
if: false
|
|
steps:
|
|
- name: Placeholder
|
|
run: |
|
|
echo "L2/L3 conformance not wired — see gate.yml header + WS-GITOSS report." >&2
|
|
exit 1
|