test: enforce that dry runs never reach the authorization gate
flex-auth's published policy package encodes an explicit limit: apply and apply --dry-run are indistinguishable to a PDP, since both arrive as action `apply`. What separates them is a property of this repo - the PEP does not call the gate for a dry run - and flex-auth recorded that as a limit rather than implying a control they do not have, asking to be told if it stops holding. Verified it holds across all five dry-run handlers (apply, revoke, lifecycle suspend/deactivate/destroy) and locked it with a regression test that fails with the instruction to notify flex-auth. A paired test proves the hook under test is actually load-bearing, so the guard cannot pass vacuously. Also records the FLEX-WP-0021-T01/T02 and GH-DEC-2026-005 outcomes in SECRETS-WP-0007-T04, including the revisit trigger flex-auth flagged: with one calling identity the denial ladder has no action_not_granted branch, so a second identity or a per-lane/stage split is the trigger to add it. allow_ttl 15m needed no change - normalize_wrap_ttl already caps wrap at 15m. The policy pin stays unset; publishing is not deploying. 257 tests pass. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01M65ovP3eiiPHubibvWs9mD Assistant: claude-code Assistant-Model: opus Assistant-Process: 393550@bnt-lap001 Assistant-Session: 4bb359f9-1f12-4410-9e76-079cf23c82e4
This commit is contained in:
parent
7b4b9e386e
commit
083bee7333
2 changed files with 124 additions and 0 deletions
67
tests/test_dry_run_never_gates.py
Normal file
67
tests/test_dry_run_never_gates.py
Normal file
|
|
@ -0,0 +1,67 @@
|
||||||
|
"""Dry runs must never reach the authorization gate.
|
||||||
|
|
||||||
|
flex-auth's `secrets-engine.catalog-lane.lifecycle` v1 encodes an explicit
|
||||||
|
limit: `apply` and `apply --dry-run` are indistinguishable to a PDP, because
|
||||||
|
both would arrive as action `apply`. What keeps them apart is a property of
|
||||||
|
THIS repo -- the PEP does not call the gate for a dry run -- and flex-auth asked
|
||||||
|
to be told if that assumption ever stops holding (FLEX-WP-0021-T02).
|
||||||
|
|
||||||
|
This test is that notification. If a dry-run path ever starts calling
|
||||||
|
`_require_lane_approval`, it fails here rather than silently widening what the
|
||||||
|
published package is understood to cover.
|
||||||
|
"""
|
||||||
|
import pytest
|
||||||
|
|
||||||
|
from secrets_engine import cli
|
||||||
|
|
||||||
|
|
||||||
|
DRY_RUN_COMMANDS = [
|
||||||
|
("apply", ["apply", "whynot-design-npm-publish", "--stage", "prod", "--dry-run"]),
|
||||||
|
("revoke", ["revoke", "whynot-design-npm-publish", "--dry-run"]),
|
||||||
|
("lifecycle suspend", ["lifecycle", "suspend", "whynot-design-npm-publish", "--dry-run"]),
|
||||||
|
("lifecycle deactivate", ["lifecycle", "deactivate", "whynot-design-npm-publish", "--dry-run"]),
|
||||||
|
(
|
||||||
|
"lifecycle destroy",
|
||||||
|
[
|
||||||
|
"lifecycle", "destroy", "whynot-design-npm-publish", "--dry-run",
|
||||||
|
"--confirm-destroy", "whynot-design-npm-publish",
|
||||||
|
],
|
||||||
|
),
|
||||||
|
]
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.mark.parametrize(("label", "argv"), DRY_RUN_COMMANDS, ids=[c[0] for c in DRY_RUN_COMMANDS])
|
||||||
|
def test_dry_run_does_not_reach_the_authorization_gate(label, argv, monkeypatch, capsys):
|
||||||
|
def _forbidden(*_args, **_kwargs):
|
||||||
|
pytest.fail(
|
||||||
|
f"'{label} --dry-run' reached the authorization gate. flex-auth's "
|
||||||
|
"policy package assumes dry runs never do, because a PDP cannot "
|
||||||
|
"distinguish them from the live action. Tell flex-auth before "
|
||||||
|
"changing this."
|
||||||
|
)
|
||||||
|
|
||||||
|
monkeypatch.setattr(cli, "_require_lane_approval", _forbidden)
|
||||||
|
monkeypatch.setattr(
|
||||||
|
cli.OpenBaoClient,
|
||||||
|
"resolve",
|
||||||
|
lambda *_a, **_k: pytest.fail(f"'{label} --dry-run' opened a backend"),
|
||||||
|
)
|
||||||
|
cli.main(argv)
|
||||||
|
# A dry run must still render something for the operator to inspect.
|
||||||
|
assert capsys.readouterr().out.strip()
|
||||||
|
|
||||||
|
|
||||||
|
def test_live_paths_do_still_gate(monkeypatch):
|
||||||
|
"""Guard the guard: prove the hook under test is actually load-bearing."""
|
||||||
|
calls = []
|
||||||
|
monkeypatch.setattr(
|
||||||
|
cli,
|
||||||
|
"_require_lane_approval",
|
||||||
|
lambda *a, **k: calls.append(a[2] if len(a) > 2 else "?"),
|
||||||
|
)
|
||||||
|
monkeypatch.setattr(
|
||||||
|
cli.OpenBaoClient, "resolve", lambda *_a, **_k: pytest.fail("backend opened")
|
||||||
|
)
|
||||||
|
with pytest.raises(BaseException):
|
||||||
|
cli.main(["apply", "whynot-design-npm-publish", "--stage", "prod"])
|
||||||
|
assert calls == ["apply"], "live apply must pass action 'apply' to the gate"
|
||||||
|
|
@ -352,6 +352,63 @@ and the published package from `FLEX-WP-0021-T02`. The pin stays unset.
|
||||||
`FLEX-WP-0021-T01`. Separately tracked: production requires a KeyCape RS256 JWT,
|
`FLEX-WP-0021-T01`. Separately tracked: production requires a KeyCape RS256 JWT,
|
||||||
not the static Bearer token this engine currently sends.
|
not the static Bearer token this engine currently sends.
|
||||||
|
|
||||||
|
Closed out 2026-09-06. gate-house amended `GH-DEC-2026-005`; flex-auth published
|
||||||
|
the policy package (`FLEX-WP-0021-T01`/`T02` done, commit `f75db59`).
|
||||||
|
|
||||||
|
- `secrets-engine.catalog-lane.lifecycle` v1 exists with both manifests, a
|
||||||
|
loadable registry snapshot, 26 fixtures and five standalone check requests;
|
||||||
|
`validate -kind policy` reports 22/22 Rego tests and 26/26 fixtures. Our
|
||||||
|
vocabulary is recorded in flex-auth `docs/secrets-engine-action-vocabulary.md`.
|
||||||
|
All four constraints from `docs/gated-actions.md` are encoded rather than
|
||||||
|
assumed: `test_revoke_is_not_an_action` asserts `revoke` denies
|
||||||
|
`unknown_action`, `destroy` is fixtured as the dual-control case before
|
||||||
|
`T04` opens the path, `compromise`/`reactivate` are annotated overlay-only,
|
||||||
|
and the ungated verbs deny `unknown_action`. flex-auth reports four of the
|
||||||
|
twelve would have been inferred wrongly, `revoke` most confidently.
|
||||||
|
- **A published limit now rests on a property of this repo.** `apply` and
|
||||||
|
`apply --dry-run` are indistinguishable to a PDP; both arrive as action
|
||||||
|
`apply`. What separates them is that our PEP does not call the gate for a dry
|
||||||
|
run. flex-auth recorded that as a limit rather than implying a control they do
|
||||||
|
not have, and asked to be told if the assumption stops holding.
|
||||||
|
`tests/test_dry_run_never_gates.py` now enforces it across all five dry-run
|
||||||
|
handlers, with a paired test proving the hook is load-bearing. Changing a
|
||||||
|
dry-run path to gate is now a test failure carrying the instruction to notify
|
||||||
|
flex-auth first.
|
||||||
|
- Dual control on `destroy` checks what the claim *says* (two distinct approver
|
||||||
|
subject ids). flex-auth deliberately does not re-derive temporal validity,
|
||||||
|
signature, or supersession — those are approval-engine's to assert and **ours
|
||||||
|
to verify against the live claim**. `validate_approval_claim` is that check.
|
||||||
|
- `allow_ttl` is 15m in the package, stated rather than left to an engine
|
||||||
|
default. Per `FLEX-DEC-2026-004` that is authority to *issue* the operation,
|
||||||
|
not to keep using what it produced; bounding a delivered secret's own lifetime
|
||||||
|
is ours. Already satisfied: `normalize_wrap_ttl` caps wrap at 15m and lane
|
||||||
|
AppRoles carry 5m/15m token TTLs with a single-use Secret ID.
|
||||||
|
- Structural note carried as a revisit trigger, not a defect: because we named
|
||||||
|
exactly one calling identity, the denial ladder has no `action_not_granted`
|
||||||
|
branch — with one subject holding all twelve actions it could never fire, and
|
||||||
|
a rule that cannot fail reads as per-action control that is not there.
|
||||||
|
Registering a second identity, or splitting the CLI identity by lane or stage,
|
||||||
|
is the trigger; adding the branch then is additive and needs no request-shape
|
||||||
|
change.
|
||||||
|
- gate-house struck the G3 revisit trigger for a composed authorization object,
|
||||||
|
verified against the DecisionEnvelope schema: `lifetime` is required whenever
|
||||||
|
effect is allow, so carrying its own end — the one structural thing the bundle
|
||||||
|
did that the split does not — is already answered. Three triggers remain: a
|
||||||
|
third or fourth PEP-shaped consumer, a single signed forwardable artifact, and
|
||||||
|
§17 request-claim assent.
|
||||||
|
- On the approver threshold we stopped checking, gate-house recorded both that
|
||||||
|
it is correct on layering **and** a genuine reduction in defence in depth,
|
||||||
|
noting a decision recording only the first would be self-serving. The
|
||||||
|
compensating property is reconstructability at the issuer under §9.6 —
|
||||||
|
detection, not prevention — not a second check here.
|
||||||
|
|
||||||
|
**The pin stays unset.** Publishing is not deploying: there is still no
|
||||||
|
`flex-auth-secrets-engine` pin and therefore no address to call. `T04` stands it
|
||||||
|
up in `callerAuth.mode warn`; `T05` hands over the Service DNS and confirms the
|
||||||
|
package/version to configure. Next inbound is the `T03` replay fixture — a real
|
||||||
|
DecisionEnvelope from this package including `provenance.registry_snapshot_digest`
|
||||||
|
— to verify the digest join unchanged.
|
||||||
|
|
||||||
Define and enforce the decision contract needed by production commands. A
|
Define and enforce the decision contract needed by production commands. A
|
||||||
resolved approval must bind at least:
|
resolved approval must bind at least:
|
||||||
|
|
||||||
|
|
|
||||||
Loading…
Add table
Add a link
Reference in a new issue