audit-core/docs/integrity.md
tegwick b0e6792cf0
All checks were successful
CI Smoke / host-smoke (push) Successful in 0s
CI Smoke / container-smoke (push) Successful in 2s
Bound /readyz so kubelet probes cannot hang the Service
/readyz walked the hash chain and opened pooled connections with no
libpq connect_timeout, so a 2s kubelet probe never saw a response and
the pod stayed unready. Informed Decision accept is blocked on that.

Probe health() only, under a 1.5s budget, publish last-known
tamper_evidence, and fail TCP handshake in 1s. Integrity stays on
/v1/integrity.

Assistant: grok
Assistant-Session: 01a0a182-bab7-7f11-b32b-d06f3af52082
2026-09-14 22:13:55 +02:00

6.5 KiB

Integrity contract (AUDIT-WP-0007)

Operational custody already stores payload_hash and rejects UPDATE/DELETE for the runtime role. That is not tamper evidence: a database owner can drop the trigger and rewrite rows. This contract says what the hash chain proves, and what it does not.

Chain

Each accepted event stores:

  • payload_hash — SHA-256 of the canonical event record (already stored)
  • chain_prev — the previous event's chain_hash, or genesis
  • chain_hashSHA-256(chain_prev | payload_hash | event_id)

Genesis is 64 ASCII zeros (audit_core.integrity.GENESIS). The delimiter is |. The chain is one stream per schema, not per tenant. A per-tenant chain would hide a cross-tenant rewrite.

The first accept of an empty store uses genesis as chain_prev. A duplicate accept must not mint a second link. A conflict must not advance the head. Concurrent first-accepts of different events take an advisory lock (CHAIN_LOCK_KEY) so they cannot fork.

Verify walks ORDER BY accepted_at, event_id, recomputes every link, and reports the first event id whose stored hashes do not match. A break is a custody defect, not a sender error. Retrying the event will not repair it.

Proof bound

A chain inside the same database detects a rewritten payload_hash if the attacker does not also recompute the suffix. A database owner can. Tamper evidence against that class of attacker requires a chain-head attestation stored outside platform-pg.

tamper_evidence=True is allowed only when:

  1. verify exists and fails on a rewritten row
  2. an external head attestation exists and verify-against-attestation reports a missing cited head as a break
  3. that attestation is fresh — its observed_at is within the freshness window below

It still does not mean WORM, object lock, or ITC-CAP data.archive. It does not raise provision maturity to D5.

Attestation cadence and freshness window

An attestation dated once is not a live precondition. The claim is derived from the mounted attestation on every read, not declared:

Setting Value
Intended attestation cadence daily
Freshness window 168 hours (7 days)
Mount path AUDIT_CORE_ATTESTATION_PATH

The window is seven times the cadence so that a handful of missed runs degrade the claim rather than a single one flapping it. Widening the window without shortening the cadence weakens the claim and is a change to this contract, not a tuning knob.

tamper_evidence degrades to False, with the reason recorded, when the attestation is absent, unreadable, undated, older than the window, or cites a head the live chain does not carry — and when the chain itself is broken or cannot be walked. Unreadable is treated as absent deliberately: a malformed file must not hold up a claim that a missing file would drop.

How the attestation is produced and where it lives

AUDIT-WP-0009-T02, deploy/attest-cronjob.yaml.

Cadence daily, 17 3 * * * UTC, against the 168h window
Producer CronJob audit-core-attest-chain, its own ServiceAccount
Published to ConfigMap audit-core-chain-head, mounted read-only by the receiver at /etc/audit-core/attestation/
Offsite copy operator step, logical-offsite path (rapp-postgres / Nextcloud + age)

Three properties of that arrangement are load-bearing, not incidental.

The producer is not the receiver. A receiver that could rewrite its own attestation could forge it. So the job runs as a separate workload whose Role reaches exactly one named ConfigMap, and NetworkPolicy gives the receiver no API-server egress at all. Asserted in tests/test_layer_conformance.py.

It refuses to publish over a broken chain. If verify_chain reports a break the job fails and leaves the previous attestation standing. Publishing a fresh head over a break would replace an honest chain_break with a fresh-looking attestation — a stale attestation degrades the claim visibly, a false one does not.

The ConfigMap is mounted as a directory, not with subPath. A subPath ConfigMap mount is resolved once at pod start and never updates, so the daily attestation would reach the ConfigMap and never the running receiver: tamper_evidence would age out to false while the job reported success every night. That failure is silent in both directions, which is why the mount shape is part of this contract rather than a deployment detail.

What this reaches, and what it does not. The in-cluster copy puts the attestation outside platform-pg, so a database owner who rewrites a suffix cannot also rewrite the head. It does not withstand a cluster owner, who can edit the ConfigMap. The offsite copy is the one that survives losing the cluster, and audit-core deliberately does not write it — this repo holds no Nextcloud credential and should not acquire one to publish a hash. Until an operator establishes that copy, the delivered control is "defends against a database owner", and no stronger claim may be made from it.

Before the first run the ConfigMap is empty and /readyz reports tamper_evidence: false. That is the correct day-one state, not a regression. /readyz itself does not walk the chain: it publishes the last evaluated claim, or false if none, so a 2-second kubelet probe cannot take the pod out of the Service. The walk lives on /v1/integrity and retention_policy.

Do not write the attestation into the Barman prefix (platform-pg/ on resource:platform:audit-storage). That copy is restored with the table. A second copy may follow the logical-offsite path already used by RESOURCE-WP-0002-T06 (rapp-postgres / Nextcloud + age); cite it, do not invent a new bucket.

Tests this contract names

Test What it asserts
test_first_accept_sets_genesis First chain_prev is genesis
test_second_accept_links Second chain_prev is the first chain_hash
test_duplicate_does_not_fork Replay does not add a link
test_verify_clean_on_fresh_store Empty and two-event stores verify
test_rewritten_payload_fails_verify Superuser rewrite of payload_hash is a break
test_attestation_mismatch Cited head absent from the live chain is a break

Operator surface

python -m audit_core verify-chain
python -m audit_core verify-chain --against docs/evidence/chain-head-<ts>.json
python -m audit_core attest-chain --output docs/evidence/chain-head-<ts>.json

GET /v1/integrity (may_read) returns {intact, events, head, head_event_id, first_break, attestation_match} and never event payloads.