27 lines
1.1 KiB
YAML
27 lines
1.1 KiB
YAML
|
|
schema: canned-prompts/eval-rubric/v0.1
|
||
|
|
name: pqrst-embedded-verbatim
|
||
|
|
description: >
|
||
|
|
The point of composing practice/pqrst-estimate is that closing a session needs
|
||
|
|
no pqrst-practice checkout. If the canonical text stops being embedded
|
||
|
|
verbatim, this package silently becomes a paraphrase — the failure that
|
||
|
|
practice/pqrst-estimate itself already had once.
|
||
|
|
example: examples/basic.yaml
|
||
|
|
|
||
|
|
render:
|
||
|
|
- resolves_all: true
|
||
|
|
- not_contains: "{{"
|
||
|
|
- contains: "P — Main Problem:"
|
||
|
|
- contains: "S — Security and Credentials:"
|
||
|
|
- contains: "must sum to exactly 100"
|
||
|
|
- contains: "Signature: P<int> Q<int> R<int> S<int> T<int>"
|
||
|
|
- contains: "S may legitimately be 0%"
|
||
|
|
- contains: "## Operating conventions"
|
||
|
|
- contains: "keep the invalid record and say so in the seat"
|
||
|
|
|
||
|
|
output:
|
||
|
|
criteria:
|
||
|
|
- The PQRST record validates, or is kept invalid with the failure stated.
|
||
|
|
- The seat carries the signature in frontmatter and the full record in a section.
|
||
|
|
- The estimate covers the substantive session, excluding the closing ritual.
|
||
|
|
- The seat reads as a perspective, not a status report.
|