feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
parent
81a4c8796a
commit
a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
|
|
@ -0,0 +1,63 @@
|
|||
---
|
||||
entity_slug: metal_currency
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T05:51:58.677413'
|
||||
overall_score: 4.2
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition is precise and captures a distinct concept - metals as
|
||||
exchange medium with specific properties (durability, divisibility, proportionality).
|
||||
It avoids circularity and clearly distinguishes metal currency from other forms
|
||||
of exchange media.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity is directly grounded in Smith's text from Book I, Chapter
|
||||
4, where he explicitly discusses why metals became preferred exchange media. The
|
||||
specific properties mentioned (durability, divisibility, precise proportioning)
|
||||
align closely with Smith's actual arguments.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The "Exchange" domain placement is correct, as metal currency is fundamentally
|
||||
about facilitating exchange transactions. This fits perfectly within the conceptual
|
||||
category of exchange mechanisms and media.
|
||||
- name: vsm_relevance
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: Metal currency maps most naturally to S1 (primary operations) as it's
|
||||
a fundamental operational tool for exchange, but it also has S2 coordination aspects
|
||||
by standardizing exchange processes. However, it's somewhat abstract as an exchange
|
||||
medium rather than a clear systemic function.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity provides genuine explanatory power by illuminating the mechanism
|
||||
behind why certain materials become dominant exchange media. It explains the structural
|
||||
relationship between material properties and exchange functionality, going beyond
|
||||
merely naming a phenomenon.
|
||||
---
|
||||
|
||||
# Evaluation: Metal Currency
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition is precise and captures a distinct concept - metals as exchange medium with specific properties (durability, divisibility, proportionality). It avoids circularity and clearly distinguishes metal currency from other forms of exchange media.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This entity is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses why metals became preferred exchange media. The specific properties mentioned (durability, divisibility, precise proportioning) align closely with Smith's actual arguments.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
The "Exchange" domain placement is correct, as metal currency is fundamentally about facilitating exchange transactions. This fits perfectly within the conceptual category of exchange mechanisms and media.
|
||||
|
||||
## vsm_relevance — 3.0 / 5.0
|
||||
|
||||
Metal currency maps most naturally to S1 (primary operations) as it's a fundamental operational tool for exchange, but it also has S2 coordination aspects by standardizing exchange processes. However, it's somewhat abstract as an exchange medium rather than a clear systemic function.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
This entity provides genuine explanatory power by illuminating the mechanism behind why certain materials become dominant exchange media. It explains the structural relationship between material properties and exchange functionality, going beyond merely naming a phenomenon.
|
||||
Loading…
Add table
Add a link
Reference in a new issue