feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
parent
81a4c8796a
commit
a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
|
|
@ -0,0 +1,66 @@
|
|||
---
|
||||
entity_slug: foreign_trade
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T05:30:26.379354'
|
||||
overall_score: 4.2
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly distinguishes foreign trade from inland trade
|
||||
based on uncertainty of returns, providing a specific criterion rather than a
|
||||
vague description. It could be slightly more precise about what constitutes "commercial
|
||||
exchange between different countries" but the uncertainty-based distinction is
|
||||
well-articulated.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity is directly grounded in Smith's text from Book I, Chapter
|
||||
10, where he explicitly discusses foreign trade's greater uncertainty compared
|
||||
to inland trade and mentions specific examples like North American trade. The
|
||||
concept and its characteristics are clearly stated in the source material.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The "Exchange" domain is perfectly appropriate for foreign trade, as
|
||||
it represents a fundamental category of commercial exchange that Smith analyzes.
|
||||
This placement correctly captures the transactional nature of the concept within
|
||||
Smith's economic framework.
|
||||
- name: vsm_relevance
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: Foreign trade could map to S4 (intelligence/environmental adaptation)
|
||||
as it involves engaging with external environments and adapting to international
|
||||
conditions, but the mapping is not particularly strong or natural. The concept
|
||||
is more descriptive of a type of economic activity than a cybernetic function.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity provides genuine explanatory value by illuminating Smith's
|
||||
risk-return mechanism across different types of commerce and explaining profit
|
||||
differentials between domestic and international trade. It reveals an important
|
||||
structural relationship in Smith's analysis of capital employment rather than
|
||||
merely naming a phenomenon.
|
||||
---
|
||||
|
||||
# Evaluation: Foreign Trade
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly distinguishes foreign trade from inland trade based on uncertainty of returns, providing a specific criterion rather than a vague description. It could be slightly more precise about what constitutes "commercial exchange between different countries" but the uncertainty-based distinction is well-articulated.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This entity is directly grounded in Smith's text from Book I, Chapter 10, where he explicitly discusses foreign trade's greater uncertainty compared to inland trade and mentions specific examples like North American trade. The concept and its characteristics are clearly stated in the source material.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
The "Exchange" domain is perfectly appropriate for foreign trade, as it represents a fundamental category of commercial exchange that Smith analyzes. This placement correctly captures the transactional nature of the concept within Smith's economic framework.
|
||||
|
||||
## vsm_relevance — 3.0 / 5.0
|
||||
|
||||
Foreign trade could map to S4 (intelligence/environmental adaptation) as it involves engaging with external environments and adapting to international conditions, but the mapping is not particularly strong or natural. The concept is more descriptive of a type of economic activity than a cybernetic function.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
This entity provides genuine explanatory value by illuminating Smith's risk-return mechanism across different types of commerce and explaining profit differentials between domestic and international trade. It reveals an important structural relationship in Smith's analysis of capital employment rather than merely naming a phenomenon.
|
||||
Loading…
Add table
Add a link
Reference in a new issue