feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
parent
81a4c8796a
commit
a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
|
|
@ -0,0 +1,66 @@
|
|||
---
|
||||
entity_slug: principal_clerk
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T06:08:47.862735'
|
||||
overall_score: 4.4
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly identifies a specific role - the chief administrative
|
||||
officer who oversees operations and directs inspection/direction labor. It distinguishes
|
||||
this from ownership and establishes it as part of the professional management
|
||||
class, making it a distinct concept rather than a vague umbrella term.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity is directly grounded in Smith's text from Book I, Chapter
|
||||
6, where he explicitly discusses how the labor of inspection and direction can
|
||||
be separated from capital ownership. The context accurately reflects Smith's analysis
|
||||
of the distinction between wages paid to clerks and profits belonging to capital
|
||||
owners.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The "Production" domain assignment is correct, as this role relates directly
|
||||
to the organization and management of productive activities. The principal clerk
|
||||
represents a key element in the division of labor within production processes
|
||||
that Smith analyzes.
|
||||
- name: vsm_relevance
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity maps well to VSM System 3 (internal regulation/audit) as
|
||||
it represents the management function that monitors and coordinates internal operations.
|
||||
It could also relate to S2 (coordination) in its role of directing labor and preventing
|
||||
operational conflicts.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity illuminates an important structural mechanism in Smith's
|
||||
analysis - the separation of management labor from capital ownership. It helps
|
||||
explain how complex enterprises can function with professional managers who receive
|
||||
wages while owners capture profits, demonstrating the evolution of organizational
|
||||
forms.
|
||||
---
|
||||
|
||||
# Evaluation: Principal Clerk
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly identifies a specific role - the chief administrative officer who oversees operations and directs inspection/direction labor. It distinguishes this from ownership and establishes it as part of the professional management class, making it a distinct concept rather than a vague umbrella term.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This entity is directly grounded in Smith's text from Book I, Chapter 6, where he explicitly discusses how the labor of inspection and direction can be separated from capital ownership. The context accurately reflects Smith's analysis of the distinction between wages paid to clerks and profits belonging to capital owners.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
The "Production" domain assignment is correct, as this role relates directly to the organization and management of productive activities. The principal clerk represents a key element in the division of labor within production processes that Smith analyzes.
|
||||
|
||||
## vsm_relevance — 4.0 / 5.0
|
||||
|
||||
This entity maps well to VSM System 3 (internal regulation/audit) as it represents the management function that monitors and coordinates internal operations. It could also relate to S2 (coordination) in its role of directing labor and preventing operational conflicts.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
This entity illuminates an important structural mechanism in Smith's analysis - the separation of management labor from capital ownership. It helps explain how complex enterprises can function with professional managers who receive wages while owners capture profits, demonstrating the evolution of organizational forms.
|
||||
Loading…
Add table
Add a link
Reference in a new issue