coulomb/llm-connect
4
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
llm-connect/contracts/functional/costs.md
tegwick 09aa1f3604
Some checks failed
CI Smoke / host-smoke (push) Successful in 0s
Details
CI Smoke / container-smoke (push) Has been cancelled
Details
Implement LLM-WP-0007: Kimi K3 default and EUR spend reporting 
Add moonshotai/kimi-k3 as OpenRouter basemodel default after live smoke,
USD→EUR cost conversion, append-only usage ledger, and CLI run/cost/spend
week commands with token and euro reporting.
2026-08-03 22:00:34 +02:00

1.2 KiB
Raw Blame History

Cost Estimates

llm_connect.costs converts token estimates or observed token counts into USD estimates using ModelRateRegistry, and optionally into EUR via llm_connect.fx.

Contract

from llm_connect import estimate_cost

estimate = estimate_cost("openai/gpt-4o-mini", 28_000, 7_500)
estimate = estimate_cost("moonshotai/kimi-k3", 1_000, 500, fx=0.92)

For known models the result is:

  • cost_usd: prompt plus completion estimate.
  • prompt_cost_usd: prompt-token component.
  • completion_cost_usd: completion-token component.
  • cost_source: rate_table:<model_id>.
  • cost_eur / prompt_cost_eur / completion_cost_eur: EUR display amounts when FX is available (default: bundled snapshot, override with fx= or env LLM_CONNECT_EUR_PER_USD as euros-per-USD).
  • fx_source: how EUR was derived (explicit, env:…, snapshot:…).

Unknown models return CostEstimate(cost_usd=None, cost_source="unknown") with EUR fields also None. Missing rates or FX are never silently treated as zero cost.

Pass apply_fx=False to skip EUR conversion.

The module also exposes CostModel(registry=..., fx=...) for callers that prefer to carry a registry object and call model.estimate_cost(...).