Expand description
Capability-benchmark registry (CH-09 capability-registry-benchmarks).
Extends the compile-time model catalog (crate::llm::catalog) with
independently-sourced benchmark scores, so the super::router::ModelRouter
can break cost/context ties using measured capability instead of catalog
order alone.
The dataset in src/llm/data/model_benchmarks.json is hand-curated, not
scraped — see src/llm/data/UPDATE.md for why and how to refresh it.
Every entry MUST carry a source_url and retrieved_date per
docs/uar-next-fable.md §2.4 (“version every entry with a source URL +
retrieval date”).
Structs§
- Benchmark
Score - A single sourced benchmark measurement for one model.
Enums§
- Benchmark
Dimension - Which capability dimension a benchmark measures.
Functions§
- best_
score - Best known score for a
provider/modelid on the given dimension, if any. - scores_
for - Look up all sourced benchmark scores for a
provider/modelid.