Expand description
Provider health tracking for failover-aware routing (CH-03).
Tracks per-provider consecutive-failure counts and puts a provider into a
cooldown window once error_threshold consecutive failures are recorded,
per crate::config::FailoverConfig. ModelRouter::route
and ProviderRegistry::resolve_to_llm_config
both consult ProviderHealthMonitor::is_available to skip providers currently in cooldown.
Structs§
- Provider
Health Monitor - Tracks provider health via consecutive-failure cooldowns.
- Provider
Health Snapshot - A point-in-time view of one provider’s health, for API/console surfacing.