Skip to main content

Module prompt_cache

universal_agent_runtime::uar

Module prompt_cache 

Source

Structs§

CachedEntry
Cached prompt metadata for Anthropic-compatible prompt caching.
SurrealMemPromptCacheProvider
Lock-free in-memory prompt cache backed by a HashMap.

Traits§

PromptCacheProvider
Abstract cache provider for prompt-caching backends.