Module prompt_caching 

Prompt-caching settings and priority resolution.

Defines the hierarchy by which effective prompt-caching state is determined for any given request:

request_override → session_override → user_setting → global_setting
(highest priority)                                (lowest priority)

Structs

EffectivePromptCaching

Effective prompt-caching value and its authoritative source.

UserPromptCachingSettings

Stored per-user prompt-caching preferences.

Enums

CachingScope

Granularity at which prompt-caching preference is expressed.

PromptCachingSource

Source that supplied the effective prompt-caching value.

Functions

resolve_effective_caching

Resolve the effective prompt-caching flag for a request.