Skip to main content

Module failover

Module failover 

Source
Expand description

Local embedding primary/backup failover.

The runtime admits this only for two byte-identical local asset manifests serving the same declared embedding space. A member is retired through an authenticated host control, drains already admitted inference, and only a subsequent real embed error promotes the backup.

Structs§

EmbeddingFailoverEvent
Generation-ordered failover event. Subscribers must check generation before accepting a recovery result from an earlier member lifetime.
EmbeddingFailoverStatus
Operator-visible state of the local embedding pair.
LocalEmbeddingFailover
A compatibility-pinned local primary/backup embedding backend.

Enums§

EmbeddingFailoverTransition
The event that changed the serving member or its admission state.
LocalEmbeddingMember
Stable names of the only two members in a local embedding failover pair.