Struct LiterLlmDriver 

pub struct LiterLlmDriver { /* private fields */ }

LLM driver powered by liter-llm’s DefaultClient.

Handles provider auto-detection, streaming, and tool-call normalization for 142+ providers through a single unified interface.

Implementations

impl LiterLlmDriver

pub fn new( config: ClientConfig, model: String, parallel_tool_calls: Option<bool>, ) -> Result<Self>

Create a new driver from a ClientConfig and model identifier.

The model should use liter-llm’s provider/model naming convention (e.g., "openai/gpt-4o", "anthropic/claude-sonnet-4").

Errors

Returns an error if the DefaultClient cannot be constructed (e.g. invalid headers or provider validation failure).

pub fn from_client( client: Arc<DefaultClient>, model: String, parallel_tool_calls: Option<bool>, budget_endpoint_fingerprint: Option<String>, ) -> Self

Create a driver from a pre-built DefaultClient.

pub fn with_endpoint_profile( self, profile: EndpointRequestProfile, ) -> Result<Self>

Bind an exact, host-resolved endpoint settings profile to this driver.

Errors

Returns an error when the profile is incomplete or belongs to another exact model. Request fields are checked immediately before dispatch.

pub fn model(&self) -> &str

Get the model identifier.

pub fn profiled_wire_receipt( &self, request: &LlmRequest, ) -> Result<ProfiledWireReceipt>

Return a redacted receipt for the exact profiled serialization that the driver validates before dispatch.

Errors

Returns an error when no endpoint profile is bound or preparation fails.

Trait Implementations

impl Debug for LiterLlmDriver

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl LlmDriver for LiterLlmDriver

fn with_bound_model(&self, model: &str) -> Result<Arc<dyn LlmDriver>>

Select another model on this exact provider/client binding. The trusted host checks the child’s policy before calling; this grants no authority. Implementations must not resolve new credentials or change endpoints.

fn stream<'life0, 'async_trait>( &'life0 self, req: LlmRequest, ) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<NormalizedEvent>> + Send>>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Stream a response from the LLM.