Struct TokenService 

pub struct TokenService;

Implementations

impl TokenService

pub fn count_serialized( contract: SerializedCountingContract, request_bytes: &[u8], ) -> Result<CountedTokens, Utf8Error>

Count one complete serialized request under an explicit framing contract.

Errors

Returns an error when the supplied bytes are not UTF-8 JSON text.

pub fn encoding_for(model: &str) -> TokenEncoding

Resolve a model identifier to its tiktoken encoding.

Accepts either a bare model id or a provider/model pair; the provider prefix is stripped before lookup.

Examples

use universal_agent_runtime::uar::runtime::context::token_service::{TokenEncoding, TokenService};
assert_eq!(TokenService::encoding_for("openai/gpt-4o"), TokenEncoding::O200kBase);
assert_eq!(TokenService::encoding_for("groq/llama-3"), TokenEncoding::Cl100kFallback);

pub fn count(model: &str, content: &str) -> usize

Count tokens in content with model’s encoding.

Examples

use universal_agent_runtime::uar::runtime::context::token_service::TokenService;
assert!(TokenService::count("openai/gpt-4o", "hello") > 0);

pub fn count_messages(model: &str, messages: &[Message]) -> usize

Count tokens in a message list with model’s encoding, including per-message and reply-priming overhead.

pub fn estimate_string(content: &str) -> usize

Count tokens for a string when the model is not known to the caller.

Uses the documented cl100k_base fallback. Prefer Self::count wherever the model is available.

pub fn estimate_messages(messages: &[Message]) -> usize

Count tokens for a message list when the model is not known to the caller. Prefer Self::count_messages.

Trait Implementations

impl Debug for TokenService

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.