ai() API

LLM provider, model, media, routing, and embedding APIs.

Most Used

`axllm::ai`

Create a provider client from a provider name and options.

Field	Value
Kind	`function`
Ax concept	`ai`
API section	AxAI
Form	`axllm::ai(provider, options)`
Returns	AI client/service

Important Options

api key
model
api URL
headers
transport

Examples

C++

auto client = axllm::ai("openai", axllm::object({{"apiKey", std::getenv("OPENAI_API_KEY")}}));

Full reference

`axllm::OpenAICompatibleClient`

OpenAI-compatible chat, stream, embedding, audio, and realtime provider boundary.

Field	Value
Kind	`type`
Ax concept	`OpenAICompatibleClient`
API section	AxAI
Form	`axllm::OpenAICompatibleClient(options, transport)`
Returns	provider client

Important Options

api key
model
base URL
transport

Full reference

`axllm::OpenAIResponsesClient`

OpenAI Responses provider mapping using the same Core-owned request and response contract.

Field	Value
Kind	`type`
Ax concept	`OpenAIResponsesClient`
API section	AxAI
Form	`axllm::OpenAIResponsesClient(options, transport)`
Returns	provider client

Important Options

api key
model
audio
realtime

Full reference

`axllm::GoogleGeminiClient`

Gemini provider mapping for chat, streaming, media, tools, embeddings, and usage normalization.

Field	Value
Kind	`type`
Ax concept	`GoogleGeminiClient`
API section	AxAI
Form	`axllm::GoogleGeminiClient(options, transport)`
Returns	provider client

Important Options

api key
model
embed model

Full reference

`axllm::AnthropicClient`

Anthropic provider mapping for messages, thinking, cache control, streaming, and usage normalization.

Field	Value
Kind	`type`
Ax concept	`AnthropicClient`
API section	AxAI
Form	`axllm::AnthropicClient(options, transport)`
Returns	provider client

Important Options

api key
model
thinking
cache control

Full reference

`axllm::AxBalancer`

Retry and route requests across multiple provider services, with opt-in adaptive cost, reliability, and deadline routing.

Field	Value
Kind	`type`
Ax concept	`AxBalancer`
API section	AxAI
Form	`axllm::AxBalancer(services, options)`
Returns	AI service

Important Options

services
retry policy
capability requirements
adaptive strategy

Full reference

`axllm::MultiServiceRouter`

Choose a service by capability or model routing policy.

Field	Value
Kind	`type`
Ax concept	`MultiServiceRouter`
API section	AxAI
Form	`axllm::MultiServiceRouter(services)`
Returns	AI service

Important Options

services
routing

Full reference

`axllm::ProviderRouter`

Route provider requests to registered provider clients.

Field	Value
Kind	`type`
Ax concept	`ProviderRouter`
API section	AxAI
Form	`axllm::ProviderRouter(providers, routing, processing)`
Returns	AI service

Important Options

providers
routing
processing

Full reference

Advanced / internals / full reference

`axllm::AxUsageContext`

Application attribution merged from service defaults and per-call overrides.

Field	Value
Kind	`type`
Ax concept	`AxUsageContext`
API section	AxAI
Form	`axllm::AxUsageContext`
Returns	usage context

Important Options

tenant
user
request
run
feature
attributes

Full reference

`axllm::AxUsageEvent`

Normalized token usage and correlation data for one completed chat or embedding operation.

Field	Value
Kind	`type`
Ax concept	`AxUsageEvent`
API section	AxAI
Form	`axllm::AxUsageEvent`
Returns	usage event

Important Options

provider
model
tokens
context
correlation IDs
streaming

Full reference

`axllm::AxUsageObserver`

Best-effort process-wide callback for normalized usage events.

Field	Value
Kind	`interface`
Ax concept	`AxUsageObserver`
API section	AxAI
Form	`axllm::AxUsageObserver`
Returns	usage observer

Important Options

fail-open delivery
synchronous enqueue

Full reference

`axllm::set_usage_observer`

Field	Value
Kind	`function`
Ax concept	`set_usage_observer`
API section	AxAI
Form	`axllm::set_usage_observer(observer)`
Returns	void

Important Options

observer
clear

Examples

C++

axllm::set_usage_observer([&](auto event) { events.push_back(event); });

Full reference

`axllm::AxBalancerAdaptiveStrategy`

Configure adaptive provider routing without changing the ordered default.

Field	Value
Kind	`type`
Ax concept	`AxBalancerAdaptiveStrategy`
API section	AxAI
Form	`axllm::AxBalancerAdaptiveStrategy`
Returns	adaptive strategy

Important Options

deadline
bad outcome cost
expected tokens
stable route keys
slice
stats store
routing events

Full reference

`axllm::AxBalancerStatsStore`

Store shared adaptive decision state with atomic observations.

Field	Value
Kind	`interface`
Ax concept	`AxBalancerStatsStore`
API section	AxAI
Form	`axllm::AxBalancerStatsStore`
Returns	stats store

Important Options

get
observe

Full reference

`axllm::AxInMemoryBalancerStatsStore`

Thread-safe in-memory adaptive stats store.

Field	Value
Kind	`type`
Ax concept	`AxInMemoryBalancerStatsStore`
API section	AxAI
Form	`axllm::AxInMemoryBalancerStatsStore`
Returns	stats store

Full reference

`axllm::create_balancer_route_stats`

Create neutral adaptive route statistics.

Field	Value
Kind	`function`
Ax concept	`create_balancer_route_stats`
API section	AxAI
Form	`axllm::create_balancer_route_stats`
Returns	route stats

Full reference

`axllm::update_balancer_route_stats`

Purely reduce one success or failure observation into route statistics.

Field	Value
Kind	`function`
Ax concept	`update_balancer_route_stats`
API section	AxAI
Form	`axllm::update_balancer_route_stats`
Returns	route stats

Important Options

current stats
observation

Full reference

`axllm::sample_balancer_route_health`

Sample failure and deadline-miss probability for adaptive exploration.

Field	Value
Kind	`function`
Ax concept	`sample_balancer_route_health`
API section	AxAI
Form	`axllm::sample_balancer_route_health`
Returns	sampled health

Important Options

route stats
deadline

Full reference

Full Reference

Open the full C++ reference. This page highlights the ai symbols most relevant to everyday use.