ai() API

LLM provider, model, media, routing, and embedding APIs.

Most Used

`axllm::ai`

Create a provider client from a named deployment profile and options.

Field	Value
Kind	`function`
Ax concept	`ai`
API section	AxAI
Form	`axllm::ai(provider, options)`
Returns	AI client/service

Important Options

api key or credential provider
model
api URL
headers
transport

Examples

C++

auto client = axllm::ai("openai", axllm::object({{"apiKey", std::getenv("OPENAI_API_KEY")}}));

Full reference

`axllm::OpenAICompatibleClient`

OpenAI-compatible chat, stream, embedding, audio, and realtime provider boundary.

Field	Value
Kind	`type`
Ax concept	`OpenAICompatibleClient`
API section	AxAI
Form	`axllm::OpenAICompatibleClient(options, transport)`
Returns	provider client

Important Options

api key
model
base URL
transport

Full reference

`axllm::OpenAIResponsesClient`

OpenAI Responses provider mapping using the same Core-owned request and response contract.

Field	Value
Kind	`type`
Ax concept	`OpenAIResponsesClient`
API section	AxAI
Form	`axllm::OpenAIResponsesClient(options, transport)`
Returns	provider client

Important Options

api key
model
audio
realtime

Full reference

`axllm::GoogleGeminiClient`

Gemini provider mapping for chat, streaming, media, tools, embeddings, and usage normalization.

Field	Value
Kind	`type`
Ax concept	`GoogleGeminiClient`
API section	AxAI
Form	`axllm::GoogleGeminiClient(options, transport)`
Returns	provider client

Important Options

api key
model
embed model

Full reference

`axllm::AnthropicClient`

Anthropic provider mapping for messages, thinking, cache control, streaming, and usage normalization.

Field	Value
Kind	`type`
Ax concept	`AnthropicClient`
API section	AxAI
Form	`axllm::AnthropicClient(options, transport)`
Returns	provider client

Important Options

api key
model
thinking
cache control

Full reference

`axllm::AxBalancer`

Retry and route requests across multiple provider services, with opt-in adaptive cost, reliability, and deadline routing.

Field	Value
Kind	`type`
Ax concept	`AxBalancer`
API section	AxAI
Form	`axllm::AxBalancer(services, options)`
Returns	AI service

Important Options

services
retry policy
capability requirements
adaptive strategy

Full reference

`axllm::MultiServiceRouter`

Choose a service by capability or model routing policy.

Field	Value
Kind	`type`
Ax concept	`MultiServiceRouter`
API section	AxAI
Form	`axllm::MultiServiceRouter(services)`
Returns	AI service

Important Options

services
routing

Full reference

`axllm::ProviderRouter`

Route requests by capability, preserving native media for supporting providers and degrading only when required.

Field	Value
Kind	`type`
Ax concept	`ProviderRouter`
API section	AxAI
Form	`axllm::ProviderRouter(providers, routing, processing)`
Returns	AI service

Important Options

providers
routing
processing

Full reference

Advanced / internals / full reference

`axllm::get_supported_ai_models`

Return the AxIR-backed provider and model catalog, including dynamic named profiles and portable capability metadata.

Field	Value
Kind	`function`
Ax concept	`get_supported_ai_models`
API section	AxAI
Form	`axllm::get_supported_ai_models(options)`
Returns	provider catalog entries

Important Options

type filter
thinkingLevels
serviceTiers
isDynamic

Examples

C++

auto catalog = axllm::get_supported_ai_models();

Full reference

`axllm::AxCredentialRequest`

Request metadata passed to a renewable credential callback for every transport attempt.

Field	Value
Kind	`type`
Ax concept	`AxCredentialRequest`
API section	AxAI
Form	`axllm::AxCredentialRequest`
Returns	credential request

Important Options

profile
operation
method
URL

Full reference

`axllm::AxCredentialProvider`

Return fresh request headers that override static profile authentication.

Field	Value
Kind	`interface`
Ax concept	`AxCredentialProvider`
API section	AxAI
Form	`axllm::AxCredentialProvider`
Returns	header map or credential error

Important Options

chat
stream
embeddings
Responses
audio
retries

Full reference

`axllm::AxStreamHandler`

Incremental, closeable provider event stream. Retry and failover stop once content is delivered.

Field	Value
Kind	`type`
Ax concept	`AxProviderStream`
API section	AxAI
Form	`client.stream_each(request, handler)`
Returns	incremental chat events

Important Options

next event
terminal error
consumer cancellation
upstream close

Examples

C++

client.stream_each(request, [&](const auto& event) { handle(event); return true; });

Full reference

`axllm::AxUsageContext`

Application attribution merged from service defaults and per-call overrides.

Field	Value
Kind	`type`
Ax concept	`AxUsageContext`
API section	AxAI
Form	`axllm::AxUsageContext`
Returns	usage context

Important Options

tenant
user
request
run
feature
attributes

Full reference

`axllm::AxUsageEvent`

Normalized token usage and correlation data for one completed chat or embedding operation.

Field	Value
Kind	`type`
Ax concept	`AxUsageEvent`
API section	AxAI
Form	`axllm::AxUsageEvent`
Returns	usage event

Important Options

provider
model
tokens
context
correlation IDs
streaming

Full reference

`axllm::AxUsageObserver`

Best-effort process-wide callback for normalized usage events.

Field	Value
Kind	`interface`
Ax concept	`AxUsageObserver`
API section	AxAI
Form	`axllm::AxUsageObserver`
Returns	usage observer

Important Options

fail-open delivery
synchronous enqueue

Full reference

`axllm::set_usage_observer`

Field	Value
Kind	`function`
Ax concept	`set_usage_observer`
API section	AxAI
Form	`axllm::set_usage_observer(observer)`
Returns	void

Important Options

observer
clear

Examples

C++

axllm::set_usage_observer([&](auto event) { events.push_back(event); });

Full reference

`axllm::AxRuntimeHooks`

Non-serializable rate limiter, tracer, and meter overrides for one service or program execution.

Field	Value
Kind	`type`
Ax concept	`AxRuntimeHooks`
API section	AxAI
Form	`axllm::AxRuntimeHooks`
Returns	runtime hooks

Important Options

rate limiter
tracer
meter
precedence

Examples

C++

axllm::AxRuntimeHooks hooks{limiter, tracer, meter};

Full reference

`axllm::AxRateLimitInfo`

Provider and model metadata supplied to a request-wrapper rate limiter.

Field	Value
Kind	`type`
Ax concept	`AxRateLimitInfo`
API section	AxAI
Form	`axllm::AxRateLimitInfo`
Returns	rate-limit context

Important Options

operation
provider
model
streaming
previous usage

Full reference

`axllm::AxRateLimiter`

Request wrapper that can delay, reject, or execute a chat or embedding request.

Field	Value
Kind	`interface`
Ax concept	`AxRateLimiter`
API section	AxAI
Form	`axllm::AxRateLimiter`
Returns	provider result

Important Options

next
metadata
errors

Full reference

`axllm::AxTracer`

Dependency-neutral tracer that creates metadata-only Ax spans.

Field	Value
Kind	`interface`
Ax concept	`AxTracer`
API section	AxAI
Form	`axllm::AxTracer`
Returns	span

Important Options

start span
parent span
fail-open

Full reference

`axllm::AxMeter`

Dependency-neutral meter for Ax counters, histograms, and gauges.

Field	Value
Kind	`interface`
Ax concept	`AxMeter`
API section	AxAI
Form	`axllm::AxMeter`
Returns	instrument

Important Options

counter
histogram
gauge
fail-open

Full reference

`axllm::AxGlobals`

Process-wide live defaults for runtime hooks and usage observation.

Field	Value
Kind	`type`
Ax concept	`AxGlobals`
API section	AxAI
Form	`axllm::AxGlobals`
Returns	global hooks

Important Options

rate limiter
tracer
meter
usage observer

Full reference

`axllm::set_rate_limiter`

Field	Value
Kind	`function`
Ax concept	`set_rate_limiter`
API section	AxAI
Form	`axllm::set_rate_limiter(limiter)`
Returns	void

Important Options

limiter
clear

Examples

C++

axllm::set_rate_limiter(limiter);

Full reference

`axllm::set_tracer`

Field	Value
Kind	`function`
Ax concept	`set_tracer`
API section	AxAI
Form	`axllm::set_tracer(tracer)`
Returns	void

Important Options

tracer
clear

Examples

C++

axllm::set_tracer(tracer);

Full reference

`axllm::set_meter`

Field	Value
Kind	`function`
Ax concept	`set_meter`
API section	AxAI
Form	`axllm::set_meter(meter)`
Returns	void

Important Options

meter
clear

Examples

C++

axllm::set_meter(meter);

Full reference

`axllm::AxBalancerAdaptiveStrategy`

Configure adaptive provider routing without changing the ordered default.

Field	Value
Kind	`type`
Ax concept	`AxBalancerAdaptiveStrategy`
API section	AxAI
Form	`axllm::AxBalancerAdaptiveStrategy`
Returns	adaptive strategy

Important Options

deadline
bad outcome cost
expected tokens
stable route keys
slice
stats store
routing events

Full reference

`axllm::AxBalancerStatsStore`

Store shared adaptive decision state with atomic observations.

Field	Value
Kind	`interface`
Ax concept	`AxBalancerStatsStore`
API section	AxAI
Form	`axllm::AxBalancerStatsStore`
Returns	stats store

Important Options

get
observe

Full reference

`axllm::AxInMemoryBalancerStatsStore`

Thread-safe in-memory adaptive stats store.

Field	Value
Kind	`type`
Ax concept	`AxInMemoryBalancerStatsStore`
API section	AxAI
Form	`axllm::AxInMemoryBalancerStatsStore`
Returns	stats store

Full reference

`axllm::create_balancer_route_stats`

Create neutral adaptive route statistics.

Field	Value
Kind	`function`
Ax concept	`create_balancer_route_stats`
API section	AxAI
Form	`axllm::create_balancer_route_stats`
Returns	route stats

Full reference

`axllm::update_balancer_route_stats`

Purely reduce one success or failure observation into route statistics.

Field	Value
Kind	`function`
Ax concept	`update_balancer_route_stats`
API section	AxAI
Form	`axllm::update_balancer_route_stats`
Returns	route stats

Important Options

current stats
observation

Full reference

`axllm::sample_balancer_route_health`

Sample failure and deadline-miss probability for adaptive exploration.

Field	Value
Kind	`function`
Ax concept	`sample_balancer_route_health`
API section	AxAI
Form	`axllm::sample_balancer_route_health`
Returns	sampled health

Important Options

route stats
deadline

Full reference

Full Reference

Open the full C++ reference. This page highlights the ai symbols most relevant to everyday use.