ai() API

LLM provider, model, media, routing, and embedding APIs.

Most Used

`axllm.NewAI`

Create a provider client from a named deployment profile and options.

Field	Value
Kind	`function`
Ax concept	`ai`
API section	AxAI
Form	`axllm.NewAI(provider, options)`
Returns	AIClient

Important Options

api key or credential provider
model
api URL
headers
transport

Examples

client := axllm.NewAI("openai", map[string]axllm.Value{"apiKey": os.Getenv("OPENAI_API_KEY")})

Full reference

`axllm.OpenAICompatibleClient`

OpenAI-compatible chat, stream, embedding, audio, and realtime provider boundary.

Field	Value
Kind	`type`
Ax concept	`OpenAICompatibleClient`
API section	AxAI
Form	`axllm.NewOpenAICompatibleClient(options)`
Returns	provider client

Important Options

api key
model
base URL
transport

Full reference

`axllm.OpenAIResponsesClient`

OpenAI Responses provider mapping using the same Core-owned request and response contract.

Field	Value
Kind	`type`
Ax concept	`OpenAIResponsesClient`
API section	AxAI
Form	`axllm.NewOpenAIResponsesClient(options)`
Returns	provider client

Important Options

api key
model
audio
realtime

Full reference

`axllm.GoogleGeminiClient`

Gemini provider mapping for chat, streaming, media, tools, embeddings, and usage normalization.

Field	Value
Kind	`type`
Ax concept	`GoogleGeminiClient`
API section	AxAI
Form	`axllm.NewGoogleGeminiClient(options)`
Returns	provider client

Important Options

api key
model
embed model

Full reference

`axllm.AnthropicClient`

Anthropic provider mapping for messages, thinking, cache control, streaming, and usage normalization.

Field	Value
Kind	`type`
Ax concept	`AnthropicClient`
API section	AxAI
Form	`axllm.NewAnthropicClient(options)`
Returns	provider client

Important Options

api key
model
thinking
cache control

Full reference

`axllm.AxBalancer`

Retry and route requests across multiple provider services, with opt-in adaptive cost, reliability, and deadline routing.

Field	Value
Kind	`type`
Ax concept	`AxBalancer`
API section	AxAI
Form	`axllm.NewAxBalancer(services, options)`
Returns	AI service

Important Options

services
retry policy
capability requirements
adaptive strategy

Full reference

`axllm.MultiServiceRouter`

Choose a service by capability or model routing policy.

Field	Value
Kind	`type`
Ax concept	`MultiServiceRouter`
API section	AxAI
Form	`axllm.MultiServiceRouter`
Returns	AI service

Important Options

services
routing

Full reference

`axllm.ProviderRouter`

Route requests by capability, preserving native media for supporting providers and degrading only when required.

Field	Value
Kind	`type`
Ax concept	`ProviderRouter`
API section	AxAI
Form	`axllm.ProviderRouter`
Returns	AI service

Important Options

providers
routing
processing

Full reference

Advanced / internals / full reference

`axllm.GetSupportedAIModels`

Return the AxIR-backed provider and model catalog, including dynamic named profiles and portable capability metadata.

Field	Value
Kind	`function`
Ax concept	`get_supported_ai_models`
API section	AxAI
Form	`axllm.GetSupportedAIModels(options)`
Returns	provider catalog entries

Important Options

type filter
thinkingLevels
serviceTiers
isDynamic

Examples

catalog := axllm.GetSupportedAIModels(map[string]axllm.Value{})

Full reference

`axllm.AxCredentialRequest`

Request metadata passed to a renewable credential callback for every transport attempt.

Field	Value
Kind	`type`
Ax concept	`AxCredentialRequest`
API section	AxAI
Form	`axllm.AxCredentialRequest`
Returns	credential request

Important Options

profile
operation
method
URL

Full reference

`axllm.AxCredentialProvider`

Return fresh request headers that override static profile authentication.

Field	Value
Kind	`interface`
Ax concept	`AxCredentialProvider`
API section	AxAI
Form	`axllm.AxCredentialProvider`
Returns	header map or credential error

Important Options

chat
stream
embeddings
Responses
audio
retries

Full reference

`axllm.AxChatStream`

Incremental, closeable provider event stream. Retry and failover stop once content is delivered.

Field	Value
Kind	`type`
Ax concept	`AxProviderStream`
API section	AxAI
Form	`client.StreamEvents(ctx, request, options)`
Returns	incremental chat events

Important Options

next event
terminal error
consumer cancellation
upstream close

Examples

stream, err := client.StreamEvents(ctx, request, nil)

Full reference

`axllm.AxUsageContext`

Application attribution merged from service defaults and per-call overrides.

Field	Value
Kind	`type`
Ax concept	`AxUsageContext`
API section	AxAI
Form	`axllm.AxUsageContext`
Returns	usage context

Important Options

tenant
user
request
run
feature
attributes

Full reference

`axllm.AxUsageEvent`

Normalized token usage and correlation data for one completed chat or embedding operation.

Field	Value
Kind	`type`
Ax concept	`AxUsageEvent`
API section	AxAI
Form	`axllm.AxUsageEvent`
Returns	usage event

Important Options

provider
model
tokens
context
correlation IDs
streaming

Full reference

`axllm.AxUsageObserver`

Best-effort process-wide callback for normalized usage events.

Field	Value
Kind	`interface`
Ax concept	`AxUsageObserver`
API section	AxAI
Form	`axllm.AxUsageObserver`
Returns	usage observer

Important Options

fail-open delivery
synchronous enqueue

Full reference

`axllm.SetUsageObserver`

Field	Value
Kind	`function`
Ax concept	`set_usage_observer`
API section	AxAI
Form	`axllm.SetUsageObserver(observer)`
Returns	void

Important Options

observer
clear

Examples

axllm.SetUsageObserver(func(event axllm.AxUsageEvent) { events = append(events, event) })

Full reference

`axllm.AxRuntimeHooks`

Non-serializable rate limiter, tracer, and meter overrides for one service or program execution.

Field	Value
Kind	`type`
Ax concept	`AxRuntimeHooks`
API section	AxAI
Form	`axllm.AxRuntimeHooks`
Returns	runtime hooks

Important Options

rate limiter
tracer
meter
precedence

Examples

hooks := axllm.AxRuntimeHooks{RateLimiter: limiter, Tracer: tracer, Meter: meter}

Full reference

`axllm.AxRateLimitInfo`

Provider and model metadata supplied to a request-wrapper rate limiter.

Field	Value
Kind	`type`
Ax concept	`AxRateLimitInfo`
API section	AxAI
Form	`axllm.AxRateLimitInfo`
Returns	rate-limit context

Important Options

operation
provider
model
streaming
previous usage

Full reference

`axllm.AxRateLimiter`

Request wrapper that can delay, reject, or execute a chat or embedding request.

Field	Value
Kind	`interface`
Ax concept	`AxRateLimiter`
API section	AxAI
Form	`axllm.AxRateLimiter`
Returns	provider result

Important Options

next
metadata
errors

Full reference

`axllm.AxTracer`

Dependency-neutral tracer that creates metadata-only Ax spans.

Field	Value
Kind	`interface`
Ax concept	`AxTracer`
API section	AxAI
Form	`axllm.AxTracer`
Returns	span

Important Options

start span
parent span
fail-open

Full reference

`axllm.AxMeter`

Dependency-neutral meter for Ax counters, histograms, and gauges.

Field	Value
Kind	`interface`
Ax concept	`AxMeter`
API section	AxAI
Form	`axllm.AxMeter`
Returns	instrument

Important Options

counter
histogram
gauge
fail-open

Full reference

`axllm.AxGlobals`

Process-wide live defaults for runtime hooks and usage observation.

Field	Value
Kind	`type`
Ax concept	`AxGlobals`
API section	AxAI
Form	`axllm.AxGlobals`
Returns	global hooks

Important Options

rate limiter
tracer
meter
usage observer

Full reference

`axllm.SetRateLimiter`

Field	Value
Kind	`function`
Ax concept	`set_rate_limiter`
API section	AxAI
Form	`axllm.SetRateLimiter(limiter)`
Returns	void

Important Options

limiter
clear

Examples

axllm.SetRateLimiter(limiter)

Full reference

`axllm.SetTracer`

Field	Value
Kind	`function`
Ax concept	`set_tracer`
API section	AxAI
Form	`axllm.SetTracer(tracer)`
Returns	void

Important Options

tracer
clear

Examples

axllm.SetTracer(tracer)

Full reference

`axllm.SetMeter`

Field	Value
Kind	`function`
Ax concept	`set_meter`
API section	AxAI
Form	`axllm.SetMeter(meter)`
Returns	void

Important Options

meter
clear

Examples

axllm.SetMeter(meter)

Full reference

`axllm.AxBalancerAdaptiveStrategy`

Configure adaptive provider routing without changing the ordered default.

Field	Value
Kind	`type`
Ax concept	`AxBalancerAdaptiveStrategy`
API section	AxAI
Form	`axllm.AxBalancerAdaptiveStrategy`
Returns	adaptive strategy

Important Options

deadline
bad outcome cost
expected tokens
stable route keys
slice
stats store
routing events

Full reference

`axllm.AxBalancerStatsStore`

Store shared adaptive decision state with atomic observations.

Field	Value
Kind	`interface`
Ax concept	`AxBalancerStatsStore`
API section	AxAI
Form	`axllm.AxBalancerStatsStore`
Returns	stats store

Important Options

get
observe

Full reference

`axllm.AxInMemoryBalancerStatsStore`

Thread-safe in-memory adaptive stats store.

Field	Value
Kind	`type`
Ax concept	`AxInMemoryBalancerStatsStore`
API section	AxAI
Form	`axllm.AxInMemoryBalancerStatsStore`
Returns	stats store

Full reference

`axllm.CreateBalancerRouteStats`

Create neutral adaptive route statistics.

Field	Value
Kind	`function`
Ax concept	`create_balancer_route_stats`
API section	AxAI
Form	`axllm.CreateBalancerRouteStats`
Returns	route stats

Full reference

`axllm.UpdateBalancerRouteStats`

Purely reduce one success or failure observation into route statistics.

Field	Value
Kind	`function`
Ax concept	`update_balancer_route_stats`
API section	AxAI
Form	`axllm.UpdateBalancerRouteStats`
Returns	route stats

Important Options

current stats
observation

Full reference

`axllm.SampleBalancerRouteHealth`

Sample failure and deadline-miss probability for adaptive exploration.

Field	Value
Kind	`function`
Ax concept	`sample_balancer_route_health`
API section	AxAI
Form	`axllm.SampleBalancerRouteHealth`
Returns	sampled health

Important Options

route stats
deadline

Full reference

Full Reference

Open the full Go reference. This page highlights the ai symbols most relevant to everyday use.