See failures, cost, and latency in productionYou add traces, usage and cost accounting, cache policy, cancellation, bounded retries, and safe logs. Debug output becomes evidence for tests and operations.rustacademyacademy/topics/production-observabilitywebsite/content-src/academy/course.mjsacademySee failures, cost, and latency in production
You add traces, usage and cost accounting, cache policy, cancellation, bounded retries, and safe logs. Debug output becomes evidence for tests and operations.
9 focused minutesNot started
Unit example (nearest native match)
See the idea in context
let program = ax("text:string -> label:string")?;
let usage = program.usage();
Trace the run
tracer connects model and tool activity to the surrounding request.
Make cancellation possible
abortSignal lets callers stop work that is no longer useful.
Control repeated work
contextCache makes reuse an explicit operational policy.
Run itIn your own project
cargo add axllm
use axllm::{ai, ax};
use serde_json::json;
let llm = ai("openai", json!({"apiKey": std::env::var("OPENAI_API_KEY")?}))?;
let classify = ax("review:string -> sentiment:class \"positive, negative, neutral\"")?;
Set OPENAI_APIKEY in your environment before running provider-backed code.
In the ax repo
From a clone of the ax repo:
npm run example -- rust src/examples/rust/long-agents/smart_defaults_agent.rs