Fall back without changing your app contract
You route across models by capability, health, latency, price, or application policy. A fallback preserves the typed contract and remains observable.
Unit example (nearest native match)
See the idea in context
axllm.SetUsageObserver(func(event axllm.AxUsageEvent) {
usageQueue <- event
})
_, err := client.Chat(ctx, request, axllm.Object(
"usageContext", axllm.Object("tenantId", tenantID, "userId", userID, "requestId", requestID),
))Run itIn your own project
go get github.com/ax-llm/ax/packages/go
import axllm "github.com/ax-llm/ax/packages/go"
client := axllm.NewAI("openai", map[string]axllm.Value{"apiKey": os.Getenv("OPENAI_API_KEY")})
classify := axllm.NewAx("review:string -> sentiment:class \"positive, negative, neutral\"", nil)Set OPENAI_APIKEY in your environment before running provider-backed code.
From a clone of the ax repo:
npm run example -- go src/examples/go/long-agents/smart_defaults_agent.goActive practice
Answer 2 in a row to learn this · attempt 1