Fall back without changing your app contract
You route across models by capability, health, latency, price, or application policy. A fallback preserves the typed contract and remains observable.
Unit example (nearest native match)
See the idea in context
auto program = axllm::ax("text:string -> label:string");
auto usage = program.getUsage();Run itIn your own project
include(FetchContent)
FetchContent_Declare(axllm GIT_REPOSITORY https://github.com/ax-llm/ax GIT_TAG main SOURCE_SUBDIR packages/cpp)
FetchContent_MakeAvailable(axllm)
target_link_libraries(your_app PRIVATE axllm::axllm)
#include <axllm/axllm.hpp>
auto llm = axllm::ai("openai", axllm::object({{"apiKey", std::getenv("OPENAI_API_KEY")}}));
auto classify = axllm::ax("review:string -> sentiment:class \"positive, negative, neutral\"");Set OPENAI_APIKEY in your environment before running provider-backed code.
From a clone of the ax repo:
npm run example -- cpp src/examples/cpp/long-agents/smart_defaults_agent.cppActive practice
Answer 2 in a row to learn this · attempt 1