Connect Ax to the right model
You configure the provider, current model, credentials, and runtime options in one place. Your program contract stays separate from that choice.
Worked example
See the idea in context
auto client = axllm::ai("openai", axllm::object({{"apiKey", std::getenv("OPENAI_API_KEY")}}));- Choose the provider
name selects the provider adapter used by this client.
- Read credentials from the host
The API key stays in the process environment instead of browser storage or source code.
- Pick a current model
Model selection belongs in provider configuration, not in the program signature.
Run itIn your own project
cmake_minimum_required(VERSION 3.20)
project(ax_quick_start LANGUAGES CXX)
set(CMAKE_CXX_STANDARD 17)
include(FetchContent)
FetchContent_Declare(axllm GIT_REPOSITORY https://github.com/ax-llm/ax GIT_TAG main SOURCE_SUBDIR packages/cpp)
FetchContent_MakeAvailable(axllm)
add_executable(quick_start quick_start.cpp)
target_link_libraries(quick_start PRIVATE axllm::axllm)
#include <axllm/axllm.hpp>
#include <cstdlib>
#include <iostream>
int main() {
auto llm = axllm::ai("openai", axllm::object({{"apiKey", std::getenv("OPENAI_API_KEY")}}));
auto classify = axllm::ax("review:string -> sentiment:class \"positive, negative, neutral\"");
auto result = classify.forward(*llm, axllm::object({
{"review", "Useful and boring in the best way."}
}));
auto sentiment = axllm::Core::get(result, "sentiment");
std::cout << "sentiment: " << std::get<std::string>(sentiment.data) << "\n";
}Set OPENAI_APIKEY in your environment before running provider-backed code.
From a clone of the ax repo:
npm run example -- cpp src/examples/cpp/generation/structured_generation.cppActive practice
Answer 2 in a row to learn this · attempt 1