Connect Ax to the right model You configure the provider, current model, credentials, and runtime options in one place. Your program contract stays separate from that choice. cpp academy academy/topics/ai-providers-models website/content-src/academy/course.mjs academy Connect Ax to the right model
Unit 2 · Make AI outputs predictable

Connect Ax to the right model

You configure the provider, current model, credentials, and runtime options in one place. Your program contract stays separate from that choice.

ai()8 focused minutesNot started
Worked example

See the idea in context

auto client = axllm::ai("openai", axllm::object({{"apiKey", std::getenv("OPENAI_API_KEY")}}));
  1. Choose the provider

    name selects the provider adapter used by this client.

  2. Read credentials from the host

    The API key stays in the process environment instead of browser storage or source code.

  3. Pick a current model

    Model selection belongs in provider configuration, not in the program signature.

Run itIn your own project
cmake_minimum_required(VERSION 3.20)
project(ax_quick_start LANGUAGES CXX)
set(CMAKE_CXX_STANDARD 17)

include(FetchContent)
FetchContent_Declare(axllm GIT_REPOSITORY https://github.com/ax-llm/ax GIT_TAG main SOURCE_SUBDIR packages/cpp)
FetchContent_MakeAvailable(axllm)

add_executable(quick_start quick_start.cpp)
target_link_libraries(quick_start PRIVATE axllm::axllm)

#include <axllm/axllm.hpp>
#include <cstdlib>
#include <iostream>

int main() {
  auto llm = axllm::ai("openai", axllm::object({{"apiKey", std::getenv("OPENAI_API_KEY")}}));
  auto classify = axllm::ax("review:string -> sentiment:class \"positive, negative, neutral\"");
  auto result = classify.forward(*llm, axllm::object({
    {"review", "Useful and boring in the best way."}
  }));

  auto sentiment = axllm::Core::get(result, "sentiment");
  std::cout << "sentiment: " << std::get<std::string>(sentiment.data) << "\n";
}

Set OPENAI_APIKEY in your environment before running provider-backed code.

In the ax repo

From a clone of the ax repo:

npm run example -- cpp src/examples/cpp/generation/structured_generation.cpp
Active practice

Show that you can use it

Answer 2 in a row to learn this · attempt 1
Keep exploring

Source-backed follow-up