Show typed results as they arrive
You can render typed deltas while the answer is still arriving. The final result remains governed by the same signature and assertions.
Unit example (nearest native match)
See the idea in context
auto answer = axllm::ax("question:string -> answer:string");- Open a typed stream
streamingForward() uses the same provider, input, and contract as forward().
- Read only present fields
A chunk may contain an answer delta while other fields are still incomplete.
- Render without reparsing
The UI consumes signature-aware deltas instead of scraping provider text.
Run itIn your own project
cmake_minimum_required(VERSION 3.20)
project(ax_quick_start LANGUAGES CXX)
set(CMAKE_CXX_STANDARD 17)
include(FetchContent)
FetchContent_Declare(axllm GIT_REPOSITORY https://github.com/ax-llm/ax GIT_TAG main SOURCE_SUBDIR packages/cpp)
FetchContent_MakeAvailable(axllm)
add_executable(quick_start quick_start.cpp)
target_link_libraries(quick_start PRIVATE axllm::axllm)
#include <axllm/axllm.hpp>
#include <cstdlib>
#include <iostream>
int main() {
auto llm = axllm::ai("openai", axllm::object({{"apiKey", std::getenv("OPENAI_API_KEY")}}));
auto classify = axllm::ax("review:string -> sentiment:class \"positive, negative, neutral\"");
auto result = classify.forward(*llm, axllm::object({
{"review", "Useful and boring in the best way."}
}));
auto sentiment = axllm::Core::get(result, "sentiment");
std::cout << "sentiment: " << std::get<std::string>(sentiment.data) << "\n";
}Set OPENAI_APIKEY in your environment before running provider-backed code.
From a clone of the ax repo:
npm run example -- cpp src/examples/cpp/generation/basic_generation.cppActive practice
Answer 2 in a row to learn this · attempt 1