Show typed results as they arrive
You can render typed deltas while the answer is still arriving. The final result remains governed by the same signature and assertions.
Unit example (nearest native match)
See the idea in context
auto answer = axllm::ax("question:string -> answer:string");- Open a typed stream
streamingForward() uses the same provider, input, and contract as forward().
- Read only present fields
A chunk may contain an answer delta while other fields are still incomplete.
- Render without reparsing
The UI consumes signature-aware deltas instead of scraping provider text.
Run itIn your own project
include(FetchContent)
FetchContent_Declare(axllm GIT_REPOSITORY https://github.com/ax-llm/ax GIT_TAG main SOURCE_SUBDIR packages/cpp)
FetchContent_MakeAvailable(axllm)
target_link_libraries(your_app PRIVATE axllm::axllm)
#include <axllm/axllm.hpp>
auto llm = axllm::ai("openai", axllm::object({{"apiKey", std::getenv("OPENAI_API_KEY")}}));
auto classify = axllm::ax("review:string -> sentiment:class \"positive, negative, neutral\"");Set OPENAI_APIKEY in your environment before running provider-backed code.
From a clone of the ax repo:
npm run example -- cpp src/examples/cpp/generation/basic_generation.cppActive practice
Answer 2 in a row to learn this · attempt 1