Let the model call your code safely
You wrap a host capability with a name, purpose, typed arguments, result, and handler. The model sees when and how to call it while your app keeps control of execution.
Worked example
See the idea in context
auto search = axllm::Tool(
"search",
"Search docs",
axllm::object({
{"type", "object"},
{"properties", axllm::object({{"query", axllm::object({{"type", "string"}})}})},
{"required", axllm::array({"query"})}
}),
[](axllm::Value) { return axllm::object({{"title", "Ax docs"}}); }
);- Explain when to call it
The name and description orient the model toward product documentation searches.
- Constrain the call
query must be a string and the result is declared as a string.
- Bind trusted code
searchDocs runs in your host environment when the tool is selected.
Run itIn your own project
include(FetchContent)
FetchContent_Declare(axllm GIT_REPOSITORY https://github.com/ax-llm/ax GIT_TAG main SOURCE_SUBDIR packages/cpp)
FetchContent_MakeAvailable(axllm)
target_link_libraries(your_app PRIVATE axllm::axllm)
#include <axllm/axllm.hpp>
auto llm = axllm::ai("openai", axllm::object({{"apiKey", std::getenv("OPENAI_API_KEY")}}));
auto classify = axllm::ax("review:string -> sentiment:class \"positive, negative, neutral\"");Set OPENAI_APIKEY in your environment before running provider-backed code.
From a clone of the ax repo:
npm run example -- cpp src/examples/cpp/generation/basic_generation.cppActive practice
Answer 2 in a row to learn this · attempt 1