Choose better results and keep contextYou can keep chat context, sample several candidates, select one result, cache responses, and observe steps. Add each option only when your feature needs that control.rustacademyacademy/topics/gen-memory-sampling-hookswebsite/content-src/academy/course.mjsacademyChoose better results and keep context
You can keep chat context, sample several candidates, select one result, cache responses, and observe steps. Add each option only when your feature needs that control.
9 focused minutesNot started
Unit example (nearest native match)
See the idea in context
let answer = ax("question:string -> answer:string")?;
Carry relevant memory
mem supplies conversation context owned by your application.
Request candidates
sampleCount asks for three possible results instead of one.
Select with a rule
resultPicker turns extra samples into a deliberate quality choice.
Run itIn your own project
cargo add axllm
use axllm::{ai, ax};
use serde_json::json;
let llm = ai("openai", json!({"apiKey": std::env::var("OPENAI_API_KEY")?}))?;
let classify = ax("review:string -> sentiment:class \"positive, negative, neutral\"")?;
Set OPENAI_APIKEY in your environment before running provider-backed code.
In the ax repo
From a clone of the ax repo:
npm run example -- rust src/examples/rust/generation/basic_generation.rs