Measure whether your AI feature improved
You pair realistic examples with a metric, then compare versions on the same evidence. This turns prompt tweaking into a repeatable improvement loop.
Unit example (nearest native match)
See the idea in context
let qa = ax("question:string -> answer:string, confidence:number")?;- Keep a known answer
Each example records the behavior you want the program to reproduce.
- Score one prediction
The metric returns 1 only when the predicted sentiment matches the example.
- Compare on the same set
Reusing the dataset makes a new score meaningful instead of anecdotal.
Run itIn your own project
cargo add axllm
use axllm::{ai, ax};
use serde_json::json;
let llm = ai("openai", json!({"apiKey": std::env::var("OPENAI_API_KEY")?}))?;
let classify = ax("review:string -> sentiment:class \"positive, negative, neutral\"")?;Set OPENAI_APIKEY in your environment before running provider-backed code.
From a clone of the ax repo:
npm run example -- rust src/examples/rust/generation/structured_generation.rsActive practice
Answer 2 in a row to learn this · attempt 1