Measure whether your AI feature improved
You pair realistic examples with a metric, then compare versions on the same evidence. This turns prompt tweaking into a repeatable improvement loop.
Unit example (nearest native match)
See the idea in context
var qa = Ax.ax("question:string -> answer:string, confidence:number");- Keep a known answer
Each example records the behavior you want the program to reproduce.
- Score one prediction
The metric returns 1 only when the predicted sentiment matches the example.
- Compare on the same set
Reusing the dataset makes a new score meaningful instead of anecdotal.
Run itIn your own project
// Gradle (build.gradle):
implementation 'dev.axllm:ax:24.0.15'
// Maven (pom.xml):
<dependency>
<groupId>dev.axllm</groupId>
<artifactId>ax</artifactId>
<version>24.0.15</version>
</dependency>
import dev.axllm.ax.Ax;
import java.util.Map;
public class QuickStart {
public static void main(String[] args) throws Exception {
var llm = Ax.ai("openai", Map.of("apiKey", System.getenv("OPENAI_API_KEY")));
var classify = Ax.ax("review:string -> sentiment:class \"positive, negative, neutral\"");
var result = classify.forward(llm, Map.of(
"review", "Useful and boring in the best way."
));
System.out.println("sentiment: " + result.get("sentiment"));
}
}Set OPENAI_APIKEY in your environment before running provider-backed code.
From a clone of the ax repo:
npm run example -- java src/examples/java/generation/StructuredGenerationExample.javaActive practice
Answer 2 in a row to learn this · attempt 1