Unit 8 · Measure and improve AI quality

Improve a generator or workflow with data

You tune a generator or workflow from examples and a metric. Bound the budget, keep validation data separate, and apply the returned artifact through the program API.

optimize()10 focused minutesNot started

Worked example

See the idea in context

const result = await optimize(program, train, metric, { studentAI, teacherAI, maxMetricCalls: 40 });

Run itIn your own project

npm install @ax-llm/ax

import { ai, ax } from '@ax-llm/ax';

const llm = ai({ name: 'openai', apiKey: process.env.OPENAI_APIKEY! });
const classify = ax('review:string -> sentiment:class "positive, negative, neutral"');

const result = await classify.forward(llm, {
  review: 'Useful and boring in the best way.',
});

Set OPENAI_APIKEY in your environment before running provider-backed code.

In the ax repo

From a clone of the ax repo:

npm run example -- typescript src/examples/typescript/optimization/axgen-optimization.ts

Active practice

Show that you can use it

Answer 2 in a row to learn this · attempt 1

Keep exploring

See the idea in context

Show that you can use it

Source-backed follow-up