Unit 8 · Measure and improve AI quality

Improve how an agent chooses and acts

You evaluate the whole agent pipeline and tune its actor or responder. Good task records exercise tool choice, clarification, delegation, and final quality.

optimize()11 focused minutesNot started

Worked example

See the idea in context

const result = await assistant.optimize(tasks, { target: 'actor', maxMetricCalls: 40 });

Run itIn your own project

npm install @ax-llm/ax

import { ai, ax } from '@ax-llm/ax';

const llm = ai({ name: 'openai', apiKey: process.env.OPENAI_APIKEY! });
const classify = ax('review:string -> sentiment:class "positive, negative, neutral"');

const result = await classify.forward(llm, {
  review: 'Useful and boring in the best way.',
});

Set OPENAI_APIKEY in your environment before running provider-backed code.

In the ax repo

From a clone of the ax repo:

npm run example -- typescript src/examples/typescript/optimization/axgen-optimization.ts

Active practice

Show that you can use it

Answer 2 in a row to learn this · attempt 1

Keep exploring

See the idea in context

Show that you can use it

Source-backed follow-up