AxBalancerRoutingContext
type AxBalancerRoutingContext<TModelKey> = Readonly<{
model: TModelKey | undefined;
options: | Readonly<AxAIServiceOptions>
| undefined;
}>;Defined in: https://github.com/ax-llm/ax/blob/781623e58befc00a555cf73ccbac598a72bb700c/src/ax/ai/balance_adaptive.ts#L74
Public, prompt-free context supplied to adaptive routing callbacks.
Type Parameters
| Type Parameter | Default type |
|---|---|
TModelKey | string |