AxBalancerRouteStats
type AxBalancerRouteStats = Readonly<{
failureEwma: number;
logLatencyM2: number;
logLatencyMean: number;
observations: number;
successes: number;
version: 1;
}>;Defined in: https://github.com/ax-llm/ax/blob/7965c876f6a5b641e0cf166e8942e540cfde65e1/src/ax/ai/balance_adaptive.ts#L36
Versioned route state used by adaptive balancing.
Successful latency is stored in log space using Welford’s online mean and M2. The balancer combines those values with a Normal-Inverse-Gamma prior at selection time.