AxInMemoryBalancerStatsStore

Defined in: https://github.com/ax-llm/ax/blob/e4219a44b7581a55a40d9dd62d2c281062ff078d/src/ax/ai/balance_adaptive.ts#L262

Browser-compatible in-memory adaptive routing store.

Implements

• AxBalancerStatsStore

Constructors

Constructor

new AxInMemoryBalancerStatsStore(): AxInMemoryBalancerStatsStore;

Returns

AxInMemoryBalancerStatsStore

Methods

get()

get(key: AxBalancerStatsKey): Promise<
  | undefined
  | Readonly<{
  failureEwma: number;
  logLatencyM2: number;
  logLatencyMean: number;
  observations: number;
  successes: number;
  version: 1;
}>>;

Defined in: https://github.com/ax-llm/ax/blob/e4219a44b7581a55a40d9dd62d2c281062ff078d/src/ax/ai/balance_adaptive.ts#L265

Read the latest route state, or return undefined for a cold route.

Parameters

Returns

Promise< | undefined | Readonly<{ failureEwma: number; logLatencyM2: number; logLatencyMean: number; observations: number; successes: number; version: 1; }>>

Implementation of

AxBalancerStatsStore.get

observe()

observe(key: AxBalancerStatsKey, observation: AxBalancerStatsObservation): Promise<void>;

Defined in: https://github.com/ax-llm/ax/blob/e4219a44b7581a55a40d9dd62d2c281062ff078d/src/ax/ai/balance_adaptive.ts#L272

Atomically reduce one observation into the state stored at key.

Parameters

Returns

Promise<void>

Implementation of

AxBalancerStatsStore.observe