Build LLM-powered agents
with production-ready TypeScript

DSPy for TypeScript. Working with LLMs is complex—they don't always do what you want. DSPy makes it easier to build amazing things with LLMs. Just define your inputs and outputs (signature) and an efficient prompt is auto-generated and used. Connect together various signatures to build complex systems and workflows using LLMs.

15+ LLM Providers

End-to-end Streaming

Auto Prompt Tuning

AxRateLimiterTokenUsage

Defined in: https://github.com/ax-llm/ax/blob/a8847bd2906efff202fde10d776fddd20fd2ff57/src/ax/util/rate-limit.ts#L9

Constructors

Constructor

new AxRateLimiterTokenUsage(
   maxTokens: number, 
   refillRate: number, 
   options?: Readonly<AxRateLimiterTokenUsageOptions>): AxRateLimiterTokenUsage;

Defined in: https://github.com/ax-llm/ax/blob/a8847bd2906efff202fde10d776fddd20fd2ff57/src/ax/util/rate-limit.ts#L16

Parameters

Parameter	Type
`maxTokens`	`number`
`refillRate`	`number`
`options?`	`Readonly`<`AxRateLimiterTokenUsageOptions`>

Returns

AxRateLimiterTokenUsage

Methods

acquire()

acquire(tokens: number): Promise<void>;

Defined in: https://github.com/ax-llm/ax/blob/a8847bd2906efff202fde10d776fddd20fd2ff57/src/ax/util/rate-limit.ts#L56

Parameters

Parameter	Type
`tokens`	`number`

Returns

Promise<void>