AxAIWebLLMChatResponseDelta Generated TypeScript API reference. typescript api api/reference build/apidocs/TypeAlias.AxAIWebLLMChatResponseDelta.md type AxAIWebLLMChatResponseDelta

AxAIWebLLMChatResponseDelta

TypeScript

type AxAIWebLLMChatResponseDelta = object;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/webllm/types.ts#L169

WebLLM: Streaming chat response structure

Properties

choices

TypeScript

choices: object[];

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/webllm/types.ts#L174

delta

TypeScript

{
  content?: string;
  role?: "assistant";
  tool_calls?: object[];
}

finish_reason?

TypeScript

optional finish_reason: "stop" | "length" | "tool_calls" | "content_filter";

index

TypeScript

index: number;

logprobs?

TypeScript

{
  content: object[];
}

created

TypeScript

created: number;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/webllm/types.ts#L172

id

TypeScript

id: string;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/webllm/types.ts#L170

model

TypeScript

model: AxAIWebLLMModelId;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/webllm/types.ts#L173

object

TypeScript

object: "chat.completion.chunk";

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/webllm/types.ts#L171

usage?

TypeScript

optional usage: object;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/webllm/types.ts#L203

completion_tokens

TypeScript

completion_tokens: number;

prompt_tokens

TypeScript

prompt_tokens: number;

total_tokens

TypeScript

total_tokens: number;

Docs