AxAIWebLLM

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/webllm/api.ts#L495

Extends

AxBaseAI<AxAIWebLLMModelId, AxAIWebLLMEmbedModel, AxAIWebLLMChatRequest, AxAIWebLLMEmbedRequest, AxAIWebLLMChatResponse, AxAIWebLLMChatResponseDelta, AxAIWebLLMEmbedResponse, TModelKey>

Type Parameters

Type Parameter
`TModelKey`

Constructors

Constructor

TypeScript

new AxAIWebLLM<TModelKey>(__namedParameters: Readonly<Omit<AxAIWebLLMArgs<TModelKey>, "name">>): AxAIWebLLM<TModelKey>;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/webllm/api.ts#L505

Parameters

Parameter	Type
`__namedParameters`	`Readonly`<`Omit`<`AxAIWebLLMArgs`<`TModelKey`>, `"name"`>>

Returns

AxAIWebLLM<TModelKey>

Overrides

AxBaseAI.constructor

Accessors

debug

Get Signature

TypeScript

get debug(): boolean;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L749

Returns

boolean

Inherited from

AxBaseAI.debug

Methods

chat()

TypeScript

chat(req: Readonly<AxChatRequest<TModel | TModelKey>>, options?: Readonly<AxAIServiceOptions>): Promise<
  | AxChatResponse
| ReadableStream<AxChatResponse>>;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L1499

Parameters

Parameter	Type
`req`	`Readonly`<`AxChatRequest`<`TModel` \| `TModelKey`>>
`options?`	`Readonly`<`AxAIServiceOptions`>

Returns

Promise< | AxChatResponse | ReadableStream<AxChatResponse>>

Inherited from

AxBaseAI.chat

embed()

TypeScript

embed(req: Readonly<AxEmbedRequest<TEmbedModel>>, options?: Readonly<AxAIServiceOptions>): Promise<AxEmbedResponse>;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L2266

Parameters

Parameter	Type
`req`	`Readonly`<`AxEmbedRequest`<`TEmbedModel`>>
`options?`	`Readonly`<`AxAIServiceOptions`>

Returns

Promise<AxEmbedResponse>

Inherited from

AxBaseAI.embed

getEstimatedCost()

TypeScript

getEstimatedCost(modelUsage?: AxModelUsage): number;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L1494

Parameters

Parameter	Type
`modelUsage?`	`AxModelUsage`

Returns

number

Inherited from

AxBaseAI.getEstimatedCost

getFeatures()

TypeScript

getFeatures(model?: AxAIWebLLMModelId): AxAIFeatures;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L840

Parameters

Parameter	Type
`model?`	`AxAIWebLLMModelId`

Returns

AxAIFeatures

Inherited from

AxBaseAI.getFeatures

getId()

TypeScript

getId(): string;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L737

Returns

string

Inherited from

AxBaseAI.getId

getLastUsedChatModel()

TypeScript

getLastUsedChatModel(): undefined | AxAIWebLLMModelId;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L846

Returns

undefined | AxAIWebLLMModelId

Inherited from

AxBaseAI.getLastUsedChatModel

getLastUsedEmbedModel()

TypeScript

getLastUsedEmbedModel(): undefined;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L850

Returns

undefined

Inherited from

AxBaseAI.getLastUsedEmbedModel

getLastUsedModelConfig()

TypeScript

getLastUsedModelConfig(): undefined | AxModelConfig;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L854

Returns

undefined | AxModelConfig

Inherited from

AxBaseAI.getLastUsedModelConfig

getLogger()

TypeScript

getLogger(): AxLoggerFunction;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L794

Returns

AxLoggerFunction

Inherited from

AxBaseAI.getLogger

getMetrics()

TypeScript

getMetrics(): AxAIServiceMetrics;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L1489

Returns

AxAIServiceMetrics

Inherited from

AxBaseAI.getMetrics

getModelList()

TypeScript

getModelList(): (
  | {
  description: string;
  embedModel?: undefined;
  key: TModelKey;
  model: string;
}
  | {
  description: string;
  embedModel: string;
  key: TModelKey;
  model?: undefined;
})[];

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L809

Returns

( | { description: string; embedModel?: undefined; key: TModelKey; model: string; } | { description: string; embedModel: string; key: TModelKey; model?: undefined; })[]

Inherited from

AxBaseAI.getModelList

getName()

TypeScript

getName(): string;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L836

Returns

string

Inherited from

AxBaseAI.getName

getOptions()

TypeScript

getOptions(): Readonly<AxAIServiceOptions>;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L773

Returns

Readonly<AxAIServiceOptions>

Inherited from

AxBaseAI.getOptions

setAPIURL()

TypeScript

setAPIURL(apiURL: string): void;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L741

Parameters

Parameter	Type
`apiURL`	`string`

Returns

void

Inherited from

AxBaseAI.setAPIURL

setHeaders()

TypeScript

setHeaders(headers: () => Promise<Record<string, string>>): void;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L745

Parameters

Parameter	Type
`headers`	() => `Promise`<`Record`<`string`, `string`>>

Returns

void

Inherited from

AxBaseAI.setHeaders

setName()

TypeScript

setName(name: string): void;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L733

Parameters

Parameter	Type
`name`	`string`

Returns

void

Inherited from

AxBaseAI.setName

setOptions()

TypeScript

setOptions(options: Readonly<AxAIServiceOptions>): void;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L753

Parameters

Parameter	Type
`options`	`Readonly`<`AxAIServiceOptions`>

Returns

void

Inherited from

AxBaseAI.setOptions

speak()

TypeScript

speak(req: Readonly<AxSpeechRequest<TModel | TModelKey>>, options?: Readonly<AxAIServiceOptions>): Promise<AxChatAudioOutput>;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L877

Parameters

Parameter	Type
`req`	`Readonly`<`AxSpeechRequest`<`TModel` \| `TModelKey`>>
`options?`	`Readonly`<`AxAIServiceOptions`>

Returns

Promise<AxChatAudioOutput>

Inherited from

AxBaseAI.speak

transcribe()

TypeScript

transcribe(req: Readonly<AxTranscriptionRequest<TModel | TModelKey>>, options?: Readonly<AxAIServiceOptions>): Promise<AxTranscriptionResponse>;

Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/base.ts#L858

Parameters

Parameter	Type
`req`	`Readonly`<`AxTranscriptionRequest`<`TModel` \| `TModelKey`>>
`options?`	`Readonly`<`AxAIServiceOptions`>

Returns

Promise<AxTranscriptionResponse>

Inherited from

AxBaseAI.transcribe