AxAIWebLLMModel
Defined in: https://github.com/ax-llm/ax/blob/3306475085414d36aee4411ad2466e08e53bef8a/src/ax/ai/webllm/types.ts#L7
WebLLM: Models for text generation
Based on WebLLM’s supported models
Enumeration Members
| Enumeration Member | Value |
|---|
Gemma2_2B_Instruct | "gemma-2-2b-it-q4f32_1-MLC" |
Gemma2_9B_Instruct | "gemma-2-9b-it-q4f32_1-MLC" |
Llama31_70B_Instruct | "Llama-3.1-70B-Instruct-q4f16_1-MLC" |
Llama31_8B_Instruct | "Llama-3.1-8B-Instruct-q4f32_1-MLC" |
Llama32_1B_Instruct | "Llama-3.2-1B-Instruct-q4f32_1-MLC" |
Llama32_3B_Instruct | "Llama-3.2-3B-Instruct-q4f32_1-MLC" |
Mistral7B_Instruct | "Mistral-7B-Instruct-v0.3-q4f32_1-MLC" |
Phi35_Mini_Instruct | "Phi-3.5-mini-instruct-q4f32_1-MLC" |
Qwen2_5_0_5B_Instruct | "Qwen2.5-0.5B-Instruct-q4f32_1-MLC" |
Qwen2_5_1_5B_Instruct | "Qwen2.5-1.5B-Instruct-q4f32_1-MLC" |
Qwen2_5_3B_Instruct | "Qwen2.5-3B-Instruct-q4f32_1-MLC" |
Qwen2_5_7B_Instruct | "Qwen2.5-7B-Instruct-q4f32_1-MLC" |