Skip to content

AxAIHuggingFaceRequest

Type Alias: AxAIHuggingFaceRequest

AxAIHuggingFaceRequest: object

Type declaration

inputs

inputs: string

model

model: AxAIHuggingFaceModel | string

options?

optional options: object

options.use_cache?

optional use_cache: boolean

options.wait_for_model?

optional wait_for_model: boolean

parameters

parameters: object

parameters.do_sample?

optional do_sample: boolean

parameters.max_new_tokens?

optional max_new_tokens: number

parameters.max_time?

optional max_time: number

parameters.num_return_sequences?

optional num_return_sequences: number

parameters.repetition_penalty?

optional repetition_penalty: number

parameters.return_full_text?

optional return_full_text: boolean

parameters.temperature?

optional temperature: number

parameters.top_k?

optional top_k: number

parameters.top_p?

optional top_p: number

Defined in

src/ax/ai/huggingface/types.ts:16