vllm

package
v1.0.18 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Apr 28, 2026 License: MIT Imports: 3 Imported by: 1

Documentation

Index

Constants

View Source
const Provider = "vLLM"

Variables

View Source
var EmbedModel_qwen_3_4b = embed.Model{
	Provider:         Provider,
	Name:             "Qwen/Qwen3-Embedding-4B",
	InputMaxTokens:   32_768,
	OutputDimensions: 2560,
}
View Source
var EmbedModel_qwen_3_8b = embed.Model{
	Provider:         Provider,
	Name:             "Qwen/Qwen3-Embedding-8B",
	InputMaxTokens:   32_768,
	OutputDimensions: 4096,
}
View Source
var GenModel_gemma_4_e4b_it = gen.Model{
	Provider: Provider,
	Name:     "google/gemma-4-E4B-it",
}
View Source
var GenModel_gpt_oss_20b = gen.Model{
	Provider: Provider,
	Name:     "openai/gpt-oss-20b",
}

Functions

func New

func New(uris []string, models []string) *openai.OpenAI

Types

This section is empty.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL