Help us shape the future of Go! Take the 2026 Go Developer Survey

command

package
v0.1.2 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Feb 10, 2026 License: Apache-2.0 Imports: 0 Imported by: 0

Documentation

Index

Constants

View Source
const (
	// CONFIG is the command to set the configuration of the model, which is used for
	// the model to be served, such as the config.json, generation_config.json, etc.
	// The CONFIG command can be used multiple times in a modelfile, it
	// will be copied the config file to the artifact package as a layer.
	CONFIG = "CONFIG"

	// MODEL is the command to set the model file path. The value of this command
	// is the glob of the model file path to match the model file name.
	// The MODEL command can be used multiple times in a modelfile, it will scan
	// the model file path by the glob and copy each model file to the artifact
	// package, and each model file will be a layer.
	MODEL = "MODEL"

	// CODE is the command to set the code file path. The value of this commands
	// is the glob of the code file path to match the code file name.
	// The CODE command can be used multiple times in a modelfile, it will scan
	// the code file path by the glob and copy each code file to the artifact
	// package, and each code file will be a layer.
	CODE = "CODE"

	// DATASET is the command to set the dataset file path. The value of this commands
	// is the glob of the dataset file path to match the dataset file name.
	// The DATASET command can be used multiple times in a modelfile, it will scan
	// the dataset file path by the glob and copy each dataset file to the artifact
	// package, and each dataset file will be a layer.
	DATASET = "DATASET"

	// DOC is the command to set the documentation file path. The value of this commands
	// is the glob of the documentation file path to match the documentation file name.
	// The DOC command can be used multiple times in a modelfile, it will scan
	// the documentation file path by the glob and copy each documentation file to the artifact
	// package, and each documentation file will be a layer.
	DOC = "DOC"

	// NAME is the command to set the model name, such as llama3-8b-instruct, gpt2-xl,
	// qwen2-vl-72b-instruct, etc.
	NAME = "NAME"

	// ARCH is the command to set the architecture of the model, such as transformer,
	// cnn, rnn, etc.
	ARCH = "ARCH"

	// FAMILY is the command to set the family of the model, such as llama3, gpt2, qwen2, etc.
	FAMILY = "FAMILY"

	// FORMAT is the command to set the format of the model, such as onnx, tensorflow, pytorch, etc.
	FORMAT = "FORMAT"

	// PARAMSIZE is the command to set the parameter size of the model.
	PARAMSIZE = "PARAMSIZE"

	// PRECISION is the command to set the precision of the model, such as bf16, fp16, int8, etc.
	PRECISION = "PRECISION"

	// QUANTIZATION is the command to set the quantization of the model, such as awq, gptq, etc.
	QUANTIZATION = "QUANTIZATION"
)

Define the command strings for modelfile.

Variables

Commands is a list of all the commands that can be used in a modelfile.

Functions

This section is empty.

Types

This section is empty.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL