loader

package

v0.9.0 Latest Latest Go to latest Published: Apr 22, 2024 License: Apache-2.0 Imports: 13 Imported by: 0

Details

This section is empty.

This section is empty.

This section is empty.

type HuggingFaceDownloader struct {
	// contains filtered or unexported fields
}

HuggingFaceDownloader downloads models from Hugging Face.

func NewHuggingFaceDownloader(cacheDir string) *HuggingFaceDownloader

NewHuggingFaceDownloader creates a new HuggingFaceDownloader.

type L struct {
	// contains filtered or unexported fields
}

L is a loader.

func New(
	store *store.S,
	baseModels []string,
	objectStorPathPrefix string,
	modelDownloader ModelDownloader,
	s3Client S3Client,
) *L

New creates a new loader.

func (l *L) LoadBaseModels(ctx context.Context) error

LoadBaseModels loads the base models.

func (l *L) Run(ctx context.Context, interval time.Duration) error

Run runs the loader.

type ModelDownloader interface {
	// contains filtered or unexported methods
}

ModelDownloader is an interface for downloading a model.

type NoopModelDownloader struct {
}

NoopModelDownloader is a no-op model downloader.

type NoopS3Client struct {
}

NoopS3Client is a no-op S3 client.

func (c *NoopS3Client) Upload(r io.Reader, key string) error

Upload uploads a file to S3.

type S3Client interface {
	Upload(r io.Reader, key string) error
}

S3Client is an interface for uploading a file to S3.