Documentation
¶
Index ¶
- Variables
- func CopyModel(src, dst model.Name) error
- func GetModelInfo(req api.ShowRequest) (*api.ShowResponse, error)
- func GetSHA256Digest(r io.Reader) (string, int64)
- func PruneLayers() error
- func PullModel(ctx context.Context, name string, regOpts *registryOptions, ...) error
- func PushModel(ctx context.Context, name string, regOpts *registryOptions, ...) error
- func Serve(ln net.Listener) error
- type ByDurationAndName
- type LlmRequest
- type Model
- type Scheduler
- type Server
- func (s *Server) ChatHandler(c *gin.Context)
- func (s *Server) CopyHandler(c *gin.Context)
- func (s *Server) CreateAliasHandler(c *gin.Context)
- func (s *Server) CreateBlobHandler(c *gin.Context)
- func (s *Server) CreateHandler(c *gin.Context)
- func (s *Server) DeleteAliasHandler(c *gin.Context)
- func (s *Server) DeleteHandler(c *gin.Context)
- func (s *Server) EmbedHandler(c *gin.Context)
- func (s *Server) EmbeddingsHandler(c *gin.Context)
- func (s *Server) GenerateHandler(c *gin.Context)
- func (s *Server) GenerateRoutes(rc *ollama.Registry) (http.Handler, error)
- func (s *Server) HeadBlobHandler(c *gin.Context)
- func (s *Server) ListAliasesHandler(c *gin.Context)
- func (s *Server) ListHandler(c *gin.Context)
- func (s *Server) PsHandler(c *gin.Context)
- func (s *Server) PullHandler(c *gin.Context)
- func (s *Server) PushHandler(c *gin.Context)
- func (s *Server) ShowHandler(c *gin.Context)
- func (s *Server) SignoutHandler(c *gin.Context)
- func (s *Server) StatusHandler(c *gin.Context)
- func (s *Server) WhoamiHandler(c *gin.Context)
Constants ¶
This section is empty.
Variables ¶
View Source
var ErrMaxQueue = errors.New("server busy, please try again. maximum pending requests exceeded")
Functions ¶
func GetModelInfo ¶
func GetModelInfo(req api.ShowRequest) (*api.ShowResponse, error)
func GetSHA256Digest ¶
GetSHA256Digest returns the SHA256 hash of a given buffer and returns it, and the size of buffer
func PruneLayers ¶
func PruneLayers() error
Types ¶
type ByDurationAndName ¶ added in v0.6.6
type ByDurationAndName []*runnerRef
func (ByDurationAndName) Len ¶ added in v0.6.6
func (a ByDurationAndName) Len() int
func (ByDurationAndName) Less ¶ added in v0.6.6
func (a ByDurationAndName) Less(i, j int) bool
func (ByDurationAndName) Swap ¶ added in v0.6.6
func (a ByDurationAndName) Swap(i, j int)
type LlmRequest ¶ added in v0.1.33
type LlmRequest struct {
// contains filtered or unexported fields
}
type Model ¶
type Model struct {
Name string `json:"name"`
Config model.ConfigV2
ShortName string
ModelPath string
ParentModel string
AdapterPaths []string
ProjectorPaths []string
System string
License []string
Digest string
Options map[string]any
Messages []api.Message
Template *template.Template
}
func (*Model) Capabilities ¶ added in v0.6.4
func (m *Model) Capabilities() []model.Capability
Capabilities returns the capabilities that the model supports
func (*Model) CheckCapabilities ¶ added in v0.2.2
func (m *Model) CheckCapabilities(want ...model.Capability) error
CheckCapabilities checks if the model has the specified capabilities returning an error describing any missing or unknown capabilities
type Scheduler ¶ added in v0.1.33
type Scheduler struct {
// contains filtered or unexported fields
}
func InitScheduler ¶ added in v0.1.33
type Server ¶
type Server struct {
// contains filtered or unexported fields
}
func (*Server) ChatHandler ¶ added in v0.1.33
func (*Server) CopyHandler ¶ added in v0.3.8
func (*Server) CreateAliasHandler ¶ added in v0.15.5
func (*Server) CreateBlobHandler ¶ added in v0.1.33
func (*Server) CreateHandler ¶ added in v0.3.8
func (*Server) DeleteAliasHandler ¶ added in v0.15.5
func (*Server) DeleteHandler ¶ added in v0.3.8
func (*Server) EmbedHandler ¶ added in v0.2.6
func (*Server) EmbeddingsHandler ¶ added in v0.1.33
func (*Server) GenerateHandler ¶ added in v0.1.33
func (*Server) GenerateRoutes ¶
func (*Server) HeadBlobHandler ¶ added in v0.1.33
func (*Server) ListAliasesHandler ¶ added in v0.15.5
func (*Server) ListHandler ¶ added in v0.3.8
func (*Server) PullHandler ¶ added in v0.3.8
func (*Server) PushHandler ¶ added in v0.3.8
func (*Server) ShowHandler ¶ added in v0.3.8
func (*Server) SignoutHandler ¶ added in v0.12.0
func (*Server) StatusHandler ¶ added in v0.16.2
func (*Server) WhoamiHandler ¶ added in v0.12.0
Source Files
¶
Directories
¶
| Path | Synopsis |
|---|---|
|
internal
|
|
|
cache/blob
Package blob implements a content-addressable disk cache for blobs and manifests.
|
Package blob implements a content-addressable disk cache for blobs and manifests. |
|
client/ollama
Package ollama provides a client for interacting with an Ollama registry which pushes and pulls model manifests and layers as defined by the ollama.com/manifest.
|
Package ollama provides a client for interacting with an Ollama registry which pushes and pulls model manifests and layers as defined by the ollama.com/manifest. |
|
internal/stringsx
Package stringsx provides additional string manipulation functions that aren't in the standard library's strings package or go4.org/mem.
|
Package stringsx provides additional string manipulation functions that aren't in the standard library's strings package or go4.org/mem. |
|
internal/syncs
Package syncs provides synchronization primitives.
|
Package syncs provides synchronization primitives. |
|
manifest
Package manifest provides documentation for the Ollama manifest format.
|
Package manifest provides documentation for the Ollama manifest format. |
|
registry
Package registry implements an http.Handler for handling local Ollama API model management requests.
|
Package registry implements an http.Handler for handling local Ollama API model management requests. |
Click to show internal directories.
Click to hide internal directories.