server

package

v1.0.0 Latest Latest Go to latest Published: Nov 20, 2025 License: Apache-2.0 Imports: 9 Imported by: 0

Details

This section is empty.

This section is empty.

This section is empty.

type ChatRequest struct {
	Message string `json:"message"`
	Model   string `json:"model"`
}

Add these type definitions:

type ErrorResponse struct {
	Error string `json:"error"`
}

type Server struct {
	// contains filtered or unexported fields
}

func NewServer(port string) (*Server, error)

func (s *Server) HandleChatStream(c *gin.Context)

HandleChatStream manages the WebSocket connection and Engine execution

func (s *Server) HandleListModels(c *gin.Context)

HandleListModels returns all available local models

func (s *Server) HandlePullModel(c *gin.Context)

HandlePullModel triggers a background download

func (s *Server) Start() error

func (s *Server) WsHandler(c *gin.Context)

WsHandler upgrades the HTTP connection to a WebSocket