server

package

v0.0.4 Latest Latest Go to latest Published: Dec 19, 2024 License: Apache-2.0 Imports: 11 Imported by: 0

Details

This section is empty.

This section is empty.

This section is empty.

type CompletionHandler struct {
	// contains filtered or unexported fields
}

CompletionHandler handles completion requests

func NewCompletionHandler(llm gollm.LLM) *CompletionHandler

NewCompletionHandler creates a new completion handler

func (h *CompletionHandler) ServeHTTP(w http.ResponseWriter, r *http.Request)

ServeHTTP implements http.Handler

type CompletionRequest struct {
	Prompt string `json:"prompt"`
}

CompletionRequest represents an incoming completion request

type CompletionResponse struct {
	Completion string `json:"completion"`
}

CompletionResponse represents the response to a completion request

type Router struct {
	// contains filtered or unexported fields
}

Router handles HTTP routing

func NewRouter(completion http.Handler) *Router

NewRouter creates a new router

func (r *Router) ServeHTTP(w http.ResponseWriter, req *http.Request)

ServeHTTP implements http.Handler

type Server struct {
	// contains filtered or unexported fields
}

Server represents the HTTP server

func NewServer(cfg config.ServerConfig, handler http.Handler) *Server

NewServer creates a new server instance

func (s *Server) Start(ctx context.Context) error

Start starts the server and blocks until shutdown

Path	Synopsis
middleware