worker

package
v0.5.0-alpha.7 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Nov 2, 2025 License: Apache-2.0 Imports: 42 Imported by: 0

Documentation

Index

Constants

View Source 
const (
	LabelStep = "step"
	LabelData = "data"
)

Variables

View Source 
var (
	UpdateUserRecommendTotal = promauto.NewGauge(prometheus.GaugeOpts{
		Namespace: "gorse",
		Subsystem: "worker",
		Name:      "update_user_recommend_total",
	})
	OfflineRecommendStepSecondsVec = promauto.NewGaugeVec(prometheus.GaugeOpts{
		Namespace: "gorse",
		Subsystem: "worker",
		Name:      "offline_recommend_step_seconds",
	}, []string{LabelStep})
	OfflineRecommendTotalSeconds = promauto.NewGauge(prometheus.GaugeOpts{
		Namespace: "gorse",
		Subsystem: "worker",
		Name:      "offline_recommend_total_seconds",
	})
	CollaborativeFilteringIndexRecall = promauto.NewGauge(prometheus.GaugeOpts{
		Namespace: "gorse",
		Subsystem: "worker",
		Name:      "collaborative_filtering_index_recall",
	})
	MemoryInuseBytesVec = promauto.NewGaugeVec(prometheus.GaugeOpts{
		Namespace: "gorse",
		Subsystem: "worker",
		Name:      "memory_inuse_bytes",
	}, []string{LabelData})
)

Functions

This section is empty.

Types

type FeedbackCache 

type FeedbackCache struct {
	*config.Config
	Client data.Database
	Types  []expression.FeedbackTypeExpression
	Cache  cmap.ConcurrentMap
}

FeedbackCache is the cache for user feedbacks.

func NewFeedbackCache 

func NewFeedbackCache(worker *Worker, feedbackTypes ...expression.FeedbackTypeExpression) *FeedbackCache

NewFeedbackCache creates a new FeedbackCache.

func (*FeedbackCache) GetUserFeedback 

func (c *FeedbackCache) GetUserFeedback(ctx context.Context, userId string) ([]string, error)

GetUserFeedback gets user feedback from cache or database.

type HealthStatus 

type HealthStatus struct {
	DataStoreError      error
	CacheStoreError     error
	DataStoreConnected  bool
	CacheStoreConnected bool
}

type ItemCache 

type ItemCache struct {
	Data map[string]*data.Item
}

ItemCache is alias of map[string]data.Item.

func NewItemCache 

func NewItemCache() *ItemCache

func (*ItemCache) Get 

func (c *ItemCache) Get(itemId string) (*data.Item, bool)

func (*ItemCache) GetCategory 

func (c *ItemCache) GetCategory(itemId string) []string

func (*ItemCache) IsAvailable 

func (c *ItemCache) IsAvailable(itemId string) bool

IsAvailable means the item exists in database and is not hidden.

func (*ItemCache) Len 

func (c *ItemCache) Len() int

func (*ItemCache) Set 

func (c *ItemCache) Set(itemId string, item data.Item)

type ScheduleState 

type ScheduleState struct {
	IsRunning bool      `json:"is_running"`
	StartTime time.Time `json:"start_time"`
}

type Worker 

type Worker struct {
	*config.Settings
	// contains filtered or unexported fields
}

Worker manages states of a worker node.

func NewWorker 

func NewWorker(
	masterHost string,
	masterPort int,
	httpHost string,
	httpPort int,
	jobs int,
	cacheFile string,
	tlsConfig *util.TLSConfig,
) *Worker

NewWorker creates a new worker node.

func (*Worker) Pull 

func (w *Worker) Pull()

Pull user index and ranking model from master.

func (*Worker) Recommend 

func (w *Worker) Recommend(users []data.User)

Recommend items to users. The workflow of recommendation is: 1. Skip inactive users. 2. Load historical items. 3. Load positive items if KNN used. 4. Generate recommendation. 5. Save result. 6. Insert cold-start items into results. 7. Rank items in results by click-through-rate. 8. Refresh cache.

func (*Worker) ScheduleAPIHandler 

func (w *Worker) ScheduleAPIHandler(writer http.ResponseWriter, request *http.Request)

func (*Worker) Serve 

func (w *Worker) Serve()

Serve as a worker node.

func (*Worker) ServeHTTP 

func (w *Worker) ServeHTTP()

ServeHTTP serves Prometheus metrics and API.

func (*Worker) SetOneMode 

func (w *Worker) SetOneMode(settings *config.Settings)

func (*Worker) Sync 

func (w *Worker) Sync()

Sync this worker to the master.

func (*Worker) WorkerName 

func (w *Worker) WorkerName() (string, error)

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.