Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func CalculatePriority ¶
CalculatePriority calculates job priority based on file modification time More recently modified files get higher priority
Types ¶
type JobResult ¶
type JobResult struct {
Entry types.IndexEntry
Embedding []float32 // Optional embedding for the file's summary
Error error
}
JobResult represents the result of processing a job
type Pool ¶
type Pool struct {
// contains filtered or unexported fields
}
Pool manages parallel file processing with rate limiting
func NewPool ¶
func NewPool( workers int, rateLimitPerMin int, embeddingRateLimitPerMin int, metadataExtractor *metadata.Extractor, semanticProvider semantic.Provider, providerName string, modelName string, embeddingProvider embeddings.Provider, embeddingCache *embeddings.Cache, cacheManager *cache.Manager, logger *slog.Logger, ctx context.Context, ) *Pool
NewPool creates a new worker pool
func (*Pool) SubmitBatch ¶
SubmitBatch submits multiple jobs, sorted by priority
Click to show internal directories.
Click to hide internal directories.