Documentation
¶
Index ¶
Constants ¶
View Source
const (
DefaultJobIndex = uint64(0)
)
Variables ¶
This section is empty.
Functions ¶
Types ¶
type ChunkConsumer ¶
type ChunkConsumer struct {
// contains filtered or unexported fields
}
ChunkConsumer consumes the jobs from the job queue, and pass it to the Worker for processing. It wraps the generic job consumer in order to be used as a ReadyDoneAware on startup
func NewChunkConsumer ¶
func NewChunkConsumer( log zerolog.Logger, processedIndex storage.ConsumerProgress, chunksQueue storage.ChunksQueue, engine fetcher.AssignedChunkProcessor, maxProcessing int64, ) *ChunkConsumer
func (ChunkConsumer) Check ¶
func (c ChunkConsumer) Check()
func (*ChunkConsumer) Done ¶
func (c *ChunkConsumer) Done() <-chan struct{}
func (*ChunkConsumer) NotifyJobIsDone ¶
func (c *ChunkConsumer) NotifyJobIsDone(jobID module.JobID)
func (*ChunkConsumer) Ready ¶
func (c *ChunkConsumer) Ready() <-chan struct{}
type ChunkJob ¶
ChunkJob converts a chunk locator into a Job to be used by job queue.
func ChunkLocatorToJob ¶
type ChunkJobs ¶
type ChunkJobs struct {
// contains filtered or unexported fields
}
ChunkJobs wraps the storage layer to provide an abstraction for consumers to read jobs.
type Worker ¶
type Worker struct {
// contains filtered or unexported fields
}
Worker receives job from job consumer and converts it back to Chunk for engine to process
func NewWorker ¶
func NewWorker(engine fetcher.AssignedChunkProcessor) *Worker
func (*Worker) Notify ¶
func (w *Worker) Notify(chunkID flow.Identifier)
Source Files
Click to show internal directories.
Click to hide internal directories.