scheduler

package
v0.1.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Nov 5, 2018 License: MIT Imports: 2 Imported by: 2

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type AddTaskOptions

type AddTaskOptions = taskqueue.EnqueueOptions

AddTaskOptions = taskqueue.EnqueueOptions

type Mode

type Mode int

Mode 代表调度器的模式

const (
	// ModeCollector 爬虫将会在达成目标 (没有更多任务) 时退出
	ModeCollector Mode = iota
	// ModeMonitor 爬虫在没有任务后会持续等待
	ModeMonitor
)

type Scheduler

type Scheduler interface {
	SetTaskHandler(handler TaskHandler)
	// TODO: SetGivenUpHandler
	SetLogger(logger logger.Logger)
	SetMode(mode Mode)

	RegisterTaskType(dummyTask interface{}) (err error)

	AddTask(task interface{}, opts AddTaskOptions) (err error)

	Run()
	WaitQuit() (errs []error)
}

Scheduler 代表爬虫的调度器

type TaskHandler

type TaskHandler func(interface{}) taskqueue.ProcessResult

TaskHandler 是任务的 handler

Directories

Path Synopsis

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL