Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type TaskConfig ¶
type TaskConfig struct {
MaxGoRoutine int `config:"max_go_routine"`
//Fetch Speed Control
FetchThresholdInMs int `config:"fetch_threshold_ms"`
DefaultPipelineConfig *pipeline.PipelineConfig `config:"default_pipeline_config"`
}
TaskConfig defines crawler related configs
Click to show internal directories.
Click to hide internal directories.