Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
Types ¶
type Config ¶
type Config struct {
Includes []*regexp.Regexp
Excludes []*regexp.Regexp
Concurrency int // number of concurrent downloads; default 1
MaxDepth int // download depth, 0 for unlimited
ImageQuality images.ImageQuality // image quality from 0 to 100%, 0 to disable reencoding
RequestTimeout time.Duration // overall time limit to process each http request
ConnectTimeout time.Duration // time limit for connecting to the origin server
LoopDelay time.Duration // fixed value sleep time per request
LaxAge time.Duration // added to origin server's expires timestamp
Tries int // download attempts, 0 for unlimited
Directory string
Username string
Password string
Cookies []Cookie
Header http.Header
UserAgent string
}
Config contains the scraper configuration.
func (*Config) SensibleDefaults ¶
func (c *Config) SensibleDefaults()
Click to show internal directories.
Click to hide internal directories.