Documentation
¶
Overview ¶
Package httpx provides shared, tuned HTTP clients for ketch.
The default transport is configured for crawling a single host at non-trivial concurrency: MaxIdleConnsPerHost is high enough to avoid per-request TLS handshakes, and every client carries a request-level Timeout so a hung peer cannot stall a worker forever.
Index ¶
Constants ¶
View Source
const DefaultMaxIdleConnsPerHost = 16
DefaultMaxIdleConnsPerHost keeps enough keep-alive connections around to serve a typical crawl concurrency without re-handshaking.
View Source
const DefaultTimeout = 30 * time.Second
DefaultTimeout is the per-request timeout for ketch HTTP clients.
Variables ¶
This section is empty.
Functions ¶
Types ¶
This section is empty.
Click to show internal directories.
Click to hide internal directories.