httptransport

package

v0.14.0 Latest Latest Go to latest Published: Apr 28, 2026 License: MIT Imports: 10 Imported by: 0

Details

Package httptransport provides reusable HTTP client transport helpers for proxy-aware scraping runtimes.

View Source

const DefaultTimeout = 15 * time.Second

DefaultTimeout is used when a client timeout is not explicitly provided.

This section is empty.

func IsSOCKSProxy(rawProxyURL string) bool

IsSOCKSProxy reports whether a proxy URL uses a supported SOCKS scheme.

func NewClient(httpProfile Profile, timeout time.Duration) (*http.Client, error)

NewClient builds an HTTP client bound to one transport profile.

func TimeoutOrDefault(timeout time.Duration) time.Duration

TimeoutOrDefault returns DefaultTimeout when timeout is not positive.

type Profile struct {
	ID               string
	Provider         string
	URL              string
	IgnoreCertErrors bool
}

Profile describes how to build an HTTP client transport.

func InferProfile(rawProxyURL string, ignoreCertErrors bool) (Profile, error)

InferProfile derives an HTTP transport profile from a raw proxy URL.

func NormalizeProfile(httpProfile Profile) (Profile, error)

NormalizeProfile trims and validates a profile before it is used to build a client.