dlgetchu

package

v0.2.8-alpha Latest Latest Go to latest Published: Apr 19, 2026 License: MIT Imports: 18 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/javinizer/javinizer-go

Links

Open Source Insights

Documentation ¶

Index ¶

func NewHTTPClient(cfg *config.ScraperSettings, globalProxy *config.ProxyConfig, ...) (*resty.Client, error)
type DLGetchuConfig
type Scraper
- func New(settings config.ScraperSettings, globalProxy *config.ProxyConfig, ...) *Scraper

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func NewHTTPClient ¶

func NewHTTPClient(cfg *config.ScraperSettings, globalProxy *config.ProxyConfig, globalFlareSolverr config.FlareSolverrConfig) (*resty.Client, error)

NewHTTPClient creates a new HTTP client for the DLgetchu scraper. HTTP-01: Per-scraper HTTP client ownership.

Types ¶

type DLGetchuConfig ¶

type DLGetchuConfig struct {
	Enabled       bool                      `yaml:"enabled" json:"enabled"`
	RequestDelay  int                       `yaml:"request_delay" json:"request_delay"`
	MaxRetries    int                       `yaml:"max_retries" json:"max_retries"`
	BaseURL       string                    `yaml:"base_url" json:"base_url"`
	UserAgent     string                    `yaml:"user_agent" json:"user_agent"`
	Proxy         *config.ProxyConfig       `yaml:"proxy,omitempty" json:"proxy,omitempty"`
	DownloadProxy *config.ProxyConfig       `yaml:"download_proxy,omitempty" json:"download_proxy,omitempty"`
	Priority      int                       `yaml:"priority" json:"priority"` // Scraper's priority (higher = higher priority)
	FlareSolverr  config.FlareSolverrConfig `yaml:"flaresolverr" json:"flaresolverr"`
}

Config holds DLgetchu scraper configuration. YAML tags are defined here for unmarshaling via config.ScrapersConfig.

func (*DLGetchuConfig) GetDownloadProxy ¶

func (c *DLGetchuConfig) GetDownloadProxy() any

GetDownloadProxy implements scraperutil.ScraperConfigInterface.

func (*DLGetchuConfig) GetMaxRetries ¶

func (c *DLGetchuConfig) GetMaxRetries() int

GetMaxRetries implements scraperutil.ScraperConfigInterface.

func (*DLGetchuConfig) GetProxy ¶

func (c *DLGetchuConfig) GetProxy() any

GetProxy implements scraperutil.ScraperConfigInterface.

func (*DLGetchuConfig) GetRequestDelay ¶

func (c *DLGetchuConfig) GetRequestDelay() int

GetRequestDelay implements scraperutil.ScraperConfigInterface.

func (*DLGetchuConfig) GetUserAgent ¶

func (c *DLGetchuConfig) GetUserAgent() string

GetUserAgent implements scraperutil.ScraperConfigInterface.

func (*DLGetchuConfig) IsEnabled ¶

func (c *DLGetchuConfig) IsEnabled() bool

IsEnabled implements scraperutil.ScraperConfigInterface.

func (*DLGetchuConfig) ValidateConfig ¶

func (c *DLGetchuConfig) ValidateConfig(sc *config.ScraperSettings) error

ValidateConfig implements config.ConfigValidator for DLGetchuConfig.

type Scraper ¶

type Scraper struct {
	// contains filtered or unexported fields
}

Scraper implements the DLgetchu scraper.

func New ¶

func New(settings config.ScraperSettings, globalProxy *config.ProxyConfig, globalFlareSolverr config.FlareSolverrConfig) *Scraper

New creates a new DLgetchu scraper.

func (*Scraper) CanHandleURL ¶

func (s *Scraper) CanHandleURL(rawURL string) bool

GetURL resolves detail URL for an ID.

func (*Scraper) Close ¶

func (s *Scraper) Close() error

Close cleans up resources held by the scraper

func (*Scraper) Config ¶

func (s *Scraper) Config() *config.ScraperSettings

Config returns the scraper's configuration

func (*Scraper) ExtractIDFromURL ¶

func (s *Scraper) ExtractIDFromURL(urlStr string) (string, error)

func (*Scraper) GetURL ¶

func (s *Scraper) GetURL(id string) (string, error)

func (*Scraper) IsEnabled ¶

func (s *Scraper) IsEnabled() bool

IsEnabled returns whether scraper is enabled.

func (*Scraper) Name ¶

func (s *Scraper) Name() string

Name returns scraper identifier.

func (*Scraper) ResolveDownloadProxyForHost ¶

func (s *Scraper) ResolveDownloadProxyForHost(host string) (*config.ProxyConfig, *config.ProxyConfig, bool)

ResolveDownloadProxyForHost declares DLgetchu-owned media hosts for downloader proxy routing.

func (*Scraper) ScrapeURL ¶

func (s *Scraper) ScrapeURL(ctx context.Context, rawURL string) (*models.ScraperResult, error)

func (*Scraper) Search ¶

func (s *Scraper) Search(ctx context.Context, id string) (*models.ScraperResult, error)

Search scrapes metadata from DLgetchu.

func (*Scraper) ValidateConfig ¶

func (s *Scraper) ValidateConfig(cfg *config.ScraperSettings) error

ValidateConfig validates the scraper configuration. Returns error if config is invalid, nil if valid.

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL