Documentation
¶
Index ¶
- type Scraper
- func (s *Scraper) GetURL(id string) (string, error)
- func (s *Scraper) IsEnabled() bool
- func (s *Scraper) Name() string
- func (s *Scraper) ResolveDownloadProxyForHost(host string) (*config.ProxyConfig, *config.ProxyConfig, bool)
- func (s *Scraper) ResolveSearchQuery(input string) (string, bool)
- func (s *Scraper) Search(id string) (*models.ScraperResult, error)
Examples ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Scraper ¶
type Scraper struct {
// contains filtered or unexported fields
}
Scraper implements the MGStage scraper
func New ¶
New creates a new MGStage scraper
Example ¶
ExampleNew demonstrates basic usage
cfg := config.DefaultConfig()
cfg.Scrapers.MGStage.Enabled = true
scraper := New(cfg)
if scraper.IsEnabled() {
// Use the scraper
fmt.Println("MGStage scraper is enabled")
}
func (*Scraper) ResolveDownloadProxyForHost ¶
func (s *Scraper) ResolveDownloadProxyForHost(host string) (*config.ProxyConfig, *config.ProxyConfig, bool)
ResolveDownloadProxyForHost declares MGStage-owned media hosts for downloader proxy routing.
func (*Scraper) ResolveSearchQuery ¶
ResolveSearchQuery normalizes MGStage-specific IDs from free-form input. This is primarily used by batch scraping to preserve 3-digit numeric prefixes (e.g., "259LUXU-1806"), which generic filename matching can strip to "LUXU-1806".
Source Files
Click to show internal directories.
Click to hide internal directories.