fc2

package

v0.2.5-alpha Latest Latest Go to latest Published: Apr 15, 2026 License: MIT Imports: 19 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/javinizer/javinizer-go

Links

Open Source Insights

Documentation ¶

Index ¶

func NewHTTPClient(cfg *config.ScraperSettings, globalProxy *config.ProxyConfig, ...) (*resty.Client, error)
type FC2Config
type Scraper
- func New(settings config.ScraperSettings, globalProxy *config.ProxyConfig, ...) *Scraper

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func NewHTTPClient ¶

func NewHTTPClient(cfg *config.ScraperSettings, globalProxy *config.ProxyConfig, globalFlareSolverr config.FlareSolverrConfig) (*resty.Client, error)

NewHTTPClient creates a new HTTP client for the FC2 scraper. HTTP-01: Per-scraper HTTP client ownership.

Types ¶

type FC2Config ¶

type FC2Config struct {
	Enabled       bool                      `yaml:"enabled" json:"enabled"`
	RequestDelay  int                       `yaml:"request_delay" json:"request_delay"`
	MaxRetries    int                       `yaml:"max_retries" json:"max_retries"`
	BaseURL       string                    `yaml:"base_url" json:"base_url"`
	UserAgent     string                    `yaml:"user_agent" json:"user_agent"`
	Proxy         *config.ProxyConfig       `yaml:"proxy,omitempty" json:"proxy,omitempty"`
	DownloadProxy *config.ProxyConfig       `yaml:"download_proxy,omitempty" json:"download_proxy,omitempty"`
	Priority      int                       `yaml:"priority" json:"priority"` // Scraper's priority (higher = higher priority)
	FlareSolverr  config.FlareSolverrConfig `yaml:"flaresolverr" json:"flaresolverr"`
}

Config holds FC2 scraper configuration. YAML tags are defined here for unmarshaling via config.ScrapersConfig.

func (*FC2Config) GetDownloadProxy ¶

func (c *FC2Config) GetDownloadProxy() any

GetDownloadProxy implements scraperutil.ScraperConfigInterface.

func (*FC2Config) GetMaxRetries ¶

func (c *FC2Config) GetMaxRetries() int

GetMaxRetries implements scraperutil.ScraperConfigInterface.

func (*FC2Config) GetProxy ¶

func (c *FC2Config) GetProxy() any

GetProxy implements scraperutil.ScraperConfigInterface.

func (*FC2Config) GetRequestDelay ¶

func (c *FC2Config) GetRequestDelay() int

GetRequestDelay implements scraperutil.ScraperConfigInterface.

func (*FC2Config) GetUserAgent ¶

func (c *FC2Config) GetUserAgent() string

GetUserAgent implements scraperutil.ScraperConfigInterface.

func (*FC2Config) IsEnabled ¶

func (c *FC2Config) IsEnabled() bool

IsEnabled implements scraperutil.ScraperConfigInterface.

func (*FC2Config) ValidateConfig ¶

func (c *FC2Config) ValidateConfig(sc *config.ScraperSettings) error

ValidateConfig implements config.ConfigValidator for FC2Config.

type Scraper ¶

type Scraper struct {
	// contains filtered or unexported fields
}

Scraper implements the FC2 scraper.

func New ¶

func New(settings config.ScraperSettings, globalProxy *config.ProxyConfig, globalFlareSolverr config.FlareSolverrConfig) *Scraper

New creates a new FC2 scraper.

func (*Scraper) CanHandleURL ¶

func (s *Scraper) CanHandleURL(rawURL string) bool

ResolveSearchQuery normalizes FC2/PPV identifiers from free-form input.

func (*Scraper) Close ¶

func (s *Scraper) Close() error

Close cleans up resources held by the scraper

func (*Scraper) Config ¶

func (s *Scraper) Config() *config.ScraperSettings

Config returns the scraper's configuration

func (*Scraper) ExtractIDFromURL ¶

func (s *Scraper) ExtractIDFromURL(urlStr string) (string, error)

func (*Scraper) GetURL ¶

func (s *Scraper) GetURL(id string) (string, error)

GetURL resolves the FC2 detail URL for an ID.

func (*Scraper) IsEnabled ¶

func (s *Scraper) IsEnabled() bool

IsEnabled returns whether scraper is enabled.

func (*Scraper) Name ¶

func (s *Scraper) Name() string

Name returns the scraper identifier.

func (*Scraper) ResolveDownloadProxyForHost ¶

func (s *Scraper) ResolveDownloadProxyForHost(host string) (*config.ProxyConfig, *config.ProxyConfig, bool)

ResolveDownloadProxyForHost declares FC2-owned media hosts for downloader proxy routing.

func (*Scraper) ResolveSearchQuery ¶

func (s *Scraper) ResolveSearchQuery(input string) (string, bool)

func (*Scraper) ScrapeURL ¶

func (s *Scraper) ScrapeURL(rawURL string) (*models.ScraperResult, error)

func (*Scraper) Search ¶

func (s *Scraper) Search(id string) (*models.ScraperResult, error)

Search scrapes metadata for a given FC2 ID.

func (*Scraper) ValidateConfig ¶

func (s *Scraper) ValidateConfig(cfg *config.ScraperSettings) error

ValidateConfig validates the scraper configuration. Returns error if config is invalid, nil if valid.

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL