Why Go
- Case Studies
  
  Common problems companies solve with Go
- Use Cases
  
  Stories about how and why companies use Go
- Security
  
  How Go can help keep you secure by default
Learn
Docs
- Effective Go
  
  Tips for writing clear, performant, and idiomatic Go code
- Go User Manual
  
  A complete introduction to building software with Go
- Standard library
  
  Reference documentation for Go's standard library
- Release Notes
  
  Learn what's new in each Go release
Packages
Community
- Recorded Talks
  
  Videos from prior events
- Meetups
  
  Meet other local Go developers
- Conferences
  
  Learn and network with Go developers from around the world
- Go blog
  
  The Go project's official blog.
- Go project
  
  Get help and stay informed from Go
- Get connected

fetch

package

Go to main page

Versions in this module

v0

v0.0.6

Apr 16, 2026

Changes in this version

type Config

+ Delay string

type Processor

+ OnProgress func(title, url string, completed, total, failed int32, success bool)

v0.0.5

Apr 15, 2026

v0.0.4

Apr 15, 2026

v0.0.3

Apr 15, 2026

v0.0.2

Apr 15, 2026

v0.0.1

Apr 15, 2026

Changes in this version

+ type CacheEntry struct

+ FetchedAt string

+ File string

+ Status int

+ URL string

+ type CacheManager struct

+ func NewCacheManager(outputDir string) (*CacheManager, error)

+ func (cm *CacheManager) Get(url string) (string, bool)

+ func (cm *CacheManager) GetCachePath(url string) string

+ func (cm *CacheManager) GetStats() map[string]interface{}

+ func (cm *CacheManager) Has(url string) bool

+ func (cm *CacheManager) Set(url, html string) error

+ type CacheMeta struct

+ Entries map[string]*CacheEntry

+ type CatalogConfig struct

+ Items []*CatalogItem

+ Selectors Selectors

+ Site string

+ URL string

+ type CatalogItem struct

+ Children []*CatalogItem

+ Title string

+ URL string

+ type Config struct

+ AppConfig *models.AppConfig

+ Input string

+ Output string

+ Retries int

+ Timeout int

+ Workers int

+ type FetchResult struct

+ Error error

+ OutputPath string

+ Success bool

+ Title string

+ URL string

+ WordCount int

+ type Processor struct

+ func NewProcessor(config *Config, logger *zap.Logger) (*Processor, error)

+ func (p *Processor) Execute(ctx context.Context) error

+ func (p *Processor) GetProgress() *Progress

+ type Progress struct

+ Completed int32

+ Current string

+ Failed int32

+ Total int32

+ type Selectors struct

+ Content string

+ ContentType string

+ TOC string

+ TOCType string