engine

package

v1.4.0 Latest Latest Go to latest Published: Jan 6, 2026 License: MIT Imports: 0 Imported by: 1

Details

This section is empty.

This section is empty.

This section is empty.

type Engine interface {
	Crawl(string) error
	Close() error
}

Path	Synopsis
common
headless
browser
browser/cookie Package cookie implements cookie consent handling for the crawler.	Package cookie implements cookie consent handling for the crawler.
browser/stealth from stealth go-rod	from stealth go-rod
crawler
crawler/diagnostics
crawler/normalizer
crawler/normalizer/simhash Package simhash implements SimHash algorithm for near-duplicate detection.	Package simhash implements SimHash algorithm for near-duplicate detection.
graph Package graph implements a Directed Graph for storing state information during crawling of a Web Application.	Package graph implements a Directed Graph for storing state information during crawling of a Web Application.
js
types
hybrid Package hybrid implements the functionality for a hybrid-headless crawler.	Package hybrid implements the functionality for a hybrid-headless crawler.
parser
files
standard Package standard implements the functionality for a non-headless crawler.	Package standard implements the functionality for a non-headless crawler.