Documentation
¶
Overview ¶
Scrape Target 2: Google Maps — "villa di bali"
Google Maps is JS-rendered; a static HTTP fetch returns either the pre-render skeleton or a consent/redirect page rather than populated place cards.
Strategy:
- Primary attempt: Google local-results search page with tbm=lcl, which is more static-friendly than the full Maps SPA and often contains structured JSON-LD or visible place data.
- Secondary attempt: a plain web search with "villa di bali" site:maps.google is tried when the local results page yields nothing — this is used only to measure block rates, not to parse real place data.
Both attempts are benchmarked together. Each request is tracked individually so the block avoidance metric is meaningful.
Run:
go run ./tests/scrape_targets/google_maps/
Click to show internal directories.
Click to hide internal directories.