Crawler_USP

Crawler_USP

Project for crawlling data of all papers produce in USP university regarding LAW:

• TCC (graduation)
• Disertação (Mesters)
• Teses (PHD)
• Livre Docências (Associate Professor)

Dependencies

• Selenium
• ChromeDriver
• Selenium-server-standalone
• htmlquery

Run

brew install chrome driver (not needed if you alredy have chrome driver)

java -jar selenium-server-standalone.jar

go run main.go

Notes

• Sometimes chromedriver need a clearnce in security options on MacOS.
• Don't forget to previus install Java.