spiders

package

v0.2.0 Latest Latest Go to latest Published: Nov 1, 2015 License: MIT Imports: 3 Imported by: 0

Details

This section is empty.

This section is empty.

This section is empty.

type SimpleSpider struct {
	URL    string
	Method string
	Body   io.Reader
	// contains filtered or unexported fields
}

func NewSimpleGETSpider(url string, spinnerFunc spider.SpinnerFunc) *SimpleSpider

Create a SimpleSpider that makes a get request to the specified url.

func NewSimpleSpider(method, url string, body io.Reader, spinnerFunc spider.SpinnerFunc) *SimpleSpider

NewSimpleSpider creates a new SimpleSpider with provided arguments. This function requires a spider.SpinnerFunc to handle parsing of to response.

func (s *SimpleSpider) Setup(ctx *spider.Context) (*spider.Context, error)

func (s *SimpleSpider) Spin(ctx *spider.Context) error