navigation

package
v1.0.2 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jun 12, 2023 License: MIT Imports: 4 Imported by: 14

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type Depth

type Depth struct{}

Depth is the depth of a navigation

type Headers added in v1.0.0

type Headers map[string]string

func (*Headers) MarshalJSON added in v1.0.0

func (h *Headers) MarshalJSON() ([]byte, error)

type Request

type Request struct {
	Method       string              `json:"method,omitempty"`
	URL          string              `json:"endpoint,omitempty"`
	Body         string              `json:"body,omitempty"`
	Depth        int                 `json:"-"`
	Headers      map[string]string   `json:"headers,omitempty"`
	Tag          string              `json:"tag,omitempty"`
	Attribute    string              `json:"attribute,omitempty"`
	RootHostname string              `json:"-"`
	Source       string              `json:"source,omitempty"`
	CustomFields map[string][]string `json:"-"`
	Raw          string              `json:"raw,omitempty"`
}

Request is a navigation request for the crawler

func NewNavigationRequestURLFromResponse

func NewNavigationRequestURLFromResponse(path, source, tag, attribute string, resp *Response) *Request

newNavigationRequestURL generates a navigation request from a relative URL

func (*Request) RequestURL

func (n *Request) RequestURL() string

RequestURL returns the request URL for the navigation

type Response

type Response struct {
	Resp         *http.Response    `json:"-"`
	Depth        int               `json:"-"`
	Reader       *goquery.Document `json:"-"`
	StatusCode   int               `json:"status_code,omitempty"`
	Headers      Headers           `json:"headers,omitempty"`
	Body         string            `json:"body,omitempty"`
	RootHostname string            `json:"-"`
	Technologies []string          `json:"technologies,omitempty"`
	Raw          string            `json:"raw,omitempty"`
}

Response is a response generated from crawler navigation

func (Response) AbsoluteURL

func (n Response) AbsoluteURL(path string) string

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL