llmstxt

package

v1.2.0 Latest Latest Go to latest Published: Oct 22, 2026 License: Apache-2.0 Imports: 6 Imported by: 0

Details

Package llmstxt finds and validates /llms.txt files (https://llmstxt.org).

View Source

const MaxSize = 2 << 20

MaxSize is the largest file read.

View Source

var Paths = []string{"/llms.txt", "/llms-full.txt"}

Paths are the well-known files checked at the site root.

func Check(ctx context.Context, get Getter, target string) ([]types.LLMsTxt, error)

Check fetches each well-known llms.txt path at the origin of target.

type Getter func(ctx context.Context, url string) (status int, body []byte, err error)

Getter performs a GET and returns the status and body.