utils

package

v0.8.97 Latest Latest Go to latest Published: Feb 3, 2026 License: CC0-1.0 Imports: 5 Imported by: 0

Details

View Source

const (
	MaxFilenameLength         = 255
	MaxFilenameWithHashLength = 247
	DefaultDirPermissions     = 0755
	DefaultFilePermissions    = 0644
)

Constants for file operations

This section is empty.

func GetThreadsFlag(cmd *cobra.Command) int

GetThreadsFlag extracts the threads flag value from a cobra command Cobra already validates that it's a valid integer, but we still check for errors

func OpenWARCFile(filepath string) (*warc.Reader, *os.File, error)

OpenWARCFile opens a WARC file and returns a reader and file handle

func ShouldSkipRecord(record *warc.Record) bool

ShouldSkipRecord determines if a WARC record should be skipped during processing

This section is empty.