stage

package
v0.0.0-debug-20260702 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jul 2, 2026 License: Apache-2.0 Imports: 6 Imported by: 0

Documentation

Index

Constants

View Source
const FILE_PROTOCOL = "file"
View Source
const HDFS_PROTOCOL = "hdfs"
View Source
const MINIO_SERVICE = "minio"
View Source
const PARAMKEY_AWS_KEY_ID = "aws_key_id"
View Source
const PARAMKEY_AWS_REGION = "aws_region"
View Source
const PARAMKEY_AWS_SECRET_KEY = "aws_secret_key"
View Source
const PARAMKEY_COMPRESSION = "compression"
View Source
const PARAMKEY_ENDPOINT = "endpoint"
View Source
const PARAMKEY_PROVIDER = "provider"
View Source
const S3_PROTOCOL = "s3"
View Source
const S3_PROVIDER_AMAZON = "amazon"
View Source
const S3_PROVIDER_COS = "cos"
View Source
const S3_PROVIDER_MINIO = "minio"
View Source
const S3_SERVICE = "s3"
View Source
const STAGE_PROTOCOL = "stage"

Variables

This section is empty.

Functions

func CredentialsToMap

func CredentialsToMap(cred string) (map[string]string, error)

func ParseS3Url

func ParseS3Url(u *url.URL) (bucket, fpath, query string, err error)

func ParseStageUrl

func ParseStageUrl(u *url.URL) (stagename, prefix, query string, err error)

Types

type StageDef

type StageDef struct {
	Id          uint32
	Name        string
	Url         *url.URL
	Credentials map[string]string
	Status      string
}

func (StageDef) GetCredentials

func (s StageDef) GetCredentials(key string, defval string) (string, bool)

func (StageDef) ToPath

func (s StageDef) ToPath() (mopath string, query string, err error)

get stages and expand the path. stage may be a file or s3 use the format of path s3,<endpoint>,<region>,<bucket>,<key>,<secret>,<prefix> or minio,<endpoint>,<region>,<bucket>,<key>,<secret>,<prefix> expand the subpath to MO path. subpath is in the format like path or path with query like path?q1=v1&q2=v2...

Directories

Path Synopsis

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL