Documentation
¶
Index ¶
Constants ¶
View Source
const FILE_PROTOCOL = "file"
View Source
const HDFS_PROTOCOL = "hdfs"
View Source
const MINIO_SERVICE = "minio"
View Source
const PARAMKEY_AWS_KEY_ID = "aws_key_id"
View Source
const PARAMKEY_AWS_REGION = "aws_region"
View Source
const PARAMKEY_AWS_SECRET_KEY = "aws_secret_key"
View Source
const PARAMKEY_COMPRESSION = "compression"
View Source
const PARAMKEY_ENDPOINT = "endpoint"
View Source
const PARAMKEY_PROVIDER = "provider"
View Source
const S3_PROTOCOL = "s3"
View Source
const S3_PROVIDER_AMAZON = "amazon"
View Source
const S3_PROVIDER_COS = "cos"
View Source
const S3_PROVIDER_MINIO = "minio"
View Source
const S3_SERVICE = "s3"
View Source
const STAGE_PROTOCOL = "stage"
Variables ¶
This section is empty.
Functions ¶
Types ¶
type StageDef ¶
type StageDef struct {
Id uint32
Name string
Url *url.URL
Credentials map[string]string
Status string
}
func (StageDef) GetCredentials ¶
func (StageDef) ToPath ¶
get stages and expand the path. stage may be a file or s3 use the format of path s3,<endpoint>,<region>,<bucket>,<key>,<secret>,<prefix> or minio,<endpoint>,<region>,<bucket>,<key>,<secret>,<prefix> expand the subpath to MO path. subpath is in the format like path or path with query like path?q1=v1&q2=v2...
Click to show internal directories.
Click to hide internal directories.