Documentation
¶
Index ¶
- Constants
- func CfgAuthOpts(cfg *viper.Viper) *shttp.AuthenticationOpts
- func NewSubscriber(pipeline *Pipeline, cfg *viper.Viper) (*websocket.StructSpeaker, error)
- func SubscriberRun(s *websocket.StructSpeaker)
- type Classifier
- type Compressor
- type Encoder
- type Filterer
- type Pipeline
- type StoreS3
- type Storer
- type Tag
- type Transformer
Constants ¶
const CfgRoot = "pipeline."
CfgRoot configuration root path
Variables ¶
This section is empty.
Functions ¶
func CfgAuthOpts ¶
func CfgAuthOpts(cfg *viper.Viper) *shttp.AuthenticationOpts
CfgAuthOpts creates the auth options form configuration
func NewSubscriber ¶
NewSubscriber returns a new flow subscriber writing to object store
func SubscriberRun ¶
func SubscriberRun(s *websocket.StructSpeaker)
SubscriberRun runs the subscriber under main
Types ¶
type Classifier ¶
Classifier exposes the interface for tag based classification
func NewClassify ¶
func NewClassify(cfg *viper.Viper) (Classifier, error)
NewClassify returns a new classify, based on the given cluster net masks
type Compressor ¶
Compressor exposes the interface for compressesing encoded flows
func NewCompressGzip ¶
func NewCompressGzip() (Compressor, error)
NewCompressGzip create an encode object
type Encoder ¶
Encoder exposes the interface for encoding flows
type Filterer ¶
Filterer exposes the interface for tag based filtering
func NewFilter ¶
NewFilter returns a new filter based on a list of excluded tags
type Pipeline ¶
type Pipeline struct {
Transformer Transformer
Classifier Classifier
Filterer Filterer
Encoder Encoder
Compressor Compressor
Storer Storer
}
Pipeline manager
func NewPipeline ¶
func NewPipeline(transformer Transformer, classifier Classifier, filterer Filterer, encoder Encoder, compressor Compressor, storer Storer) *Pipeline
NewPipeline defines the pipeline elements
type StoreS3 ¶
type StoreS3 struct {
// contains filtered or unexported fields
}
StoreS3 allows writing flows to an object storage service
func NewStoreS3 ¶
func NewStoreS3(client objectStoreClient, bucket, objectPrefix string, maxFlowArraySize, maxFlowsPerObject, maxSecondsPerObject, maxSecondsPerStream int) (*StoreS3, error)
NewStoreS3 creates a store
func NewStoreS3FromConfig ¶
NewStoreS3FromConfig returns a new storage interface for storing flows to object store
func (*StoreS3) DeleteObject ¶
DeleteObject deletes an object
func (*StoreS3) ListObjects ¶
ListObjects lists all stored objects
func (*StoreS3) ReadObjectFlows ¶
ReadObjectFlows reads flows from object
Source Files
¶
- classify.go
- compress.go
- encode.go
- filter.go
- pipeline.go
- s3_client.go
- store.go
- store_log.go
- store_s3.go
- subscriber.go
- transform.go