logstack

module
v0.0.0-...-691b052 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: May 7, 2018 License: Apache-2.0

README

Bitfan
Bitfan

Data and Event processing pipeliner really inspired by Logstash.

GoDoc Go Report Card Build Status Codecov


Get bitfan, usage and configuration documentation and a availables processors

Features

  • configuration file compatible with logstash config file format.
  • support conditionals, env, sprintf variables in configuration : %{[field][key]} ${ENVVAR}
  • supports input, filters, output and codecs
  • consume local and remote (http) configuration files
  • build complex pipelines with the use keyword to import, connect, fork to other pipelines/configuration files
  • gracefully stop and start each pipelines
  • install bitfan as a system daemon / service
  • manage running pipelines (list / stop / start a pipeline in a running bitfan)
  • monitor pipeline processors and events with prometheus
  • REST API to manage Bitfan
  • WebUI

Similar projets in go

  • tsaikd/gogstash - Logstash like, written in golang
  • packetzoom/logzoom - A lightweight replacement for logstash indexer in Go
  • hailocab/logslam - A lightweight lumberjack protocol compliant logstash indexer
  • spartanlogs/spartan - Spartan is a data process much like Logstash

Credits

Icon made by Freepik from www.flaticon.com is licensed by CC 3.0 BY

Contributors

  • @vjeantet - Valere JEANTET
  • @mirdhyn - Merlin Gaillard
  • @AlexAkulov - Alexander AKULOV
  • @lor00x - Thomas GUILLIER

Directories

Path Synopsis
api
cmd
bitfan command
bitfanDoc command
bitfanUI command
csv
Parses comma-separated value data into individual fields
Parses comma-separated value data into individual fields
json
Code generated by "bitfanDoc -codec json"; DO NOT EDIT
Code generated by "bitfanDoc -codec json"; DO NOT EDIT
jsonlines
Code generated by "bitfanDoc -codec json_lines"; DO NOT EDIT
Code generated by "bitfanDoc -codec json_lines"; DO NOT EDIT
line
Code generated by "bitfanDoc -codec encoder"; DO NOT EDIT
Code generated by "bitfanDoc -codec encoder"; DO NOT EDIT
multiline
The multiline codec will collapse multiline messages and merge them into a single event.
The multiline codec will collapse multiline messages and merge them into a single event.
plain
Code generated by "bitfanDoc -codec encoder"; DO NOT EDIT
Code generated by "bitfanDoc -codec encoder"; DO NOT EDIT
rubydebug
Code generated by "bitfanDoc -codec rubydebug"; DO NOT EDIT
Code generated by "bitfanDoc -codec rubydebug"; DO NOT EDIT
w3c
Parses comma-separated value data into individual fields
Parses comma-separated value data into individual fields
Entrypoint manage pipeline's definitions to get Pipeline ready to be used by the core
Entrypoint manage pipeline's definitions to get Pipeline ready to be used by the core
doc
filter-blacklist
The blacklist rule will check a certain field against a blacklist, and match if it is in the blacklist.
The blacklist rule will check a certain field against a blacklist, and match if it is in the blacklist.
filter-change
This rule will monitor a certain field and match if that field changes.
This rule will monitor a certain field and match if that field changes.
filter-date
The date filter is used for parsing dates from fields, and then using that date or timestamp as the logstash timestamp for the event.
The date filter is used for parsing dates from fields, and then using that date or timestamp as the logstash timestamp for the event.
filter-digest
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-drop
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-eval
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-exec
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-geoip
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-grok
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-html
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-json
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-kv
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-mutate
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-newterm
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-split
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-uuid
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
filter-whitelist
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
httpout
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
httppoller
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-beats
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-elasticsearch
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-event
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-exec
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-file
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-httpserver
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-imap
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-rabbitmq
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-stdin
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-stdout
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-syslog
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-tail
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-twitter
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-udp
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-unix
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
input-websocket
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
ldap
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
output-elasticsearch
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
output-elasticsearch2
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
output-email
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
output-file
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
output-glusterfs
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
output-http
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
output-mongodb
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
output-null
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
output-rabbitmq
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
output-statsd
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
output-tcp
Code generated by "bitfanDoc -processor output-tcp"; DO NOT EDIT
Code generated by "bitfanDoc -processor output-tcp"; DO NOT EDIT
pop3
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
route
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
sleep
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
sql
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
stdout
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
stop
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
template
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
use
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
webfan
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
websocket
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT
when
Code generated by "bitfanDoc "; DO NOT EDIT
Code generated by "bitfanDoc "; DO NOT EDIT

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL