Documentation
¶
Overview ¶
Loads many source CSV files (produced by the collector), creates summary files in CSV and Parquet, and writes a single CSV file with all raw transactions
Index ¶
Constants ¶
This section is empty.
Variables ¶
View Source
var Command = cli.Command{ Name: "merge", Usage: "Load input CSV files, deduplicate, sort and produce single output file", Subcommands: []*cli.Command{ { Name: "transactions", Aliases: []string{"tx", "t"}, Usage: "merge transaction CSVs", Flags: append(commonFlags, mergeTxFlags...), Action: mergeTransactions, }, { Name: "sourcelog", Aliases: []string{"s"}, Usage: "merge sourcelog CSVs", Flags: commonFlags, Action: mergeSourcelog, }, { Name: "trash", Usage: "merge trash CSVs", Flags: commonFlags, Action: mergeTrash, }, }, }
View Source
var ErrNoDSN = fmt.Errorf("Clickhouse DSN is required")
Functions ¶
This section is empty.
Types ¶
type BlockCache ¶
type BlockCache struct {
// contains filtered or unexported fields
}
BlockCache - reuse already known blocks and avoid unnecessary lookups for transaction inclusion
func NewBlockCache ¶
func NewBlockCache() *BlockCache
type Clickhouse ¶ added in v1.2.1
type Clickhouse struct {
// contains filtered or unexported fields
}
func NewClickhouse ¶ added in v1.2.1
func NewClickhouse(opts ClickhouseOpts) (*Clickhouse, error)
NewClickhouse creates a new Clickhouse instance with a connection to the database.
type ClickhouseOpts ¶ added in v1.2.1
type ClickhouseOpts struct {
Log *zap.SugaredLogger
DSN string
}
type TxUpdateWorker ¶
type TxUpdateWorker struct {
// contains filtered or unexported fields
}
TxUpdateWorker - independent EL connections for parallel tx inclusion checks
func NewTxUpdateWorker ¶
func NewTxUpdateWorker(log *zap.SugaredLogger, checkNodeURI string, txC chan *common.TxSummaryEntry, respC chan error, blockCache *BlockCache) (p *TxUpdateWorker)
Source Files
Click to show internal directories.
Click to hide internal directories.