workflow

package
v0.2.2 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Aug 25, 2026 License: MIT Imports: 5 Imported by: 0

Documentation

Overview

Package workflow wires a Source to a Sink and drives the metadata push in the order required by OpenMetadata's entity hierarchy: service, then databases, then schemas, then tables. Every level is upserted, so re-runs are idempotent.

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type Stats

type Stats struct {
	Databases int
	Schemas   int
	Tables    int
	// FailedTables counts tables skipped because their upsert failed. The run
	// continues past such failures rather than aborting.
	FailedTables int
}

Stats summarises what a run pushed.

type Workflow

type Workflow struct {
	// contains filtered or unexported fields
}

Workflow couples a source and a sink.

func New

func New(src source.Source, snk sink.Sink, log *slog.Logger) *Workflow

New builds a Workflow.

func (*Workflow) Run

func (w *Workflow) Run(ctx context.Context) (Stats, error)

Run extracts from the source and pushes the full hierarchy to the sink.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL