The highest tagged major version is v4.

plugins

package

v0.12.9 Latest Latest Go to latest Published: Oct 7, 2022 License: MPL-2.0 Imports: 20 Imported by: 7

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/cloudquery/plugin-sdk

Links

Open Source Insights

Documentation ¶

Overview ¶

Package plugins defines APIs for source and destination plugins

Index ¶

func TestSourcePluginSync(t *testing.T, plugin *SourcePlugin, logger zerolog.Logger, spec specs.Source)
type DestinationClient
type DestinationPlugin
- func NewDestinationPlugin(name string, version string, newDestinationClient NewDestinationClientFunc) *DestinationPlugin
type NewDestinationClientFunc
type ResourceTestCase
type SourceNewExecutionClientFunc
type SourcePlugin
- func NewSourcePlugin(name string, version string, tables []*schema.Table, ...) *SourcePlugin
type WriteSummary

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func TestSourcePluginSync ¶ added in v0.0.4

func TestSourcePluginSync(t *testing.T, plugin *SourcePlugin, logger zerolog.Logger, spec specs.Source)

Types ¶

type DestinationClient ¶ added in v0.2.3

type DestinationClient interface {
	Migrate(ctx context.Context, tables schema.Tables) error
	Write(ctx context.Context, table string, data map[string]interface{}) error
	DeleteStale(ctx context.Context, tables string, sourceName string, syncTime time.Time) error
	Close(ctx context.Context) error
}

type DestinationPlugin ¶

type DestinationPlugin struct {
	// contains filtered or unexported fields
}

func NewDestinationPlugin ¶ added in v0.2.3

func NewDestinationPlugin(name string, version string, newDestinationClient NewDestinationClientFunc) *DestinationPlugin

func (*DestinationPlugin) Close ¶ added in v0.11.4

func (p *DestinationPlugin) Close(ctx context.Context) error

func (*DestinationPlugin) DeleteStale ¶ added in v0.12.0

func (p *DestinationPlugin) DeleteStale(ctx context.Context, tables []string, sourceName string, syncTime time.Time) uint64

func (*DestinationPlugin) Init ¶ added in v0.12.0

func (p *DestinationPlugin) Init(ctx context.Context, logger zerolog.Logger, spec specs.Destination) error

we need lazy loading because we want to be able to initialize after

func (*DestinationPlugin) Migrate ¶ added in v0.0.4

func (p *DestinationPlugin) Migrate(ctx context.Context, tables schema.Tables) error

we implement all DestinationClient functions so we can hook into pre-post behavior

func (*DestinationPlugin) Name ¶ added in v0.0.4

func (p *DestinationPlugin) Name() string

func (*DestinationPlugin) Version ¶ added in v0.0.4

func (p *DestinationPlugin) Version() string

func (*DestinationPlugin) Write ¶ added in v0.0.4

func (p *DestinationPlugin) Write(ctx context.Context, source string, syncTime time.Time, res <-chan *schema.Resource) *WriteSummary

type NewDestinationClientFunc ¶ added in v0.12.0

type NewDestinationClientFunc func(context.Context, zerolog.Logger, specs.Destination) (DestinationClient, error)

type ResourceTestCase ¶

type ResourceTestCase struct {
	Plugin *SourcePlugin
	Spec   specs.Source
	// ParallelFetchingLimit limits parallel resources fetch at a time
	ParallelFetchingLimit uint64
	// SkipIgnoreInTest flag which detects if schema.Table or schema.Column should be ignored
	SkipIgnoreInTest bool
}

type SourceNewExecutionClientFunc ¶ added in v0.0.4

type SourceNewExecutionClientFunc func(context.Context, zerolog.Logger, specs.Source) (schema.ClientMeta, error)

type SourcePlugin ¶

type SourcePlugin struct {
	// contains filtered or unexported fields
}

SourcePlugin is the base structure required to pass to sdk.serve We take a declarative approach to API here similar to Cobra

func NewSourcePlugin ¶ added in v0.0.4

func NewSourcePlugin(name string, version string, tables []*schema.Table, newExecutionClient SourceNewExecutionClientFunc) *SourcePlugin

NewSourcePlugin returns a new plugin with a given name, version, tables, newExecutionClient and additional options.

func (*SourcePlugin) GenerateSourcePluginDocs ¶ added in v0.6.4

func (p *SourcePlugin) GenerateSourcePluginDocs(dir string) error

GenerateSourcePluginDocs creates table documentation for the source plugin based on its list of tables

func (*SourcePlugin) Name ¶

func (p *SourcePlugin) Name() string

Name return the name of this plugin

func (*SourcePlugin) Sync ¶ added in v0.0.4

func (p *SourcePlugin) Sync(ctx context.Context, logger zerolog.Logger, spec specs.Source, res chan<- *schema.Resource) (*schema.SyncSummary, error)

Sync is syncing data from the requested tables in spec to the given channel

func (*SourcePlugin) Tables ¶

func (p *SourcePlugin) Tables() schema.Tables

Tables returns all supported tables by this source plugin

func (*SourcePlugin) Version ¶

func (p *SourcePlugin) Version() string

Version returns the version of this plugin

type WriteSummary ¶ added in v0.12.0

type WriteSummary struct {
	SuccessWrites uint64
	FailedWrites  uint64
	FailedDeletes uint64
}

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL