Documentation
¶
Index ¶
- Variables
- type FileQuerySplitterExtractor
- func (f FileQuerySplitterExtractor) CloneForAsset(ctx context.Context, p *pipeline.Pipeline, t *pipeline.Asset) (QueryExtractor, error)
- func (f FileQuerySplitterExtractor) ExtractQueriesFromString(content string) ([]*Query, error)
- func (f FileQuerySplitterExtractor) ReextractQueriesFromSlice(content []string) ([]string, error)
- type Query
- type QueryExtractor
- type QueryResult
- type Renderer
- type WholeFileExtractor
- func (f *WholeFileExtractor) CloneForAsset(ctx context.Context, p *pipeline.Pipeline, t *pipeline.Asset) (QueryExtractor, error)
- func (f *WholeFileExtractor) ExtractQueriesFromString(content string) ([]*Query, error)
- func (f *WholeFileExtractor) ReextractQueriesFromSlice(content []string) ([]string, error)
Constants ¶
This section is empty.
Variables ¶
View Source
var DefaultJinjaRenderer = jinja.NewRenderer(jinja.Context{ "ds": time.Now().Format("2006-01-02"), "ds_nodash": time.Now().Format("20060102"), "data_interval_start": time.Now().AddDate(0, 0, -1).Format(time.RFC3339), "data_interval_end": time.Now().Format(time.RFC3339), "utils": map[string]interface{}{ "date_add": func(str string, days int) string { return str }, "date_format": func(str, inputFormat, outputFormat string) string { return str }, }, })
Functions ¶
This section is empty.
Types ¶
type FileQuerySplitterExtractor ¶
type FileQuerySplitterExtractor struct {
Fs afero.Fs
Renderer jinja.RendererInterface
}
FileQuerySplitterExtractor is a regular file extractor, but it splits the queries in the given file into multiple instances. For usecases that require EXPLAIN statements, such as validating Snowflake queries, it is not possible to use a single query with multiple statements, so we need to split them into multiple queries.
func (FileQuerySplitterExtractor) CloneForAsset ¶ added in v0.11.230
func (f FileQuerySplitterExtractor) CloneForAsset(ctx context.Context, p *pipeline.Pipeline, t *pipeline.Asset) (QueryExtractor, error)
func (FileQuerySplitterExtractor) ExtractQueriesFromString ¶ added in v0.7.1
func (f FileQuerySplitterExtractor) ExtractQueriesFromString(content string) ([]*Query, error)
func (FileQuerySplitterExtractor) ReextractQueriesFromSlice ¶ added in v0.11.230
func (f FileQuerySplitterExtractor) ReextractQueriesFromSlice(content []string) ([]string, error)
type QueryExtractor ¶ added in v0.11.182
type QueryResult ¶ added in v0.11.53
type WholeFileExtractor ¶
type WholeFileExtractor struct {
Fs afero.Fs
Renderer jinja.RendererInterface
}
WholeFileExtractor is a regular file extractor that returns the whole file content as the query string. It is useful for cases where the whole file content can be treated as a single query, such as validating GoogleCloudPlatform queries via dry-run.
func (*WholeFileExtractor) CloneForAsset ¶ added in v0.11.182
func (f *WholeFileExtractor) CloneForAsset(ctx context.Context, p *pipeline.Pipeline, t *pipeline.Asset) (QueryExtractor, error)
func (*WholeFileExtractor) ExtractQueriesFromString ¶ added in v0.7.1
func (f *WholeFileExtractor) ExtractQueriesFromString(content string) ([]*Query, error)
func (*WholeFileExtractor) ReextractQueriesFromSlice ¶ added in v0.11.165
func (f *WholeFileExtractor) ReextractQueriesFromSlice(content []string) ([]string, error)
Click to show internal directories.
Click to hide internal directories.