Documentation
¶
Index ¶
- Constants
- func DeleteParentIdFilter(id string) func(meta ClientMeta, parent *Resource) []interface{}
- func GenerateMarkdownTree(tables []*Table, dir string) error
- func ParentIdResolver(_ context.Context, _ ClientMeta, r *Resource, c Column) error
- func ValidateTable(t *Table) error
- type ClientMeta
- type Column
- type ColumnCreationOptions
- type ColumnList
- type ColumnMeta
- type ColumnResolver
- func DateResolver(path string, rfcs ...string) ColumnResolver
- func DateUTCResolver(path string, rfcs ...string) ColumnResolver
- func IPAddressResolver(path string) ColumnResolver
- func IPAddressesResolver(path string) ColumnResolver
- func IPNetResolver(path string) ColumnResolver
- func IntResolver(path string) ColumnResolver
- func MACAddressResolver(path string) ColumnResolver
- func ParentPathResolver(path string) ColumnResolver
- func ParentResourceFieldResolver(name string) ColumnResolver
- func PathResolver(path string) ColumnResolver
- func StringResolver(path string) ColumnResolver
- func UUIDResolver(path string) ColumnResolver
- type IgnoreErrorFunc
- type LengthTableValidator
- type Meta
- type ResolverMeta
- type Resource
- type Resources
- type RowResolver
- type Table
- type TableCreationOptions
- type TableResolver
- type TableValidator
- type ValueType
Constants ¶
const FetchIdMetaKey = "cq_fetch_id"
Variables ¶
This section is empty.
Functions ¶
func DeleteParentIdFilter ¶
func DeleteParentIdFilter(id string) func(meta ClientMeta, parent *Resource) []interface{}
DeleteParentIdFilter is mostly used for table relations to delete table data based on parent's cq_id
func GenerateMarkdownTree ¶
func ParentIdResolver ¶
ParentIdResolver resolves the cq_id from the parent if you want to reference the parent's primary keys use ParentResourceFieldResolver as required.
func ValidateTable ¶
Types ¶
type ClientMeta ¶
type Column ¶
type Column struct {
// Name of column
Name string
// Value Type of column i.e String, UUID etc'
Type ValueType
// Description about column, this description is added as a comment in the database
Description string
// Column Resolver allows to set you own data based on resolving this can be an API call or setting multiple embedded values etc'
Resolver ColumnResolver `msgpack:"-"`
// Creation options allow modifying how column is defined when table is created
CreationOptions ColumnCreationOptions
// IgnoreInTests is used to skip verifying the column is non-nil in integration tests.
// By default, integration tests perform a fetch for all resources in cloudquery's test account, and
// verify all columns are non-nil.
// If IgnoreInTests is true, verification is skipped for this column.
// Used when it is hard to create a reproducible environment with this column being non-nil (e.g. various error columns).
IgnoreInTests bool
// contains filtered or unexported fields
}
Column definition for Table
func SetColumnMeta ¶
func SetColumnMeta(c Column, m *ColumnMeta) Column
func (Column) Meta ¶
func (c Column) Meta() *ColumnMeta
func (Column) ValidateType ¶
type ColumnCreationOptions ¶
ColumnCreationOptions allow modification of how column is defined when table is created
type ColumnList ¶
type ColumnList []Column
func (ColumnList) Get ¶
func (c ColumnList) Get(name string) *Column
func (ColumnList) Names ¶
func (c ColumnList) Names() []string
func (ColumnList) Sift ¶
func (c ColumnList) Sift() (providerCols ColumnList, internalCols ColumnList)
Sift gets a column list and returns a list of provider columns, and another list of internal columns, cqId column being the very last one
type ColumnMeta ¶
type ColumnMeta struct {
Resolver *ResolverMeta
IgnoreExists bool
}
type ColumnResolver ¶
ColumnResolver is called for each row received in TableResolver's data fetch. execution holds all relevant information regarding execution as well as the Column called. resource holds the current row we are resolving the column for.
func DateResolver ¶
func DateResolver(path string, rfcs ...string) ColumnResolver
DateResolver resolves the different date formats (ISODate - 2011-10-05T14:48:00.000Z is default) into *time.Time
Examples: DateResolver("Date") - resolves using RFC.RFC3339 as default DateResolver("InnerStruct.Field", time.RFC822) - resolves using time.RFC822 DateResolver("InnerStruct.Field", time.RFC822, "2011-10-05") - resolves using a few resolvers one by one
func DateUTCResolver ¶
func DateUTCResolver(path string, rfcs ...string) ColumnResolver
DateUTCResolver resolves the different date formats (ISODate - 2011-10-05T14:48:00.000Z is default) into *time.Time and converts the date to utc timezone
Examples: DateUTCResolver("Date") - resolves using RFC.RFC3339 as default DateUTCResolver("InnerStruct.Field", time.RFC822) - resolves using time.RFC822 DateUTCResolver("InnerStruct.Field", time.RFC822, "2011-10-05") - resolves using a few resolvers one by one
func IPAddressResolver ¶
func IPAddressResolver(path string) ColumnResolver
IPAddressResolver resolves the ip string value and returns net.IP
Examples: IPAddressResolver("IP")
func IPAddressesResolver ¶
func IPAddressesResolver(path string) ColumnResolver
IPAddressesResolver resolves the ip string value and returns net.IP
Examples: IPAddressesResolver("IP")
func IPNetResolver ¶
func IPNetResolver(path string) ColumnResolver
IPNetResolver resolves the network string value and returns net.IPNet
Examples: IPNetResolver("Network")
func IntResolver ¶
func IntResolver(path string) ColumnResolver
IntResolver tries to cast value into int
Examples: IntResolver("Id")
func MACAddressResolver ¶
func MACAddressResolver(path string) ColumnResolver
MACAddressResolver resolves the mac string value and returns net.HardwareAddr
Examples: MACAddressResolver("MAC")
func ParentPathResolver ¶
func ParentPathResolver(path string) ColumnResolver
ParentPathResolver resolves a field from the parent
func ParentResourceFieldResolver ¶
func ParentResourceFieldResolver(name string) ColumnResolver
ParentResourceFieldResolver resolves a field from the parent's resource, the value is expected to be set if name isn't set the field will be set to null
func PathResolver ¶
func PathResolver(path string) ColumnResolver
PathResolver resolves a field in the Resource.Item
Examples: PathResolver("Field") PathResolver("InnerStruct.Field") PathResolver("InnerStruct.InnerInnerStruct.Field")
func StringResolver ¶
func StringResolver(path string) ColumnResolver
StringResolver tries to cast value into string
Examples: StringResolver("Id")
func UUIDResolver ¶
func UUIDResolver(path string) ColumnResolver
UUIDResolver resolves the uuid string value and returns uuid.UUID
Examples: UUIDResolver("Resource.UUID")
type IgnoreErrorFunc ¶
IgnoreErrorFunc checks if returned error from table resolver should be ignored.
type LengthTableValidator ¶
type LengthTableValidator struct{}
func (LengthTableValidator) Validate ¶
func (LengthTableValidator) Validate(t *Table) error
type ResolverMeta ¶
type Resource ¶
type Resource struct {
// Original resource item that wa from prior resolve
Item interface{}
// Set if this is an embedded table
Parent *Resource `msgpack:"parent"`
// internal fields
Table *Table `msgpack:"table"`
Data map[string]interface{} `msgpack:"data"`
CColumns []string `msgpack:"columns"`
// contains filtered or unexported fields
}
Resource represents a row in it's associated table, it carries a reference to the original item, and automatically generates an Id based on Table's Columns. Resource data can be accessed by the Get and Set methods
func NewResourceData ¶
type RowResolver ¶
type RowResolver func(ctx context.Context, meta ClientMeta, resource *Resource) error
type Table ¶
type Table struct {
// Name of table
Name string
// table description
Description string
// Columns are the set of fields that are part of this table
Columns ColumnList
// Relations are a set of related tables defines
Relations []*Table
// Resolver is the main entry point to fetching table data and
Resolver TableResolver `msgpack:"-"`
// Ignore errors checks if returned error from table resolver should be ignored.
IgnoreError IgnoreErrorFunc `msgpack:"-"`
// Multiplex returns re-purposed meta clients. The sdk will execute the table with each of them
Multiplex func(meta ClientMeta) []ClientMeta `msgpack:"-"`
// Post resource resolver is called after all columns have been resolved, and before resource is inserted to database.
PostResourceResolver RowResolver `msgpack:"-"`
// Options allow modification of how the table is defined when created
Options TableCreationOptions
// IgnoreInTests is used to exclude a table from integration tests.
// By default, integration tests fetch all resources from cloudquery's test account, and verify all tables
// have at least one row.
// When IgnoreInTests is true, integration tests won't fetch from this table.
// Used when it is hard to create a reproducible environment with a row in this table.
IgnoreInTests bool
// Parent is the parent table in case this table is called via parent table (i.e. relation)
Parent *Table
// Serial is used to force a signature change, which forces new table creation and cascading removal of old table and relations
Serial string
}
func (Table) Resolve ¶
func (t Table) Resolve(ctx context.Context, meta ClientMeta, parent *Resource, resolvedResources chan<- *Resource)
Call the table resolver with with all of it's relation for every reolved resource
func (Table) TableNames ¶
type TableCreationOptions ¶
type TableCreationOptions struct {
// List of columns to set as primary keys. If this is empty, a random unique ID is generated.
PrimaryKeys []string
}
TableCreationOptions allow modifying how table is created such as defining primary keys, indices, foreign keys and constraints.
type TableResolver ¶
type TableResolver func(ctx context.Context, meta ClientMeta, parent *Resource, res chan<- interface{}) error
TableResolver is the main entry point when a table fetch is called.
Table resolver has 3 main arguments: - meta(ClientMeta): is the client returned by the plugin.Provider Configure call - parent(Resource): resource is the parent resource in case this table is called via parent table (i.e. relation) - res(chan interface{}): is a channel to pass results fetched by the TableResolver
type TableValidator ¶
type ValueType ¶
type ValueType int
func ValueTypeFromString ¶
ValueTypeFromString this function is mainly used by https://github.com/cloudquery/cq-gen