reconcilers

package
v0.78.0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Dec 22, 2025 License: Apache-2.0 Imports: 40 Imported by: 0

README

runtime/reconcilers/

Adding a new resource type

  1. Define spec and state schemas in proto/rill/runtime/v1/resource.proto
  2. Define a reconciler for it in runtime/reconcilers/
  3. If the resource should be defined in code files,
    • Define parser logic for it in runtime/parser
    • Define mapping from parser output to catalog in runtime/reconcilers/project_parser.go

When reconcile is invoked

  • When the runtime is restarted
  • When the resource's refs or spec is updated
  • When the resource is deleted (.Meta.DeletedOn will be non-nil)
  • When the resource is renamed (.Meta.RenamedFrom will be non-nil)
  • When all the resource's refs finish running Reconcile (even if they return an error)
  • When Controller.Reconcile is called for the resource
  • When the retrigger timestamp returned from an earlier invocation of Reconcile falls due

How the controller schedules reconcilers

  • The controller may run Reconcile for different resources at the same time.
  • The controller will only run one Reconcile per resource name at a time.
  • The controller will not reconcile resources that reference each other at the same time – i.e. it only runs one non-cancelled Reconcile call between any given root and leaf node of the resource DAG. This means Reconcile does not need to worry about refs changing their state while it's running.
  • The controller cancels a reconcile if the resource being reconciled was updated/deleted by another agent than the reconciler itself (self-updates do not cause cancellations).
  • The controller cancels reconciles if DAG ancestors need to be reconciled. It will wait for the cancelled reconcile to complete before starting reconcile for the ancestor.
  • The controller does not call Reconcile for resources with cyclic refs. Instead, it immediately sets an error on them.
  • The controller schedules reconciles of deleted and renamed resources, and waits for them to finish, before scheduling new regular reconciles. It does so in two phases, first letting all deletes finish (resources with deleted_on != nil), second letting all renames finish (resources with renamed_from != nil).

Principles for reconciler development

  • The implementation of Reconcile should be idempotent
  • Assume Reconcile may be invoked at any time
  • The ctx may be cancelled at any time. When ctx is cancelled, the reconciler should return as soon as possible.
  • After the ctx has been cancelled, the reconciler can still update its state before returning (by using the ctx to call UpdateState).
  • If the ctx is cancelled, you can assume that Reconcile will be invoked again shortly.
  • Calls to Reconcile can run for a long time (as long as they respond quickly to a cancelled ctx).
  • Reconcile should strive to keep a resource's .State correct at all times because it may be accessed while Reconcile is running to resolve API requests (such as dashboard queries).
  • The Reconciler struct is shared for all resources of the registered kind for a given instance ID. This enables it to cache (ephemeral) state in-between invocations for optimization.
  • The resource's meta and spec (but not state) may be updated concurrently. Calls to Get return a clone of the resource, but if the reconciler update's the resource's meta or spec, it must use a lock to read and update it.

Documentation

Index

Constants

This section is empty.

Variables

View Source 
var ErrParserHasParseErrors = errors.New("encountered parse errors")

Functions

This section is empty.

Types

type APIReconciler added in v0.42.0 

type APIReconciler struct {
	C *runtime.Controller
}

func (*APIReconciler) AssignSpec added in v0.42.0 

func (r *APIReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*APIReconciler) AssignState added in v0.42.0 

func (r *APIReconciler) AssignState(from, to *runtimev1.Resource) error

func (*APIReconciler) Close added in v0.42.0 

func (r *APIReconciler) Close(ctx context.Context) error

func (*APIReconciler) Reconcile added in v0.42.0 

func (r *APIReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*APIReconciler) ResetState added in v0.42.0 

func (r *APIReconciler) ResetState(res *runtimev1.Resource) error

func (*APIReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *APIReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

type AlertReconciler added in v0.41.0 

type AlertReconciler struct {
	C *runtime.Controller
}

func (*AlertReconciler) AssignSpec added in v0.41.0 

func (r *AlertReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*AlertReconciler) AssignState added in v0.41.0 

func (r *AlertReconciler) AssignState(from, to *runtimev1.Resource) error

func (*AlertReconciler) Close added in v0.41.0 

func (r *AlertReconciler) Close(ctx context.Context) error

func (*AlertReconciler) Reconcile added in v0.41.0 

func (r *AlertReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*AlertReconciler) ResetState added in v0.41.0 

func (r *AlertReconciler) ResetState(res *runtimev1.Resource) error

func (*AlertReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *AlertReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

type CanvasReconciler added in v0.50.0 

type CanvasReconciler struct {
	C *runtime.Controller
}

func (*CanvasReconciler) AssignSpec added in v0.50.0 

func (r *CanvasReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*CanvasReconciler) AssignState added in v0.50.0 

func (r *CanvasReconciler) AssignState(from, to *runtimev1.Resource) error

func (*CanvasReconciler) Close added in v0.50.0 

func (r *CanvasReconciler) Close(ctx context.Context) error

func (*CanvasReconciler) Reconcile added in v0.50.0 

func (r *CanvasReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*CanvasReconciler) ResetState added in v0.50.0 

func (r *CanvasReconciler) ResetState(res *runtimev1.Resource) error

func (*CanvasReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *CanvasReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

type ComponentReconciler added in v0.44.0 

type ComponentReconciler struct {
	C *runtime.Controller
}

func (*ComponentReconciler) AssignSpec added in v0.44.0 

func (r *ComponentReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*ComponentReconciler) AssignState added in v0.44.0 

func (r *ComponentReconciler) AssignState(from, to *runtimev1.Resource) error

func (*ComponentReconciler) Close added in v0.44.0 

func (r *ComponentReconciler) Close(ctx context.Context) error

func (*ComponentReconciler) Reconcile added in v0.44.0 

func (r *ComponentReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*ComponentReconciler) ResetState added in v0.44.0 

func (r *ComponentReconciler) ResetState(res *runtimev1.Resource) error

func (*ComponentReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *ComponentReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

type ConnectorReconciler added in v0.46.0 

type ConnectorReconciler struct {
	C *runtime.Controller
}

func (*ConnectorReconciler) AssignSpec added in v0.46.0 

func (r *ConnectorReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*ConnectorReconciler) AssignState added in v0.46.0 

func (r *ConnectorReconciler) AssignState(from, to *runtimev1.Resource) error

func (*ConnectorReconciler) Close added in v0.46.0 

func (r *ConnectorReconciler) Close(ctx context.Context) error

func (*ConnectorReconciler) Reconcile added in v0.46.0 

func (r *ConnectorReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*ConnectorReconciler) ResetState added in v0.46.0 

func (r *ConnectorReconciler) ResetState(res *runtimev1.Resource) error

func (*ConnectorReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *ConnectorReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

type ExploreReconciler added in v0.50.0 

type ExploreReconciler struct {
	C *runtime.Controller
}

func (*ExploreReconciler) AssignSpec added in v0.50.0 

func (r *ExploreReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*ExploreReconciler) AssignState added in v0.50.0 

func (r *ExploreReconciler) AssignState(from, to *runtimev1.Resource) error

func (*ExploreReconciler) Close added in v0.50.0 

func (r *ExploreReconciler) Close(ctx context.Context) error

func (*ExploreReconciler) Reconcile added in v0.50.0 

func (r *ExploreReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*ExploreReconciler) ResetState added in v0.50.0 

func (r *ExploreReconciler) ResetState(res *runtimev1.Resource) error

func (*ExploreReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *ExploreReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

type MetricsViewReconciler 

type MetricsViewReconciler struct {
	C *runtime.Controller
}

func (*MetricsViewReconciler) AssignSpec added in v0.33.0 

func (r *MetricsViewReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*MetricsViewReconciler) AssignState added in v0.33.0 

func (r *MetricsViewReconciler) AssignState(from, to *runtimev1.Resource) error

func (*MetricsViewReconciler) Close 

func (r *MetricsViewReconciler) Close(ctx context.Context) error

func (*MetricsViewReconciler) Reconcile 

func (r *MetricsViewReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*MetricsViewReconciler) ResetState added in v0.34.0 

func (r *MetricsViewReconciler) ResetState(res *runtimev1.Resource) error

func (*MetricsViewReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *MetricsViewReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

type MigrationReconciler 

type MigrationReconciler struct {
	C *runtime.Controller
}

func (*MigrationReconciler) AssignSpec added in v0.33.0 

func (r *MigrationReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*MigrationReconciler) AssignState added in v0.33.0 

func (r *MigrationReconciler) AssignState(from, to *runtimev1.Resource) error

func (*MigrationReconciler) Close 

func (r *MigrationReconciler) Close(ctx context.Context) error

func (*MigrationReconciler) Reconcile 

func (r *MigrationReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*MigrationReconciler) ResetState added in v0.34.0 

func (r *MigrationReconciler) ResetState(res *runtimev1.Resource) error

func (*MigrationReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *MigrationReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

type ModelReconciler 

type ModelReconciler struct {
	C *runtime.Controller
	// contains filtered or unexported fields
}

func (*ModelReconciler) AssignSpec added in v0.33.0 

func (r *ModelReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*ModelReconciler) AssignState added in v0.33.0 

func (r *ModelReconciler) AssignState(from, to *runtimev1.Resource) error

func (*ModelReconciler) Close 

func (r *ModelReconciler) Close(ctx context.Context) error

func (*ModelReconciler) Reconcile 

func (r *ModelReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*ModelReconciler) ResetState added in v0.34.0 

func (r *ModelReconciler) ResetState(res *runtimev1.Resource) error

func (*ModelReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *ModelReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

type ProjectParserReconciler 

type ProjectParserReconciler struct {
	C *runtime.Controller
}

func (*ProjectParserReconciler) AssignSpec added in v0.33.0 

func (r *ProjectParserReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*ProjectParserReconciler) AssignState added in v0.33.0 

func (r *ProjectParserReconciler) AssignState(from, to *runtimev1.Resource) error

func (*ProjectParserReconciler) Close 

func (r *ProjectParserReconciler) Close(ctx context.Context) error

func (*ProjectParserReconciler) Reconcile 

func (r *ProjectParserReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*ProjectParserReconciler) ResetState added in v0.34.0 

func (r *ProjectParserReconciler) ResetState(res *runtimev1.Resource) error

func (*ProjectParserReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *ProjectParserReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

type RefreshTriggerReconciler 

type RefreshTriggerReconciler struct {
	C *runtime.Controller
}

RefreshTriggerReconciler reconciles a RefreshTrigger. When a RefreshTrigger is created, the reconciler will refresh source and model by setting Trigger=true in their specs. After that, it will delete the RefreshTrigger resource.

func (*RefreshTriggerReconciler) AssignSpec added in v0.33.0 

func (r *RefreshTriggerReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*RefreshTriggerReconciler) AssignState added in v0.33.0 

func (r *RefreshTriggerReconciler) AssignState(from, to *runtimev1.Resource) error

func (*RefreshTriggerReconciler) Close 

func (r *RefreshTriggerReconciler) Close(ctx context.Context) error

func (*RefreshTriggerReconciler) Reconcile 

func (r *RefreshTriggerReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*RefreshTriggerReconciler) ResetState added in v0.34.0 

func (r *RefreshTriggerReconciler) ResetState(res *runtimev1.Resource) error

func (*RefreshTriggerReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *RefreshTriggerReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

func (*RefreshTriggerReconciler) UpdateModelTrigger added in v0.78.0 

func (r *RefreshTriggerReconciler) UpdateModelTrigger(ctx context.Context, res *runtimev1.Resource, normal, full, partitions bool) error

UpdateModelTrigger sets the Trigger, TriggerFull, or TriggerPartitions spec properties of the model resource based on the provided flags. Note the function only updates to truthy values; only the model reconciler can set these back to false. NOTE: If you edit this logic, also update the checks in newResourceIfModified in project_parser.go accordingly (they need to incorporate triggers in their modified checks).

func (*RefreshTriggerReconciler) UpdateTriggerTrue added in v0.49.0 

func (r *RefreshTriggerReconciler) UpdateTriggerTrue(ctx context.Context, res *runtimev1.Resource) error

UpdateTriggerTrue sets the Trigger spec property of the resource to true. If you're refreshing a model, consider using UpdateModelTrigger directly for more granular control. NOTE: If you edit this logic, also update the checks in newResourceIfModified in project_parser.go accordingly (they need to incorporate triggers in their modified checks).

type ReportReconciler added in v0.36.0 

type ReportReconciler struct {
	C *runtime.Controller
}

func (*ReportReconciler) AssignSpec added in v0.36.0 

func (r *ReportReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*ReportReconciler) AssignState added in v0.36.0 

func (r *ReportReconciler) AssignState(from, to *runtimev1.Resource) error

func (*ReportReconciler) Close added in v0.36.0 

func (r *ReportReconciler) Close(ctx context.Context) error

func (*ReportReconciler) Reconcile added in v0.36.0 

func (r *ReportReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*ReportReconciler) ResetState added in v0.36.0 

func (r *ReportReconciler) ResetState(res *runtimev1.Resource) error

func (*ReportReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *ReportReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

type SourceReconciler 

type SourceReconciler struct {
	C *runtime.Controller
	// contains filtered or unexported fields
}

func (*SourceReconciler) AssignSpec added in v0.33.0 

func (r *SourceReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*SourceReconciler) AssignState added in v0.33.0 

func (r *SourceReconciler) AssignState(from, to *runtimev1.Resource) error

func (*SourceReconciler) Close 

func (r *SourceReconciler) Close(ctx context.Context) error

func (*SourceReconciler) Reconcile 

func (r *SourceReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*SourceReconciler) ResetState added in v0.34.0 

func (r *SourceReconciler) ResetState(res *runtimev1.Resource) error

func (*SourceReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *SourceReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

type ThemeReconciler added in v0.38.0 

type ThemeReconciler struct {
	C *runtime.Controller
}

func (*ThemeReconciler) AssignSpec added in v0.38.0 

func (r *ThemeReconciler) AssignSpec(from, to *runtimev1.Resource) error

func (*ThemeReconciler) AssignState added in v0.38.0 

func (r *ThemeReconciler) AssignState(from, to *runtimev1.Resource) error

func (*ThemeReconciler) Close added in v0.38.0 

func (r *ThemeReconciler) Close(ctx context.Context) error

func (*ThemeReconciler) Reconcile added in v0.38.0 

func (r *ThemeReconciler) Reconcile(ctx context.Context, n *runtimev1.ResourceName) runtime.ReconcileResult

func (*ThemeReconciler) ResetState added in v0.38.0 

func (r *ThemeReconciler) ResetState(res *runtimev1.Resource) error

func (*ThemeReconciler) ResolveTransitiveAccess added in v0.78.0 

func (r *ThemeReconciler) ResolveTransitiveAccess(ctx context.Context, claims *runtime.SecurityClaims, res *runtimev1.Resource) ([]*runtimev1.SecurityRule, error)

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.