v1alpha1

package
v0.5.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Apr 13, 2026 License: Apache-2.0 Imports: 5 Imported by: 0

Documentation

Overview

Package v1alpha1 contains API Schema definitions for the operator v1alpha1 API group +kubebuilder:object:generate=true +groupName=operator.dataverse.redhat.com

Index

Constants

View Source
const (
	SuccessfullyReconciled = "SuccessfullyReconciled"
	ReconcileFailed        = "ReconcileFailed"
)
View Source
const (
	TypeS3                             UnstructuredDataType = "s3"
	DestinationTypeInternalStage       UnstructuredDataType = "snowflakeInternalStage"
	ChunkingStrategyRecursiveCharacter ChunkingStrategy     = "recursiveCharacterTextSplitter"
	ChunkingStrategyMarkdown           ChunkingStrategy     = "markdownTextSplitter"
	ChunkingStrategyToken              ChunkingStrategy     = "tokenTextSplitter"

	UnstructuredDataProductCondition = "UnstructuredDataProductReady"
)
View Source
const (
	ChunksGeneratorCondition = "ChunksGeneratorReady"
)
View Source
const (
	ConfigCondition = "ConfigReady"
)
View Source
const (
	DocumentProcessorCondition = "DocumentProcessorReady"
)
View Source
const (
	SQSInformerCondition = "SQSInformerReady"
)
View Source
const (
	VectorEmbeddingGenerationConditionType = "VectorEmbeddingGenerationReady"
)

Variables

View Source
var (
	// GroupVersion is group version used to register these objects
	GroupVersion = schema.GroupVersion{Group: "operator.dataverse.redhat.com", Version: "v1alpha1"}

	// SchemeBuilder is used to add go types to the GroupVersionKind scheme
	SchemeBuilder = &scheme.Builder{GroupVersion: GroupVersion}

	// AddToScheme adds the types in this group-version to the given scheme.
	AddToScheme = SchemeBuilder.AddToScheme
)

Functions

This section is empty.

Types

type ChunkingStrategy

type ChunkingStrategy string

type ChunksGenerator

type ChunksGenerator struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   ChunksGeneratorSpec   `json:"spec,omitempty"`
	Status ChunksGeneratorStatus `json:"status,omitempty"`
}

ChunksGenerator is the Schema for the chunksgenerators API

func (*ChunksGenerator) DeepCopy

func (in *ChunksGenerator) DeepCopy() *ChunksGenerator

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGenerator.

func (*ChunksGenerator) DeepCopyInto

func (in *ChunksGenerator) DeepCopyInto(out *ChunksGenerator)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*ChunksGenerator) DeepCopyObject

func (in *ChunksGenerator) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

func (*ChunksGenerator) SetWaiting

func (c *ChunksGenerator) SetWaiting()

func (*ChunksGenerator) UpdateStatus

func (c *ChunksGenerator) UpdateStatus(message string, err error)

type ChunksGeneratorConfig

type ChunksGeneratorConfig struct {
	Strategy                         ChunkingStrategy                 `json:"strategy"`
	RecursiveCharacterSplitterConfig RecursiveCharacterSplitterConfig `json:"recursiveCharacterSplitterConfig,omitempty"`
	MarkdownSplitterConfig           MarkdownSplitterConfig           `json:"markdownSplitterConfig,omitempty"`
	TokenSplitterConfig              TokenSplitterConfig              `json:"tokenSplitterConfig,omitempty"`
}

func (*ChunksGeneratorConfig) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGeneratorConfig.

func (*ChunksGeneratorConfig) DeepCopyInto

func (in *ChunksGeneratorConfig) DeepCopyInto(out *ChunksGeneratorConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ChunksGeneratorList

type ChunksGeneratorList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []ChunksGenerator `json:"items"`
}

ChunksGeneratorList contains a list of ChunksGenerator

func (*ChunksGeneratorList) DeepCopy

func (in *ChunksGeneratorList) DeepCopy() *ChunksGeneratorList

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGeneratorList.

func (*ChunksGeneratorList) DeepCopyInto

func (in *ChunksGeneratorList) DeepCopyInto(out *ChunksGeneratorList)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*ChunksGeneratorList) DeepCopyObject

func (in *ChunksGeneratorList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type ChunksGeneratorSpec

type ChunksGeneratorSpec struct {
	DataProduct           string                `json:"dataProduct,omitempty"`
	ChunksGeneratorConfig ChunksGeneratorConfig `json:"config,omitempty"`
}

ChunksGeneratorSpec defines the desired state of ChunksGenerator

func (*ChunksGeneratorSpec) DeepCopy

func (in *ChunksGeneratorSpec) DeepCopy() *ChunksGeneratorSpec

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGeneratorSpec.

func (*ChunksGeneratorSpec) DeepCopyInto

func (in *ChunksGeneratorSpec) DeepCopyInto(out *ChunksGeneratorSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ChunksGeneratorStatus

type ChunksGeneratorStatus struct {
	LastAppliedGeneration int64              `json:"lastAppliedGeneration,omitempty"`
	Conditions            []metav1.Condition `json:"conditions,omitempty"`
}

ChunksGeneratorStatus defines the observed state of ChunksGenerator

func (*ChunksGeneratorStatus) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGeneratorStatus.

func (*ChunksGeneratorStatus) DeepCopyInto

func (in *ChunksGeneratorStatus) DeepCopyInto(out *ChunksGeneratorStatus)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ControllerConfig

type ControllerConfig struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   ControllerConfigSpec   `json:"spec,omitempty"`
	Status ControllerConfigStatus `json:"status,omitempty"`
}

ControllerConfig is the Schema for the controllerconfigs API.

func (*ControllerConfig) DeepCopy

func (in *ControllerConfig) DeepCopy() *ControllerConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ControllerConfig.

func (*ControllerConfig) DeepCopyInto

func (in *ControllerConfig) DeepCopyInto(out *ControllerConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*ControllerConfig) DeepCopyObject

func (in *ControllerConfig) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

func (*ControllerConfig) IsHealthy

func (c *ControllerConfig) IsHealthy() bool

func (*ControllerConfig) SetWaiting

func (c *ControllerConfig) SetWaiting()

func (*ControllerConfig) UpdateStatus

func (c *ControllerConfig) UpdateStatus(err error)

type ControllerConfigList

type ControllerConfigList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []ControllerConfig `json:"items"`
}

ControllerConfigList contains a list of ControllerConfig.

func (*ControllerConfigList) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ControllerConfigList.

func (*ControllerConfigList) DeepCopyInto

func (in *ControllerConfigList) DeepCopyInto(out *ControllerConfigList)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*ControllerConfigList) DeepCopyObject

func (in *ControllerConfigList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type ControllerConfigSpec

type ControllerConfigSpec struct {
	SnowflakeConfig                  *SnowflakeConfig                     `json:"snowflakeConfig,omitempty"`
	UnstructuredSecret               string                               `json:"unstructuredSecret,omitempty"`
	UnstructuredDataProcessingConfig UnstructuredDataProcessingConfigSpec `json:"unstructuredDataProcessingConfig,omitempty"`
}

ControllerConfigSpec defines the desired state of ControllerConfig.

func (*ControllerConfigSpec) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ControllerConfigSpec.

func (*ControllerConfigSpec) DeepCopyInto

func (in *ControllerConfigSpec) DeepCopyInto(out *ControllerConfigSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ControllerConfigStatus

type ControllerConfigStatus struct {
	Conditions            []metav1.Condition `json:"conditions,omitempty"`
	LastAppliedGeneration int64              `json:"lastAppliedGeneration,omitempty"`
}

ControllerConfigStatus defines the observed state of ControllerConfig.

func (*ControllerConfigStatus) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ControllerConfigStatus.

func (*ControllerConfigStatus) DeepCopyInto

func (in *ControllerConfigStatus) DeepCopyInto(out *ControllerConfigStatus)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DestinationConfig

type DestinationConfig struct {
	Type                         UnstructuredDataType         `json:"type,omitempty"`
	SnowflakeInternalStageConfig SnowflakeInternalStageConfig `json:"snowflakeInternalStageConfig,omitempty"`
	S3DestinationConfig          S3Config                     `json:"s3DestinationConfig,omitempty"`
}

DestinationConfig defines where to write processed data (e.g. Snowflake internal stage or S3).

func (*DestinationConfig) DeepCopy

func (in *DestinationConfig) DeepCopy() *DestinationConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DestinationConfig.

func (*DestinationConfig) DeepCopyInto

func (in *DestinationConfig) DeepCopyInto(out *DestinationConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DoclingConfig

type DoclingConfig struct {
	FromFormats     []string `json:"from_formats,omitempty"`
	ToFormats       []string `json:"to_formats,omitempty"`
	ImageExportMode string   `json:"image_export_mode,omitempty"`
	DoOCR           bool     `json:"do_ocr,omitempty"`
	ForceOCR        bool     `json:"force_ocr,omitempty"`
	OCREngine       string   `json:"ocr_engine,omitempty"`
	OCRLang         []string `json:"ocr_lang,omitempty"`
	PDFBackend      string   `json:"pdf_backend,omitempty"`
	TableMode       string   `json:"table_mode,omitempty"`
	AbortOnError    bool     `json:"abort_on_error,omitempty"`
}

func (*DoclingConfig) DeepCopy

func (in *DoclingConfig) DeepCopy() *DoclingConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DoclingConfig.

func (*DoclingConfig) DeepCopyInto

func (in *DoclingConfig) DeepCopyInto(out *DoclingConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DocumentProcessor

type DocumentProcessor struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   DocumentProcessorSpec   `json:"spec,omitempty"`
	Status DocumentProcessorStatus `json:"status,omitempty"`
}

DocumentProcessor is the Schema for the documentprocessors API

func (*DocumentProcessor) AddOrUpdateJob

func (d *DocumentProcessor) AddOrUpdateJob(newJob Job)

func (*DocumentProcessor) AddPermanentlyFailingFile

func (d *DocumentProcessor) AddPermanentlyFailingFile(filePath string)

func (*DocumentProcessor) DeepCopy

func (in *DocumentProcessor) DeepCopy() *DocumentProcessor

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessor.

func (*DocumentProcessor) DeepCopyInto

func (in *DocumentProcessor) DeepCopyInto(out *DocumentProcessor)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*DocumentProcessor) DeepCopyObject

func (in *DocumentProcessor) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

func (*DocumentProcessor) DeleteJobByFilePath

func (d *DocumentProcessor) DeleteJobByFilePath(filePath string)

func (*DocumentProcessor) GetJobByFilePath

func (d *DocumentProcessor) GetJobByFilePath(filePath string) *Job

func (*DocumentProcessor) IsFilePermanentlyFailing

func (d *DocumentProcessor) IsFilePermanentlyFailing(filePath string) bool

func (*DocumentProcessor) SetWaiting

func (d *DocumentProcessor) SetWaiting()

func (*DocumentProcessor) UpdateStatus

func (d *DocumentProcessor) UpdateStatus(message string, err error)

type DocumentProcessorConfig

type DocumentProcessorConfig struct {
	Type          string        `json:"type,omitempty"`
	DoclingConfig DoclingConfig `json:"doclingConfig,omitempty"`
}

func (*DocumentProcessorConfig) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessorConfig.

func (*DocumentProcessorConfig) DeepCopyInto

func (in *DocumentProcessorConfig) DeepCopyInto(out *DocumentProcessorConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DocumentProcessorList

type DocumentProcessorList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []DocumentProcessor `json:"items"`
}

DocumentProcessorList contains a list of DocumentProcessor

func (*DocumentProcessorList) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessorList.

func (*DocumentProcessorList) DeepCopyInto

func (in *DocumentProcessorList) DeepCopyInto(out *DocumentProcessorList)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*DocumentProcessorList) DeepCopyObject

func (in *DocumentProcessorList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type DocumentProcessorSpec

type DocumentProcessorSpec struct {
	DataProduct             string                  `json:"dataProduct,omitempty"`
	DocumentProcessorConfig DocumentProcessorConfig `json:"config,omitempty"`
}

DocumentProcessorSpec defines the desired state of DocumentProcessor

func (*DocumentProcessorSpec) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessorSpec.

func (*DocumentProcessorSpec) DeepCopyInto

func (in *DocumentProcessorSpec) DeepCopyInto(out *DocumentProcessorSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DocumentProcessorStatus

type DocumentProcessorStatus struct {
	LastAppliedGeneration   int64              `json:"lastAppliedGeneration,omitempty"`
	Conditions              []metav1.Condition `json:"conditions,omitempty"`
	Jobs                    []Job              `json:"jobs,omitempty"`
	PermanentlyFailingFiles []string           `json:"permanentlyFailingFiles,omitempty"`
}

DocumentProcessorStatus defines the observed state of DocumentProcessor

func (*DocumentProcessorStatus) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessorStatus.

func (*DocumentProcessorStatus) DeepCopyInto

func (in *DocumentProcessorStatus) DeepCopyInto(out *DocumentProcessorStatus)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type EmbeddingProvider added in v0.2.0

type EmbeddingProvider string

type Job

type Job struct {
	FilePath          string        `json:"filePath,omitempty"`
	DocumentConverter string        `json:"documentConverter,omitempty"`
	DoclingConfig     DoclingConfig `json:"doclingConfig,omitempty"`
	TaskID            string        `json:"taskID,omitempty"`
	Status            string        `json:"status,omitempty"`
	CreatedOn         string        `json:"createdOn,omitempty"`
	Attempts          int           `json:"attempts,omitempty"`
}

func (*Job) DeepCopy

func (in *Job) DeepCopy() *Job

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new Job.

func (*Job) DeepCopyInto

func (in *Job) DeepCopyInto(out *Job)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type MarkdownSplitterConfig

type MarkdownSplitterConfig struct {
	ChunkSize        int  `json:"chunkSize,omitempty"`
	ChunkOverlap     int  `json:"chunkOverlap,omitempty"`
	CodeBlocks       bool `json:"codeBlocks,omitempty"`
	ReferenceLinks   bool `json:"referenceLinks,omitempty"`
	HeadingHierarchy bool `json:"headingHierarchy,omitempty"`
	JoinTableRows    bool `json:"joinTableRows,omitempty"`
}

func (*MarkdownSplitterConfig) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new MarkdownSplitterConfig.

func (*MarkdownSplitterConfig) DeepCopyInto

func (in *MarkdownSplitterConfig) DeepCopyInto(out *MarkdownSplitterConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type NomicEmbedTextV15Config added in v0.2.0

type NomicEmbedTextV15Config struct {
	EncodingFormat string `json:"encodingformat,omitempty"`
}

func (*NomicEmbedTextV15Config) DeepCopy added in v0.2.0

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new NomicEmbedTextV15Config.

func (*NomicEmbedTextV15Config) DeepCopyInto added in v0.2.0

func (in *NomicEmbedTextV15Config) DeepCopyInto(out *NomicEmbedTextV15Config)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type RecursiveCharacterSplitterConfig

type RecursiveCharacterSplitterConfig struct {
	Separators    []string `json:"separators,omitempty"`
	ChunkSize     int      `json:"chunkSize,omitempty"`
	ChunkOverlap  int      `json:"chunkOverlap,omitempty"`
	KeepSeparator bool     `json:"keepSeparator,omitempty"`
}

func (*RecursiveCharacterSplitterConfig) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new RecursiveCharacterSplitterConfig.

func (*RecursiveCharacterSplitterConfig) DeepCopyInto

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type S3Config

type S3Config struct {
	Bucket string `json:"bucket"`
	Prefix string `json:"prefix,omitempty"`
}

S3Config configures an S3 bucket and optional prefix.

func (*S3Config) DeepCopy

func (in *S3Config) DeepCopy() *S3Config

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new S3Config.

func (*S3Config) DeepCopyInto

func (in *S3Config) DeepCopyInto(out *S3Config)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SQSInformer added in v0.2.0

type SQSInformer struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   SQSInformerSpec   `json:"spec,omitempty"`
	Status SQSInformerStatus `json:"status,omitempty"`
}

SQSInformer is the Schema for the sqsinformers API.

func (*SQSInformer) DeepCopy added in v0.2.0

func (in *SQSInformer) DeepCopy() *SQSInformer

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SQSInformer.

func (*SQSInformer) DeepCopyInto added in v0.2.0

func (in *SQSInformer) DeepCopyInto(out *SQSInformer)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*SQSInformer) DeepCopyObject added in v0.2.0

func (in *SQSInformer) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

func (*SQSInformer) SetWaiting added in v0.2.0

func (c *SQSInformer) SetWaiting()

func (*SQSInformer) UpdateStatus added in v0.2.0

func (c *SQSInformer) UpdateStatus(message string, err error)

UpdateStatus updates the status of the SQSInformer CR It takes a message and an error, and updates the status of the CR accordingly If the error is nil, the status is set to True and the message is set to the message If the error is not nil, the status is set to False and the message is set to the message and the error

type SQSInformerList added in v0.2.0

type SQSInformerList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []SQSInformer `json:"items"`
}

SQSInformerList contains a list of SQSInformer.

func (*SQSInformerList) DeepCopy added in v0.2.0

func (in *SQSInformerList) DeepCopy() *SQSInformerList

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SQSInformerList.

func (*SQSInformerList) DeepCopyInto added in v0.2.0

func (in *SQSInformerList) DeepCopyInto(out *SQSInformerList)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*SQSInformerList) DeepCopyObject added in v0.2.0

func (in *SQSInformerList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type SQSInformerSpec added in v0.2.0

type SQSInformerSpec struct {
	QueueURL string `json:"queueURL,omitempty"`
}

SQSInformerSpec defines the desired state of SQSInformer.

func (*SQSInformerSpec) DeepCopy added in v0.2.0

func (in *SQSInformerSpec) DeepCopy() *SQSInformerSpec

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SQSInformerSpec.

func (*SQSInformerSpec) DeepCopyInto added in v0.2.0

func (in *SQSInformerSpec) DeepCopyInto(out *SQSInformerSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SQSInformerStatus added in v0.2.0

type SQSInformerStatus struct {
	LastAppliedGeneration int64              `json:"lastAppliedGeneration,omitempty"`
	Conditions            []metav1.Condition `json:"conditions,omitempty"`
}

SQSInformerStatus defines the observed state of SQSInformer.

func (*SQSInformerStatus) DeepCopy added in v0.2.0

func (in *SQSInformerStatus) DeepCopy() *SQSInformerStatus

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SQSInformerStatus.

func (*SQSInformerStatus) DeepCopyInto added in v0.2.0

func (in *SQSInformerStatus) DeepCopyInto(out *SQSInformerStatus)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SnowflakeConfig

type SnowflakeConfig struct {
	Name      string `json:"name"`
	Account   string `json:"account"`
	User      string `json:"user"`
	Role      string `json:"role"`
	Region    string `json:"region,omitempty"`
	Warehouse string `json:"warehouse"`
}

func (*SnowflakeConfig) DeepCopy

func (in *SnowflakeConfig) DeepCopy() *SnowflakeConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SnowflakeConfig.

func (*SnowflakeConfig) DeepCopyInto

func (in *SnowflakeConfig) DeepCopyInto(out *SnowflakeConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SnowflakeInternalStageConfig

type SnowflakeInternalStageConfig struct {
	Stage    string `json:"stage,omitempty"`
	Database string `json:"database,omitempty"`
	Schema   string `json:"schema,omitempty"`
}

SnowflakeInternalStageConfig configures a Snowflake database schema and internal stage.

func (*SnowflakeInternalStageConfig) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SnowflakeInternalStageConfig.

func (*SnowflakeInternalStageConfig) DeepCopyInto

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SourceConfig

type SourceConfig struct {
	Type     UnstructuredDataType `json:"type,omitempty"`
	S3Config S3Config             `json:"s3Config,omitempty"`
}

SourceConfig defines where to read unstructured data from (e.g. S3).

func (*SourceConfig) DeepCopy

func (in *SourceConfig) DeepCopy() *SourceConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SourceConfig.

func (*SourceConfig) DeepCopyInto

func (in *SourceConfig) DeepCopyInto(out *SourceConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type TokenSplitterConfig

type TokenSplitterConfig struct {
	ChunkSize         int      `json:"chunkSize,omitempty"`
	ChunkOverlap      int      `json:"chunkOverlap,omitempty"`
	ModelName         string   `json:"modelName,omitempty"`
	EncodingName      string   `json:"encodingName,omitempty"`
	AllowedSpecial    []string `json:"allowedSpecial,omitempty"`
	DisallowedSpecial []string `json:"disallowedSpecial,omitempty"`
}

func (*TokenSplitterConfig) DeepCopy

func (in *TokenSplitterConfig) DeepCopy() *TokenSplitterConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new TokenSplitterConfig.

func (*TokenSplitterConfig) DeepCopyInto

func (in *TokenSplitterConfig) DeepCopyInto(out *TokenSplitterConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type UnstructuredDataProcessingConfigSpec

type UnstructuredDataProcessingConfigSpec struct {
	MaxConcurrentDoclingTasks   int `json:"maxConcurrentDoclingTasks,omitempty"`
	MaxConcurrentLangchainTasks int `json:"maxConcurrentLangchainTasks,omitempty"`

	IngestionBucket string `json:"ingestionBucket,omitempty"`
	DoclingServeURL string `json:"doclingServeURL,omitempty"`

	CacheDirectory    string `json:"cacheDirectory,omitempty"`
	DataStorageBucket string `json:"dataStorageBucket,omitempty"`
}

func (*UnstructuredDataProcessingConfigSpec) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProcessingConfigSpec.

func (*UnstructuredDataProcessingConfigSpec) DeepCopyInto

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type UnstructuredDataProduct

type UnstructuredDataProduct struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   UnstructuredDataProductSpec   `json:"spec,omitempty"`
	Status UnstructuredDataProductStatus `json:"status,omitempty"`
}

UnstructuredDataProduct is the Schema for the unstructureddataproducts API

func (*UnstructuredDataProduct) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProduct.

func (*UnstructuredDataProduct) DeepCopyInto

func (in *UnstructuredDataProduct) DeepCopyInto(out *UnstructuredDataProduct)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*UnstructuredDataProduct) DeepCopyObject

func (in *UnstructuredDataProduct) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

func (*UnstructuredDataProduct) SetWaiting

func (u *UnstructuredDataProduct) SetWaiting()

func (*UnstructuredDataProduct) UpdateStatus

func (u *UnstructuredDataProduct) UpdateStatus(message string, err error)

type UnstructuredDataProductList

type UnstructuredDataProductList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []UnstructuredDataProduct `json:"items"`
}

UnstructuredDataProductList contains a list of UnstructuredDataProduct

func (*UnstructuredDataProductList) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProductList.

func (*UnstructuredDataProductList) DeepCopyInto

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*UnstructuredDataProductList) DeepCopyObject

func (in *UnstructuredDataProductList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type UnstructuredDataProductSpec

type UnstructuredDataProductSpec struct {
	SourceConfig                    SourceConfig                    `json:"sourceConfig,omitempty"`
	DestinationConfig               DestinationConfig               `json:"destinationConfig,omitempty"`
	DocumentProcessorConfig         DocumentProcessorConfig         `json:"documentProcessorConfig,omitempty"`
	ChunksGeneratorConfig           ChunksGeneratorConfig           `json:"chunksGeneratorConfig,omitempty"`
	VectorEmbeddingsGeneratorConfig VectorEmbeddingsGeneratorConfig `json:"vectorEmbeddingsGeneratorConfig,omitempty"`
}

UnstructuredDataProductSpec defines the desired state of UnstructuredDataProduct

func (*UnstructuredDataProductSpec) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProductSpec.

func (*UnstructuredDataProductSpec) DeepCopyInto

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type UnstructuredDataProductStatus

type UnstructuredDataProductStatus struct {
	LastAppliedGeneration int64              `json:"lastAppliedGeneration,omitempty"`
	Conditions            []metav1.Condition `json:"conditions,omitempty"`
}

UnstructuredDataProductStatus defines the observed state of UnstructuredDataProduct

func (*UnstructuredDataProductStatus) DeepCopy

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProductStatus.

func (*UnstructuredDataProductStatus) DeepCopyInto

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type UnstructuredDataType added in v0.2.0

type UnstructuredDataType string

type VectorEmbeddingsGenerator added in v0.2.0

type VectorEmbeddingsGenerator struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   VectorEmbeddingsGeneratorSpec   `json:"spec,omitempty"`
	Status VectorEmbeddingsGeneratorStatus `json:"status,omitempty"`
}

VectorEmbeddingsGenerator is the Schema for the vectorembeddingsgenerators API.

func (*VectorEmbeddingsGenerator) DeepCopy added in v0.2.0

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new VectorEmbeddingsGenerator.

func (*VectorEmbeddingsGenerator) DeepCopyInto added in v0.2.0

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*VectorEmbeddingsGenerator) DeepCopyObject added in v0.2.0

func (in *VectorEmbeddingsGenerator) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

func (*VectorEmbeddingsGenerator) SetWaiting added in v0.2.0

func (c *VectorEmbeddingsGenerator) SetWaiting()

func (*VectorEmbeddingsGenerator) UpdateStatus added in v0.2.0

func (c *VectorEmbeddingsGenerator) UpdateStatus(message string, err error)

type VectorEmbeddingsGeneratorConfig added in v0.2.0

type VectorEmbeddingsGeneratorConfig struct {
	ModelName               string                  `json:"modelName,omitempty"`
	NomicEmbedTextV15Config NomicEmbedTextV15Config `json:"nomicEmbedTextV15Config,omitempty"`
}

func (*VectorEmbeddingsGeneratorConfig) DeepCopy added in v0.2.0

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new VectorEmbeddingsGeneratorConfig.

func (*VectorEmbeddingsGeneratorConfig) DeepCopyInto added in v0.2.0

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type VectorEmbeddingsGeneratorList added in v0.2.0

type VectorEmbeddingsGeneratorList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []VectorEmbeddingsGenerator `json:"items"`
}

VectorEmbeddingsGeneratorList contains a list of VectorEmbeddingsGenerator.

func (*VectorEmbeddingsGeneratorList) DeepCopy added in v0.2.0

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new VectorEmbeddingsGeneratorList.

func (*VectorEmbeddingsGeneratorList) DeepCopyInto added in v0.2.0

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*VectorEmbeddingsGeneratorList) DeepCopyObject added in v0.2.0

func (in *VectorEmbeddingsGeneratorList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type VectorEmbeddingsGeneratorSpec added in v0.2.0

type VectorEmbeddingsGeneratorSpec struct {
	DataProduct                     string                          `json:"dataProduct,omitempty"`
	VectorEmbeddingsGeneratorConfig VectorEmbeddingsGeneratorConfig `json:"embeddingGeneratorConfig,omitempty"`
}

VectorEmbeddingsGeneratorSpec defines the desired state of VectorEmbeddingsGenerator.

func (*VectorEmbeddingsGeneratorSpec) DeepCopy added in v0.2.0

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new VectorEmbeddingsGeneratorSpec.

func (*VectorEmbeddingsGeneratorSpec) DeepCopyInto added in v0.2.0

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type VectorEmbeddingsGeneratorStatus added in v0.2.0

type VectorEmbeddingsGeneratorStatus struct {
	LastAppliedGeneration int64              `json:"lastAppliedGeneration,omitempty"`
	Conditions            []metav1.Condition `json:"conditions,omitempty"`
}

VectorEmbeddingsGeneratorStatus defines the observed state of VectorEmbeddingsGenerator.

func (*VectorEmbeddingsGeneratorStatus) DeepCopy added in v0.2.0

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new VectorEmbeddingsGeneratorStatus.

func (*VectorEmbeddingsGeneratorStatus) DeepCopyInto added in v0.2.0

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL