Documentation
¶
Overview ¶
Package v1alpha1 contains API Schema definitions for the operator v1alpha1 API group +kubebuilder:object:generate=true +groupName=operator.dataverse.redhat.com
Index ¶
- Constants
- Variables
- type ChunkingStrategy
- type ChunksGenerator
- type ChunksGeneratorConfig
- type ChunksGeneratorList
- type ChunksGeneratorSpec
- type ChunksGeneratorStatus
- type ControllerConfig
- func (in *ControllerConfig) DeepCopy() *ControllerConfig
- func (in *ControllerConfig) DeepCopyInto(out *ControllerConfig)
- func (in *ControllerConfig) DeepCopyObject() runtime.Object
- func (c *ControllerConfig) IsHealthy() bool
- func (c *ControllerConfig) SetWaiting()
- func (c *ControllerConfig) UpdateStatus(err error)
- type ControllerConfigList
- type ControllerConfigSpec
- type ControllerConfigStatus
- type DestinationConfig
- type DoclingConfig
- type DocumentProcessor
- func (d *DocumentProcessor) AddOrUpdateJob(newJob Job)
- func (d *DocumentProcessor) AddPermanentlyFailingFile(filePath string)
- func (in *DocumentProcessor) DeepCopy() *DocumentProcessor
- func (in *DocumentProcessor) DeepCopyInto(out *DocumentProcessor)
- func (in *DocumentProcessor) DeepCopyObject() runtime.Object
- func (d *DocumentProcessor) DeleteJobByFilePath(filePath string)
- func (d *DocumentProcessor) GetJobByFilePath(filePath string) *Job
- func (d *DocumentProcessor) IsFilePermanentlyFailing(filePath string) bool
- func (d *DocumentProcessor) SetWaiting()
- func (d *DocumentProcessor) UpdateStatus(message string, err error)
- type DocumentProcessorConfig
- type DocumentProcessorList
- type DocumentProcessorSpec
- type DocumentProcessorStatus
- type EmbeddingProvider
- type Job
- type MarkdownSplitterConfig
- type NomicEmbedTextV15Config
- type RecursiveCharacterSplitterConfig
- type S3Config
- type SQSInformer
- type SQSInformerList
- type SQSInformerSpec
- type SQSInformerStatus
- type SnowflakeConfig
- type SnowflakeInternalStageConfig
- type SourceConfig
- type TokenSplitterConfig
- type UnstructuredDataProcessingConfigSpec
- type UnstructuredDataProduct
- func (in *UnstructuredDataProduct) DeepCopy() *UnstructuredDataProduct
- func (in *UnstructuredDataProduct) DeepCopyInto(out *UnstructuredDataProduct)
- func (in *UnstructuredDataProduct) DeepCopyObject() runtime.Object
- func (u *UnstructuredDataProduct) SetWaiting()
- func (u *UnstructuredDataProduct) UpdateStatus(message string, err error)
- type UnstructuredDataProductList
- type UnstructuredDataProductSpec
- type UnstructuredDataProductStatus
- type UnstructuredDataType
- type VectorEmbeddingsGenerator
- func (in *VectorEmbeddingsGenerator) DeepCopy() *VectorEmbeddingsGenerator
- func (in *VectorEmbeddingsGenerator) DeepCopyInto(out *VectorEmbeddingsGenerator)
- func (in *VectorEmbeddingsGenerator) DeepCopyObject() runtime.Object
- func (c *VectorEmbeddingsGenerator) SetWaiting()
- func (c *VectorEmbeddingsGenerator) UpdateStatus(message string, err error)
- type VectorEmbeddingsGeneratorConfig
- type VectorEmbeddingsGeneratorList
- type VectorEmbeddingsGeneratorSpec
- type VectorEmbeddingsGeneratorStatus
Constants ¶
const ( SuccessfullyReconciled = "SuccessfullyReconciled" ReconcileFailed = "ReconcileFailed" )
const ( TypeS3 UnstructuredDataType = "s3" DestinationTypeInternalStage UnstructuredDataType = "snowflakeInternalStage" ChunkingStrategyRecursiveCharacter ChunkingStrategy = "recursiveCharacterTextSplitter" ChunkingStrategyMarkdown ChunkingStrategy = "markdownTextSplitter" ChunkingStrategyToken ChunkingStrategy = "tokenTextSplitter" UnstructuredDataProductCondition = "UnstructuredDataProductReady" )
const (
ChunksGeneratorCondition = "ChunksGeneratorReady"
)
const (
ConfigCondition = "ConfigReady"
)
const (
DocumentProcessorCondition = "DocumentProcessorReady"
)
const (
SQSInformerCondition = "SQSInformerReady"
)
const (
VectorEmbeddingGenerationConditionType = "VectorEmbeddingGenerationReady"
)
Variables ¶
var ( // GroupVersion is group version used to register these objects GroupVersion = schema.GroupVersion{Group: "operator.dataverse.redhat.com", Version: "v1alpha1"} // SchemeBuilder is used to add go types to the GroupVersionKind scheme SchemeBuilder = &scheme.Builder{GroupVersion: GroupVersion} // AddToScheme adds the types in this group-version to the given scheme. AddToScheme = SchemeBuilder.AddToScheme )
Functions ¶
This section is empty.
Types ¶
type ChunkingStrategy ¶
type ChunkingStrategy string
type ChunksGenerator ¶
type ChunksGenerator struct {
metav1.TypeMeta `json:",inline"`
metav1.ObjectMeta `json:"metadata,omitempty"`
Spec ChunksGeneratorSpec `json:"spec,omitempty"`
Status ChunksGeneratorStatus `json:"status,omitempty"`
}
ChunksGenerator is the Schema for the chunksgenerators API
func (*ChunksGenerator) DeepCopy ¶
func (in *ChunksGenerator) DeepCopy() *ChunksGenerator
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGenerator.
func (*ChunksGenerator) DeepCopyInto ¶
func (in *ChunksGenerator) DeepCopyInto(out *ChunksGenerator)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
func (*ChunksGenerator) DeepCopyObject ¶
func (in *ChunksGenerator) DeepCopyObject() runtime.Object
DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.
func (*ChunksGenerator) SetWaiting ¶
func (c *ChunksGenerator) SetWaiting()
func (*ChunksGenerator) UpdateStatus ¶
func (c *ChunksGenerator) UpdateStatus(message string, err error)
type ChunksGeneratorConfig ¶
type ChunksGeneratorConfig struct {
Strategy ChunkingStrategy `json:"strategy"`
RecursiveCharacterSplitterConfig RecursiveCharacterSplitterConfig `json:"recursiveCharacterSplitterConfig,omitempty"`
MarkdownSplitterConfig MarkdownSplitterConfig `json:"markdownSplitterConfig,omitempty"`
TokenSplitterConfig TokenSplitterConfig `json:"tokenSplitterConfig,omitempty"`
}
func (*ChunksGeneratorConfig) DeepCopy ¶
func (in *ChunksGeneratorConfig) DeepCopy() *ChunksGeneratorConfig
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGeneratorConfig.
func (*ChunksGeneratorConfig) DeepCopyInto ¶
func (in *ChunksGeneratorConfig) DeepCopyInto(out *ChunksGeneratorConfig)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type ChunksGeneratorList ¶
type ChunksGeneratorList struct {
metav1.TypeMeta `json:",inline"`
metav1.ListMeta `json:"metadata,omitempty"`
Items []ChunksGenerator `json:"items"`
}
ChunksGeneratorList contains a list of ChunksGenerator
func (*ChunksGeneratorList) DeepCopy ¶
func (in *ChunksGeneratorList) DeepCopy() *ChunksGeneratorList
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGeneratorList.
func (*ChunksGeneratorList) DeepCopyInto ¶
func (in *ChunksGeneratorList) DeepCopyInto(out *ChunksGeneratorList)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
func (*ChunksGeneratorList) DeepCopyObject ¶
func (in *ChunksGeneratorList) DeepCopyObject() runtime.Object
DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.
type ChunksGeneratorSpec ¶
type ChunksGeneratorSpec struct {
DataProduct string `json:"dataProduct,omitempty"`
ChunksGeneratorConfig ChunksGeneratorConfig `json:"config,omitempty"`
}
ChunksGeneratorSpec defines the desired state of ChunksGenerator
func (*ChunksGeneratorSpec) DeepCopy ¶
func (in *ChunksGeneratorSpec) DeepCopy() *ChunksGeneratorSpec
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGeneratorSpec.
func (*ChunksGeneratorSpec) DeepCopyInto ¶
func (in *ChunksGeneratorSpec) DeepCopyInto(out *ChunksGeneratorSpec)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type ChunksGeneratorStatus ¶
type ChunksGeneratorStatus struct {
LastAppliedGeneration int64 `json:"lastAppliedGeneration,omitempty"`
Conditions []metav1.Condition `json:"conditions,omitempty"`
}
ChunksGeneratorStatus defines the observed state of ChunksGenerator
func (*ChunksGeneratorStatus) DeepCopy ¶
func (in *ChunksGeneratorStatus) DeepCopy() *ChunksGeneratorStatus
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGeneratorStatus.
func (*ChunksGeneratorStatus) DeepCopyInto ¶
func (in *ChunksGeneratorStatus) DeepCopyInto(out *ChunksGeneratorStatus)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type ControllerConfig ¶
type ControllerConfig struct {
metav1.TypeMeta `json:",inline"`
metav1.ObjectMeta `json:"metadata,omitempty"`
Spec ControllerConfigSpec `json:"spec,omitempty"`
Status ControllerConfigStatus `json:"status,omitempty"`
}
ControllerConfig is the Schema for the controllerconfigs API.
func (*ControllerConfig) DeepCopy ¶
func (in *ControllerConfig) DeepCopy() *ControllerConfig
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ControllerConfig.
func (*ControllerConfig) DeepCopyInto ¶
func (in *ControllerConfig) DeepCopyInto(out *ControllerConfig)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
func (*ControllerConfig) DeepCopyObject ¶
func (in *ControllerConfig) DeepCopyObject() runtime.Object
DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.
func (*ControllerConfig) IsHealthy ¶
func (c *ControllerConfig) IsHealthy() bool
func (*ControllerConfig) SetWaiting ¶
func (c *ControllerConfig) SetWaiting()
func (*ControllerConfig) UpdateStatus ¶
func (c *ControllerConfig) UpdateStatus(err error)
type ControllerConfigList ¶
type ControllerConfigList struct {
metav1.TypeMeta `json:",inline"`
metav1.ListMeta `json:"metadata,omitempty"`
Items []ControllerConfig `json:"items"`
}
ControllerConfigList contains a list of ControllerConfig.
func (*ControllerConfigList) DeepCopy ¶
func (in *ControllerConfigList) DeepCopy() *ControllerConfigList
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ControllerConfigList.
func (*ControllerConfigList) DeepCopyInto ¶
func (in *ControllerConfigList) DeepCopyInto(out *ControllerConfigList)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
func (*ControllerConfigList) DeepCopyObject ¶
func (in *ControllerConfigList) DeepCopyObject() runtime.Object
DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.
type ControllerConfigSpec ¶
type ControllerConfigSpec struct {
SnowflakeConfig *SnowflakeConfig `json:"snowflakeConfig,omitempty"`
UnstructuredSecret string `json:"unstructuredSecret,omitempty"`
UnstructuredDataProcessingConfig UnstructuredDataProcessingConfigSpec `json:"unstructuredDataProcessingConfig,omitempty"`
}
ControllerConfigSpec defines the desired state of ControllerConfig.
func (*ControllerConfigSpec) DeepCopy ¶
func (in *ControllerConfigSpec) DeepCopy() *ControllerConfigSpec
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ControllerConfigSpec.
func (*ControllerConfigSpec) DeepCopyInto ¶
func (in *ControllerConfigSpec) DeepCopyInto(out *ControllerConfigSpec)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type ControllerConfigStatus ¶
type ControllerConfigStatus struct {
Conditions []metav1.Condition `json:"conditions,omitempty"`
LastAppliedGeneration int64 `json:"lastAppliedGeneration,omitempty"`
}
ControllerConfigStatus defines the observed state of ControllerConfig.
func (*ControllerConfigStatus) DeepCopy ¶
func (in *ControllerConfigStatus) DeepCopy() *ControllerConfigStatus
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ControllerConfigStatus.
func (*ControllerConfigStatus) DeepCopyInto ¶
func (in *ControllerConfigStatus) DeepCopyInto(out *ControllerConfigStatus)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type DestinationConfig ¶
type DestinationConfig struct {
Type UnstructuredDataType `json:"type,omitempty"`
SnowflakeInternalStageConfig SnowflakeInternalStageConfig `json:"snowflakeInternalStageConfig,omitempty"`
S3DestinationConfig S3Config `json:"s3DestinationConfig,omitempty"`
}
DestinationConfig defines where to write processed data (e.g. Snowflake internal stage or S3).
func (*DestinationConfig) DeepCopy ¶
func (in *DestinationConfig) DeepCopy() *DestinationConfig
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DestinationConfig.
func (*DestinationConfig) DeepCopyInto ¶
func (in *DestinationConfig) DeepCopyInto(out *DestinationConfig)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type DoclingConfig ¶
type DoclingConfig struct {
FromFormats []string `json:"from_formats,omitempty"`
ToFormats []string `json:"to_formats,omitempty"`
ImageExportMode string `json:"image_export_mode,omitempty"`
DoOCR bool `json:"do_ocr,omitempty"`
ForceOCR bool `json:"force_ocr,omitempty"`
OCREngine string `json:"ocr_engine,omitempty"`
OCRLang []string `json:"ocr_lang,omitempty"`
PDFBackend string `json:"pdf_backend,omitempty"`
TableMode string `json:"table_mode,omitempty"`
AbortOnError bool `json:"abort_on_error,omitempty"`
}
func (*DoclingConfig) DeepCopy ¶
func (in *DoclingConfig) DeepCopy() *DoclingConfig
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DoclingConfig.
func (*DoclingConfig) DeepCopyInto ¶
func (in *DoclingConfig) DeepCopyInto(out *DoclingConfig)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type DocumentProcessor ¶
type DocumentProcessor struct {
metav1.TypeMeta `json:",inline"`
metav1.ObjectMeta `json:"metadata,omitempty"`
Spec DocumentProcessorSpec `json:"spec,omitempty"`
Status DocumentProcessorStatus `json:"status,omitempty"`
}
DocumentProcessor is the Schema for the documentprocessors API
func (*DocumentProcessor) AddOrUpdateJob ¶
func (d *DocumentProcessor) AddOrUpdateJob(newJob Job)
func (*DocumentProcessor) AddPermanentlyFailingFile ¶
func (d *DocumentProcessor) AddPermanentlyFailingFile(filePath string)
func (*DocumentProcessor) DeepCopy ¶
func (in *DocumentProcessor) DeepCopy() *DocumentProcessor
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessor.
func (*DocumentProcessor) DeepCopyInto ¶
func (in *DocumentProcessor) DeepCopyInto(out *DocumentProcessor)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
func (*DocumentProcessor) DeepCopyObject ¶
func (in *DocumentProcessor) DeepCopyObject() runtime.Object
DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.
func (*DocumentProcessor) DeleteJobByFilePath ¶
func (d *DocumentProcessor) DeleteJobByFilePath(filePath string)
func (*DocumentProcessor) GetJobByFilePath ¶
func (d *DocumentProcessor) GetJobByFilePath(filePath string) *Job
func (*DocumentProcessor) IsFilePermanentlyFailing ¶
func (d *DocumentProcessor) IsFilePermanentlyFailing(filePath string) bool
func (*DocumentProcessor) SetWaiting ¶
func (d *DocumentProcessor) SetWaiting()
func (*DocumentProcessor) UpdateStatus ¶
func (d *DocumentProcessor) UpdateStatus(message string, err error)
type DocumentProcessorConfig ¶
type DocumentProcessorConfig struct {
Type string `json:"type,omitempty"`
DoclingConfig DoclingConfig `json:"doclingConfig,omitempty"`
}
func (*DocumentProcessorConfig) DeepCopy ¶
func (in *DocumentProcessorConfig) DeepCopy() *DocumentProcessorConfig
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessorConfig.
func (*DocumentProcessorConfig) DeepCopyInto ¶
func (in *DocumentProcessorConfig) DeepCopyInto(out *DocumentProcessorConfig)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type DocumentProcessorList ¶
type DocumentProcessorList struct {
metav1.TypeMeta `json:",inline"`
metav1.ListMeta `json:"metadata,omitempty"`
Items []DocumentProcessor `json:"items"`
}
DocumentProcessorList contains a list of DocumentProcessor
func (*DocumentProcessorList) DeepCopy ¶
func (in *DocumentProcessorList) DeepCopy() *DocumentProcessorList
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessorList.
func (*DocumentProcessorList) DeepCopyInto ¶
func (in *DocumentProcessorList) DeepCopyInto(out *DocumentProcessorList)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
func (*DocumentProcessorList) DeepCopyObject ¶
func (in *DocumentProcessorList) DeepCopyObject() runtime.Object
DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.
type DocumentProcessorSpec ¶
type DocumentProcessorSpec struct {
DataProduct string `json:"dataProduct,omitempty"`
DocumentProcessorConfig DocumentProcessorConfig `json:"config,omitempty"`
}
DocumentProcessorSpec defines the desired state of DocumentProcessor
func (*DocumentProcessorSpec) DeepCopy ¶
func (in *DocumentProcessorSpec) DeepCopy() *DocumentProcessorSpec
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessorSpec.
func (*DocumentProcessorSpec) DeepCopyInto ¶
func (in *DocumentProcessorSpec) DeepCopyInto(out *DocumentProcessorSpec)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type DocumentProcessorStatus ¶
type DocumentProcessorStatus struct {
LastAppliedGeneration int64 `json:"lastAppliedGeneration,omitempty"`
Conditions []metav1.Condition `json:"conditions,omitempty"`
Jobs []Job `json:"jobs,omitempty"`
PermanentlyFailingFiles []string `json:"permanentlyFailingFiles,omitempty"`
}
DocumentProcessorStatus defines the observed state of DocumentProcessor
func (*DocumentProcessorStatus) DeepCopy ¶
func (in *DocumentProcessorStatus) DeepCopy() *DocumentProcessorStatus
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessorStatus.
func (*DocumentProcessorStatus) DeepCopyInto ¶
func (in *DocumentProcessorStatus) DeepCopyInto(out *DocumentProcessorStatus)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type EmbeddingProvider ¶ added in v0.2.0
type EmbeddingProvider string
type Job ¶
type Job struct {
FilePath string `json:"filePath,omitempty"`
DocumentConverter string `json:"documentConverter,omitempty"`
DoclingConfig DoclingConfig `json:"doclingConfig,omitempty"`
TaskID string `json:"taskID,omitempty"`
Status string `json:"status,omitempty"`
CreatedOn string `json:"createdOn,omitempty"`
Attempts int `json:"attempts,omitempty"`
}
func (*Job) DeepCopy ¶
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new Job.
func (*Job) DeepCopyInto ¶
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type MarkdownSplitterConfig ¶
type MarkdownSplitterConfig struct {
ChunkSize int `json:"chunkSize,omitempty"`
ChunkOverlap int `json:"chunkOverlap,omitempty"`
CodeBlocks bool `json:"codeBlocks,omitempty"`
ReferenceLinks bool `json:"referenceLinks,omitempty"`
HeadingHierarchy bool `json:"headingHierarchy,omitempty"`
JoinTableRows bool `json:"joinTableRows,omitempty"`
}
func (*MarkdownSplitterConfig) DeepCopy ¶
func (in *MarkdownSplitterConfig) DeepCopy() *MarkdownSplitterConfig
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new MarkdownSplitterConfig.
func (*MarkdownSplitterConfig) DeepCopyInto ¶
func (in *MarkdownSplitterConfig) DeepCopyInto(out *MarkdownSplitterConfig)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type NomicEmbedTextV15Config ¶ added in v0.2.0
type NomicEmbedTextV15Config struct {
EncodingFormat string `json:"encodingformat,omitempty"`
}
func (*NomicEmbedTextV15Config) DeepCopy ¶ added in v0.2.0
func (in *NomicEmbedTextV15Config) DeepCopy() *NomicEmbedTextV15Config
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new NomicEmbedTextV15Config.
func (*NomicEmbedTextV15Config) DeepCopyInto ¶ added in v0.2.0
func (in *NomicEmbedTextV15Config) DeepCopyInto(out *NomicEmbedTextV15Config)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type RecursiveCharacterSplitterConfig ¶
type RecursiveCharacterSplitterConfig struct {
Separators []string `json:"separators,omitempty"`
ChunkSize int `json:"chunkSize,omitempty"`
ChunkOverlap int `json:"chunkOverlap,omitempty"`
KeepSeparator bool `json:"keepSeparator,omitempty"`
}
func (*RecursiveCharacterSplitterConfig) DeepCopy ¶
func (in *RecursiveCharacterSplitterConfig) DeepCopy() *RecursiveCharacterSplitterConfig
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new RecursiveCharacterSplitterConfig.
func (*RecursiveCharacterSplitterConfig) DeepCopyInto ¶
func (in *RecursiveCharacterSplitterConfig) DeepCopyInto(out *RecursiveCharacterSplitterConfig)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type S3Config ¶
S3Config configures an S3 bucket and optional prefix.
func (*S3Config) DeepCopy ¶
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new S3Config.
func (*S3Config) DeepCopyInto ¶
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type SQSInformer ¶ added in v0.2.0
type SQSInformer struct {
metav1.TypeMeta `json:",inline"`
metav1.ObjectMeta `json:"metadata,omitempty"`
Spec SQSInformerSpec `json:"spec,omitempty"`
Status SQSInformerStatus `json:"status,omitempty"`
}
SQSInformer is the Schema for the sqsinformers API.
func (*SQSInformer) DeepCopy ¶ added in v0.2.0
func (in *SQSInformer) DeepCopy() *SQSInformer
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SQSInformer.
func (*SQSInformer) DeepCopyInto ¶ added in v0.2.0
func (in *SQSInformer) DeepCopyInto(out *SQSInformer)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
func (*SQSInformer) DeepCopyObject ¶ added in v0.2.0
func (in *SQSInformer) DeepCopyObject() runtime.Object
DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.
func (*SQSInformer) SetWaiting ¶ added in v0.2.0
func (c *SQSInformer) SetWaiting()
func (*SQSInformer) UpdateStatus ¶ added in v0.2.0
func (c *SQSInformer) UpdateStatus(message string, err error)
UpdateStatus updates the status of the SQSInformer CR It takes a message and an error, and updates the status of the CR accordingly If the error is nil, the status is set to True and the message is set to the message If the error is not nil, the status is set to False and the message is set to the message and the error
type SQSInformerList ¶ added in v0.2.0
type SQSInformerList struct {
metav1.TypeMeta `json:",inline"`
metav1.ListMeta `json:"metadata,omitempty"`
Items []SQSInformer `json:"items"`
}
SQSInformerList contains a list of SQSInformer.
func (*SQSInformerList) DeepCopy ¶ added in v0.2.0
func (in *SQSInformerList) DeepCopy() *SQSInformerList
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SQSInformerList.
func (*SQSInformerList) DeepCopyInto ¶ added in v0.2.0
func (in *SQSInformerList) DeepCopyInto(out *SQSInformerList)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
func (*SQSInformerList) DeepCopyObject ¶ added in v0.2.0
func (in *SQSInformerList) DeepCopyObject() runtime.Object
DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.
type SQSInformerSpec ¶ added in v0.2.0
type SQSInformerSpec struct {
QueueURL string `json:"queueURL,omitempty"`
}
SQSInformerSpec defines the desired state of SQSInformer.
func (*SQSInformerSpec) DeepCopy ¶ added in v0.2.0
func (in *SQSInformerSpec) DeepCopy() *SQSInformerSpec
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SQSInformerSpec.
func (*SQSInformerSpec) DeepCopyInto ¶ added in v0.2.0
func (in *SQSInformerSpec) DeepCopyInto(out *SQSInformerSpec)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type SQSInformerStatus ¶ added in v0.2.0
type SQSInformerStatus struct {
LastAppliedGeneration int64 `json:"lastAppliedGeneration,omitempty"`
Conditions []metav1.Condition `json:"conditions,omitempty"`
}
SQSInformerStatus defines the observed state of SQSInformer.
func (*SQSInformerStatus) DeepCopy ¶ added in v0.2.0
func (in *SQSInformerStatus) DeepCopy() *SQSInformerStatus
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SQSInformerStatus.
func (*SQSInformerStatus) DeepCopyInto ¶ added in v0.2.0
func (in *SQSInformerStatus) DeepCopyInto(out *SQSInformerStatus)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type SnowflakeConfig ¶
type SnowflakeConfig struct {
Name string `json:"name"`
Account string `json:"account"`
User string `json:"user"`
Role string `json:"role"`
Region string `json:"region,omitempty"`
Warehouse string `json:"warehouse"`
}
func (*SnowflakeConfig) DeepCopy ¶
func (in *SnowflakeConfig) DeepCopy() *SnowflakeConfig
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SnowflakeConfig.
func (*SnowflakeConfig) DeepCopyInto ¶
func (in *SnowflakeConfig) DeepCopyInto(out *SnowflakeConfig)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type SnowflakeInternalStageConfig ¶
type SnowflakeInternalStageConfig struct {
Stage string `json:"stage,omitempty"`
Database string `json:"database,omitempty"`
Schema string `json:"schema,omitempty"`
}
SnowflakeInternalStageConfig configures a Snowflake database schema and internal stage.
func (*SnowflakeInternalStageConfig) DeepCopy ¶
func (in *SnowflakeInternalStageConfig) DeepCopy() *SnowflakeInternalStageConfig
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SnowflakeInternalStageConfig.
func (*SnowflakeInternalStageConfig) DeepCopyInto ¶
func (in *SnowflakeInternalStageConfig) DeepCopyInto(out *SnowflakeInternalStageConfig)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type SourceConfig ¶
type SourceConfig struct {
Type UnstructuredDataType `json:"type,omitempty"`
S3Config S3Config `json:"s3Config,omitempty"`
}
SourceConfig defines where to read unstructured data from (e.g. S3).
func (*SourceConfig) DeepCopy ¶
func (in *SourceConfig) DeepCopy() *SourceConfig
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SourceConfig.
func (*SourceConfig) DeepCopyInto ¶
func (in *SourceConfig) DeepCopyInto(out *SourceConfig)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type TokenSplitterConfig ¶
type TokenSplitterConfig struct {
ChunkSize int `json:"chunkSize,omitempty"`
ChunkOverlap int `json:"chunkOverlap,omitempty"`
ModelName string `json:"modelName,omitempty"`
EncodingName string `json:"encodingName,omitempty"`
AllowedSpecial []string `json:"allowedSpecial,omitempty"`
DisallowedSpecial []string `json:"disallowedSpecial,omitempty"`
}
func (*TokenSplitterConfig) DeepCopy ¶
func (in *TokenSplitterConfig) DeepCopy() *TokenSplitterConfig
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new TokenSplitterConfig.
func (*TokenSplitterConfig) DeepCopyInto ¶
func (in *TokenSplitterConfig) DeepCopyInto(out *TokenSplitterConfig)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type UnstructuredDataProcessingConfigSpec ¶
type UnstructuredDataProcessingConfigSpec struct {
MaxConcurrentDoclingTasks int `json:"maxConcurrentDoclingTasks,omitempty"`
MaxConcurrentLangchainTasks int `json:"maxConcurrentLangchainTasks,omitempty"`
IngestionBucket string `json:"ingestionBucket,omitempty"`
DoclingServeURL string `json:"doclingServeURL,omitempty"`
CacheDirectory string `json:"cacheDirectory,omitempty"`
DataStorageBucket string `json:"dataStorageBucket,omitempty"`
}
func (*UnstructuredDataProcessingConfigSpec) DeepCopy ¶
func (in *UnstructuredDataProcessingConfigSpec) DeepCopy() *UnstructuredDataProcessingConfigSpec
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProcessingConfigSpec.
func (*UnstructuredDataProcessingConfigSpec) DeepCopyInto ¶
func (in *UnstructuredDataProcessingConfigSpec) DeepCopyInto(out *UnstructuredDataProcessingConfigSpec)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type UnstructuredDataProduct ¶
type UnstructuredDataProduct struct {
metav1.TypeMeta `json:",inline"`
metav1.ObjectMeta `json:"metadata,omitempty"`
Spec UnstructuredDataProductSpec `json:"spec,omitempty"`
Status UnstructuredDataProductStatus `json:"status,omitempty"`
}
UnstructuredDataProduct is the Schema for the unstructureddataproducts API
func (*UnstructuredDataProduct) DeepCopy ¶
func (in *UnstructuredDataProduct) DeepCopy() *UnstructuredDataProduct
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProduct.
func (*UnstructuredDataProduct) DeepCopyInto ¶
func (in *UnstructuredDataProduct) DeepCopyInto(out *UnstructuredDataProduct)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
func (*UnstructuredDataProduct) DeepCopyObject ¶
func (in *UnstructuredDataProduct) DeepCopyObject() runtime.Object
DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.
func (*UnstructuredDataProduct) SetWaiting ¶
func (u *UnstructuredDataProduct) SetWaiting()
func (*UnstructuredDataProduct) UpdateStatus ¶
func (u *UnstructuredDataProduct) UpdateStatus(message string, err error)
type UnstructuredDataProductList ¶
type UnstructuredDataProductList struct {
metav1.TypeMeta `json:",inline"`
metav1.ListMeta `json:"metadata,omitempty"`
Items []UnstructuredDataProduct `json:"items"`
}
UnstructuredDataProductList contains a list of UnstructuredDataProduct
func (*UnstructuredDataProductList) DeepCopy ¶
func (in *UnstructuredDataProductList) DeepCopy() *UnstructuredDataProductList
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProductList.
func (*UnstructuredDataProductList) DeepCopyInto ¶
func (in *UnstructuredDataProductList) DeepCopyInto(out *UnstructuredDataProductList)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
func (*UnstructuredDataProductList) DeepCopyObject ¶
func (in *UnstructuredDataProductList) DeepCopyObject() runtime.Object
DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.
type UnstructuredDataProductSpec ¶
type UnstructuredDataProductSpec struct {
SourceConfig SourceConfig `json:"sourceConfig,omitempty"`
DestinationConfig DestinationConfig `json:"destinationConfig,omitempty"`
DocumentProcessorConfig DocumentProcessorConfig `json:"documentProcessorConfig,omitempty"`
ChunksGeneratorConfig ChunksGeneratorConfig `json:"chunksGeneratorConfig,omitempty"`
VectorEmbeddingsGeneratorConfig VectorEmbeddingsGeneratorConfig `json:"vectorEmbeddingsGeneratorConfig,omitempty"`
}
UnstructuredDataProductSpec defines the desired state of UnstructuredDataProduct
func (*UnstructuredDataProductSpec) DeepCopy ¶
func (in *UnstructuredDataProductSpec) DeepCopy() *UnstructuredDataProductSpec
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProductSpec.
func (*UnstructuredDataProductSpec) DeepCopyInto ¶
func (in *UnstructuredDataProductSpec) DeepCopyInto(out *UnstructuredDataProductSpec)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type UnstructuredDataProductStatus ¶
type UnstructuredDataProductStatus struct {
LastAppliedGeneration int64 `json:"lastAppliedGeneration,omitempty"`
Conditions []metav1.Condition `json:"conditions,omitempty"`
}
UnstructuredDataProductStatus defines the observed state of UnstructuredDataProduct
func (*UnstructuredDataProductStatus) DeepCopy ¶
func (in *UnstructuredDataProductStatus) DeepCopy() *UnstructuredDataProductStatus
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProductStatus.
func (*UnstructuredDataProductStatus) DeepCopyInto ¶
func (in *UnstructuredDataProductStatus) DeepCopyInto(out *UnstructuredDataProductStatus)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type UnstructuredDataType ¶ added in v0.2.0
type UnstructuredDataType string
type VectorEmbeddingsGenerator ¶ added in v0.2.0
type VectorEmbeddingsGenerator struct {
metav1.TypeMeta `json:",inline"`
metav1.ObjectMeta `json:"metadata,omitempty"`
Spec VectorEmbeddingsGeneratorSpec `json:"spec,omitempty"`
Status VectorEmbeddingsGeneratorStatus `json:"status,omitempty"`
}
VectorEmbeddingsGenerator is the Schema for the vectorembeddingsgenerators API.
func (*VectorEmbeddingsGenerator) DeepCopy ¶ added in v0.2.0
func (in *VectorEmbeddingsGenerator) DeepCopy() *VectorEmbeddingsGenerator
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new VectorEmbeddingsGenerator.
func (*VectorEmbeddingsGenerator) DeepCopyInto ¶ added in v0.2.0
func (in *VectorEmbeddingsGenerator) DeepCopyInto(out *VectorEmbeddingsGenerator)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
func (*VectorEmbeddingsGenerator) DeepCopyObject ¶ added in v0.2.0
func (in *VectorEmbeddingsGenerator) DeepCopyObject() runtime.Object
DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.
func (*VectorEmbeddingsGenerator) SetWaiting ¶ added in v0.2.0
func (c *VectorEmbeddingsGenerator) SetWaiting()
func (*VectorEmbeddingsGenerator) UpdateStatus ¶ added in v0.2.0
func (c *VectorEmbeddingsGenerator) UpdateStatus(message string, err error)
type VectorEmbeddingsGeneratorConfig ¶ added in v0.2.0
type VectorEmbeddingsGeneratorConfig struct {
ModelName string `json:"modelName,omitempty"`
NomicEmbedTextV15Config NomicEmbedTextV15Config `json:"nomicEmbedTextV15Config,omitempty"`
}
func (*VectorEmbeddingsGeneratorConfig) DeepCopy ¶ added in v0.2.0
func (in *VectorEmbeddingsGeneratorConfig) DeepCopy() *VectorEmbeddingsGeneratorConfig
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new VectorEmbeddingsGeneratorConfig.
func (*VectorEmbeddingsGeneratorConfig) DeepCopyInto ¶ added in v0.2.0
func (in *VectorEmbeddingsGeneratorConfig) DeepCopyInto(out *VectorEmbeddingsGeneratorConfig)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type VectorEmbeddingsGeneratorList ¶ added in v0.2.0
type VectorEmbeddingsGeneratorList struct {
metav1.TypeMeta `json:",inline"`
metav1.ListMeta `json:"metadata,omitempty"`
Items []VectorEmbeddingsGenerator `json:"items"`
}
VectorEmbeddingsGeneratorList contains a list of VectorEmbeddingsGenerator.
func (*VectorEmbeddingsGeneratorList) DeepCopy ¶ added in v0.2.0
func (in *VectorEmbeddingsGeneratorList) DeepCopy() *VectorEmbeddingsGeneratorList
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new VectorEmbeddingsGeneratorList.
func (*VectorEmbeddingsGeneratorList) DeepCopyInto ¶ added in v0.2.0
func (in *VectorEmbeddingsGeneratorList) DeepCopyInto(out *VectorEmbeddingsGeneratorList)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
func (*VectorEmbeddingsGeneratorList) DeepCopyObject ¶ added in v0.2.0
func (in *VectorEmbeddingsGeneratorList) DeepCopyObject() runtime.Object
DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.
type VectorEmbeddingsGeneratorSpec ¶ added in v0.2.0
type VectorEmbeddingsGeneratorSpec struct {
DataProduct string `json:"dataProduct,omitempty"`
VectorEmbeddingsGeneratorConfig VectorEmbeddingsGeneratorConfig `json:"embeddingGeneratorConfig,omitempty"`
}
VectorEmbeddingsGeneratorSpec defines the desired state of VectorEmbeddingsGenerator.
func (*VectorEmbeddingsGeneratorSpec) DeepCopy ¶ added in v0.2.0
func (in *VectorEmbeddingsGeneratorSpec) DeepCopy() *VectorEmbeddingsGeneratorSpec
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new VectorEmbeddingsGeneratorSpec.
func (*VectorEmbeddingsGeneratorSpec) DeepCopyInto ¶ added in v0.2.0
func (in *VectorEmbeddingsGeneratorSpec) DeepCopyInto(out *VectorEmbeddingsGeneratorSpec)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.
type VectorEmbeddingsGeneratorStatus ¶ added in v0.2.0
type VectorEmbeddingsGeneratorStatus struct {
LastAppliedGeneration int64 `json:"lastAppliedGeneration,omitempty"`
Conditions []metav1.Condition `json:"conditions,omitempty"`
}
VectorEmbeddingsGeneratorStatus defines the observed state of VectorEmbeddingsGenerator.
func (*VectorEmbeddingsGeneratorStatus) DeepCopy ¶ added in v0.2.0
func (in *VectorEmbeddingsGeneratorStatus) DeepCopy() *VectorEmbeddingsGeneratorStatus
DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new VectorEmbeddingsGeneratorStatus.
func (*VectorEmbeddingsGeneratorStatus) DeepCopyInto ¶ added in v0.2.0
func (in *VectorEmbeddingsGeneratorStatus) DeepCopyInto(out *VectorEmbeddingsGeneratorStatus)
DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.