v1alpha1

package
v0.1.0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Mar 5, 2026 License: Apache-2.0 Imports: 5 Imported by: 0

Documentation

Overview

Package v1alpha1 contains API Schema definitions for the operator v1alpha1 API group +kubebuilder:object:generate=true +groupName=operator.dataverse.redhat.com

Index

Constants

View Source 
const (
	SuccessfullyReconciled = "SuccessfullyReconciled"
	ReconcileFailed        = "ReconcileFailed"
)
View Source 
const (
	SourceTypeS3                       UnstructuredDataSourceType      = "s3"
	DestinationTypeInternalStage       UnstructuredDataDestinationType = "snowflakeInternalStage"
	ChunkingStrategyRecursiveCharacter ChunkingStrategy                = "recursiveCharacterTextSplitter"
	ChunkingStrategyMarkdown           ChunkingStrategy                = "markdownTextSplitter"
	ChunkingStrategyToken              ChunkingStrategy                = "tokenTextSplitter"

	UnstructuredDataProductCondition = "UnstructuredDataProductReady"
)
View Source 
const (
	ChunksGeneratorCondition = "ChunksGeneratorReady"
)
View Source 
const (
	ConfigCondition = "ConfigReady"
)
View Source 
const (
	DocumentProcessorCondition = "DocumentProcessorReady"
)
View Source 
const (
	SQSConsumerCondition = "SQSConsumerReady"
)

Variables

View Source 
var (
	// GroupVersion is group version used to register these objects
	GroupVersion = schema.GroupVersion{Group: "operator.dataverse.redhat.com", Version: "v1alpha1"}

	// SchemeBuilder is used to add go types to the GroupVersionKind scheme
	SchemeBuilder = &scheme.Builder{GroupVersion: GroupVersion}

	// AddToScheme adds the types in this group-version to the given scheme.
	AddToScheme = SchemeBuilder.AddToScheme
)

Functions

This section is empty.

Types

type ChunkingStrategy 

type ChunkingStrategy string

type ChunksGenerator 

type ChunksGenerator struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   ChunksGeneratorSpec   `json:"spec,omitempty"`
	Status ChunksGeneratorStatus `json:"status,omitempty"`
}

ChunksGenerator is the Schema for the chunksgenerators API

func (*ChunksGenerator) DeepCopy 

func (in *ChunksGenerator) DeepCopy() *ChunksGenerator

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGenerator.

func (*ChunksGenerator) DeepCopyInto 

func (in *ChunksGenerator) DeepCopyInto(out *ChunksGenerator)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*ChunksGenerator) DeepCopyObject 

func (in *ChunksGenerator) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

func (*ChunksGenerator) SetWaiting 

func (c *ChunksGenerator) SetWaiting()

func (*ChunksGenerator) UpdateStatus 

func (c *ChunksGenerator) UpdateStatus(message string, err error)

type ChunksGeneratorConfig 

type ChunksGeneratorConfig struct {
	Strategy                         ChunkingStrategy                 `json:"strategy"`
	RecursiveCharacterSplitterConfig RecursiveCharacterSplitterConfig `json:"recursiveCharacterSplitterConfig,omitempty"`
	MarkdownSplitterConfig           MarkdownSplitterConfig           `json:"markdownSplitterConfig,omitempty"`
	TokenSplitterConfig              TokenSplitterConfig              `json:"tokenSplitterConfig,omitempty"`
}

func (*ChunksGeneratorConfig) DeepCopy 

func (in *ChunksGeneratorConfig) DeepCopy() *ChunksGeneratorConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGeneratorConfig.

func (*ChunksGeneratorConfig) DeepCopyInto 

func (in *ChunksGeneratorConfig) DeepCopyInto(out *ChunksGeneratorConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ChunksGeneratorList 

type ChunksGeneratorList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []ChunksGenerator `json:"items"`
}

ChunksGeneratorList contains a list of ChunksGenerator

func (*ChunksGeneratorList) DeepCopy 

func (in *ChunksGeneratorList) DeepCopy() *ChunksGeneratorList

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGeneratorList.

func (*ChunksGeneratorList) DeepCopyInto 

func (in *ChunksGeneratorList) DeepCopyInto(out *ChunksGeneratorList)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*ChunksGeneratorList) DeepCopyObject 

func (in *ChunksGeneratorList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type ChunksGeneratorSpec 

type ChunksGeneratorSpec struct {
	DataProduct           string                `json:"dataProduct,omitempty"`
	ChunksGeneratorConfig ChunksGeneratorConfig `json:"config,omitempty"`
}

ChunksGeneratorSpec defines the desired state of ChunksGenerator

func (*ChunksGeneratorSpec) DeepCopy 

func (in *ChunksGeneratorSpec) DeepCopy() *ChunksGeneratorSpec

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGeneratorSpec.

func (*ChunksGeneratorSpec) DeepCopyInto 

func (in *ChunksGeneratorSpec) DeepCopyInto(out *ChunksGeneratorSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ChunksGeneratorStatus 

type ChunksGeneratorStatus struct {
	LastAppliedGeneration int64              `json:"lastAppliedGeneration,omitempty"`
	Conditions            []metav1.Condition `json:"conditions,omitempty"`
}

ChunksGeneratorStatus defines the observed state of ChunksGenerator

func (*ChunksGeneratorStatus) DeepCopy 

func (in *ChunksGeneratorStatus) DeepCopy() *ChunksGeneratorStatus

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ChunksGeneratorStatus.

func (*ChunksGeneratorStatus) DeepCopyInto 

func (in *ChunksGeneratorStatus) DeepCopyInto(out *ChunksGeneratorStatus)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ControllerConfig 

type ControllerConfig struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   ControllerConfigSpec   `json:"spec,omitempty"`
	Status ControllerConfigStatus `json:"status,omitempty"`
}

ControllerConfig is the Schema for the controllerconfigs API.

func (*ControllerConfig) DeepCopy 

func (in *ControllerConfig) DeepCopy() *ControllerConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ControllerConfig.

func (*ControllerConfig) DeepCopyInto 

func (in *ControllerConfig) DeepCopyInto(out *ControllerConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*ControllerConfig) DeepCopyObject 

func (in *ControllerConfig) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

func (*ControllerConfig) IsHealthy 

func (c *ControllerConfig) IsHealthy() bool

func (*ControllerConfig) SetWaiting 

func (c *ControllerConfig) SetWaiting()

func (*ControllerConfig) UpdateStatus 

func (c *ControllerConfig) UpdateStatus(err error)

type ControllerConfigList 

type ControllerConfigList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []ControllerConfig `json:"items"`
}

ControllerConfigList contains a list of ControllerConfig.

func (*ControllerConfigList) DeepCopy 

func (in *ControllerConfigList) DeepCopy() *ControllerConfigList

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ControllerConfigList.

func (*ControllerConfigList) DeepCopyInto 

func (in *ControllerConfigList) DeepCopyInto(out *ControllerConfigList)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*ControllerConfigList) DeepCopyObject 

func (in *ControllerConfigList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type ControllerConfigSpec 

type ControllerConfigSpec struct {
	SnowflakeConfig                  SnowflakeConfig                      `json:"snowflakeConfig,omitempty"`
	AWSSecret                        string                               `json:"awsSecret,omitempty"`
	UnstructuredDataProcessingConfig UnstructuredDataProcessingConfigSpec `json:"unstructuredDataProcessingConfig,omitempty"`
}

ControllerConfigSpec defines the desired state of ControllerConfig.

func (*ControllerConfigSpec) DeepCopy 

func (in *ControllerConfigSpec) DeepCopy() *ControllerConfigSpec

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ControllerConfigSpec.

func (*ControllerConfigSpec) DeepCopyInto 

func (in *ControllerConfigSpec) DeepCopyInto(out *ControllerConfigSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ControllerConfigStatus 

type ControllerConfigStatus struct {
	Conditions            []metav1.Condition `json:"conditions,omitempty"`
	LastAppliedGeneration int64              `json:"lastAppliedGeneration,omitempty"`
}

ControllerConfigStatus defines the observed state of ControllerConfig.

func (*ControllerConfigStatus) DeepCopy 

func (in *ControllerConfigStatus) DeepCopy() *ControllerConfigStatus

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ControllerConfigStatus.

func (*ControllerConfigStatus) DeepCopyInto 

func (in *ControllerConfigStatus) DeepCopyInto(out *ControllerConfigStatus)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DestinationConfig 

type DestinationConfig struct {
	Type                         UnstructuredDataDestinationType `json:"type,omitempty"`
	SnowflakeInternalStageConfig SnowflakeInternalStageConfig    `json:"snowflakeInternalStageConfig,omitempty"`
}

func (*DestinationConfig) DeepCopy 

func (in *DestinationConfig) DeepCopy() *DestinationConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DestinationConfig.

func (*DestinationConfig) DeepCopyInto 

func (in *DestinationConfig) DeepCopyInto(out *DestinationConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DoclingConfig 

type DoclingConfig struct {
	FromFormats     []string `json:"from_formats,omitempty"`
	ToFormats       []string `json:"to_formats,omitempty"`
	ImageExportMode string   `json:"image_export_mode,omitempty"`
	DoOCR           bool     `json:"do_ocr,omitempty"`
	ForceOCR        bool     `json:"force_ocr,omitempty"`
	OCREngine       string   `json:"ocr_engine,omitempty"`
	OCRLang         []string `json:"ocr_lang,omitempty"`
	PDFBackend      string   `json:"pdf_backend,omitempty"`
	TableMode       string   `json:"table_mode,omitempty"`
	AbortOnError    bool     `json:"abort_on_error,omitempty"`
}

func (*DoclingConfig) DeepCopy 

func (in *DoclingConfig) DeepCopy() *DoclingConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DoclingConfig.

func (*DoclingConfig) DeepCopyInto 

func (in *DoclingConfig) DeepCopyInto(out *DoclingConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DocumentProcessor 

type DocumentProcessor struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   DocumentProcessorSpec   `json:"spec,omitempty"`
	Status DocumentProcessorStatus `json:"status,omitempty"`
}

DocumentProcessor is the Schema for the documentprocessors API

func (*DocumentProcessor) AddOrUpdateJob 

func (d *DocumentProcessor) AddOrUpdateJob(newJob Job)

func (*DocumentProcessor) AddPermanentlyFailingFile 

func (d *DocumentProcessor) AddPermanentlyFailingFile(filePath string)

func (*DocumentProcessor) DeepCopy 

func (in *DocumentProcessor) DeepCopy() *DocumentProcessor

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessor.

func (*DocumentProcessor) DeepCopyInto 

func (in *DocumentProcessor) DeepCopyInto(out *DocumentProcessor)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*DocumentProcessor) DeepCopyObject 

func (in *DocumentProcessor) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

func (*DocumentProcessor) DeleteJobByFilePath 

func (d *DocumentProcessor) DeleteJobByFilePath(filePath string)

func (*DocumentProcessor) GetJobByFilePath 

func (d *DocumentProcessor) GetJobByFilePath(filePath string) *Job

func (*DocumentProcessor) IsFilePermanentlyFailing 

func (d *DocumentProcessor) IsFilePermanentlyFailing(filePath string) bool

func (*DocumentProcessor) SetWaiting 

func (d *DocumentProcessor) SetWaiting()

func (*DocumentProcessor) UpdateStatus 

func (d *DocumentProcessor) UpdateStatus(message string, err error)

type DocumentProcessorConfig 

type DocumentProcessorConfig struct {
	Type          string        `json:"type,omitempty"`
	DoclingConfig DoclingConfig `json:"doclingConfig,omitempty"`
}

func (*DocumentProcessorConfig) DeepCopy 

func (in *DocumentProcessorConfig) DeepCopy() *DocumentProcessorConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessorConfig.

func (*DocumentProcessorConfig) DeepCopyInto 

func (in *DocumentProcessorConfig) DeepCopyInto(out *DocumentProcessorConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DocumentProcessorList 

type DocumentProcessorList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []DocumentProcessor `json:"items"`
}

DocumentProcessorList contains a list of DocumentProcessor

func (*DocumentProcessorList) DeepCopy 

func (in *DocumentProcessorList) DeepCopy() *DocumentProcessorList

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessorList.

func (*DocumentProcessorList) DeepCopyInto 

func (in *DocumentProcessorList) DeepCopyInto(out *DocumentProcessorList)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*DocumentProcessorList) DeepCopyObject 

func (in *DocumentProcessorList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type DocumentProcessorSpec 

type DocumentProcessorSpec struct {
	DataProduct             string                  `json:"dataProduct,omitempty"`
	DocumentProcessorConfig DocumentProcessorConfig `json:"config,omitempty"`
}

DocumentProcessorSpec defines the desired state of DocumentProcessor

func (*DocumentProcessorSpec) DeepCopy 

func (in *DocumentProcessorSpec) DeepCopy() *DocumentProcessorSpec

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessorSpec.

func (*DocumentProcessorSpec) DeepCopyInto 

func (in *DocumentProcessorSpec) DeepCopyInto(out *DocumentProcessorSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DocumentProcessorStatus 

type DocumentProcessorStatus struct {
	LastAppliedGeneration   int64              `json:"lastAppliedGeneration,omitempty"`
	Conditions              []metav1.Condition `json:"conditions,omitempty"`
	Jobs                    []Job              `json:"jobs,omitempty"`
	PermanentlyFailingFiles []string           `json:"permanentlyFailingFiles,omitempty"`
}

DocumentProcessorStatus defines the observed state of DocumentProcessor

func (*DocumentProcessorStatus) DeepCopy 

func (in *DocumentProcessorStatus) DeepCopy() *DocumentProcessorStatus

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DocumentProcessorStatus.

func (*DocumentProcessorStatus) DeepCopyInto 

func (in *DocumentProcessorStatus) DeepCopyInto(out *DocumentProcessorStatus)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type Job 

type Job struct {
	FilePath          string        `json:"filePath,omitempty"`
	DocumentConverter string        `json:"documentConverter,omitempty"`
	DoclingConfig     DoclingConfig `json:"doclingConfig,omitempty"`
	TaskID            string        `json:"taskID,omitempty"`
	Status            string        `json:"status,omitempty"`
	CreatedOn         string        `json:"createdOn,omitempty"`
	Attempts          int           `json:"attempts,omitempty"`
}

func (*Job) DeepCopy 

func (in *Job) DeepCopy() *Job

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new Job.

func (*Job) DeepCopyInto 

func (in *Job) DeepCopyInto(out *Job)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type MarkdownSplitterConfig 

type MarkdownSplitterConfig struct {
	ChunkSize        int  `json:"chunkSize,omitempty"`
	ChunkOverlap     int  `json:"chunkOverlap,omitempty"`
	CodeBlocks       bool `json:"codeBlocks,omitempty"`
	ReferenceLinks   bool `json:"referenceLinks,omitempty"`
	HeadingHierarchy bool `json:"headingHierarchy,omitempty"`
	JoinTableRows    bool `json:"joinTableRows,omitempty"`
}

func (*MarkdownSplitterConfig) DeepCopy 

func (in *MarkdownSplitterConfig) DeepCopy() *MarkdownSplitterConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new MarkdownSplitterConfig.

func (*MarkdownSplitterConfig) DeepCopyInto 

func (in *MarkdownSplitterConfig) DeepCopyInto(out *MarkdownSplitterConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type RecursiveCharacterSplitterConfig 

type RecursiveCharacterSplitterConfig struct {
	Separators    []string `json:"separators,omitempty"`
	ChunkSize     int      `json:"chunkSize,omitempty"`
	ChunkOverlap  int      `json:"chunkOverlap,omitempty"`
	KeepSeparator bool     `json:"keepSeparator,omitempty"`
}

func (*RecursiveCharacterSplitterConfig) DeepCopy 

func (in *RecursiveCharacterSplitterConfig) DeepCopy() *RecursiveCharacterSplitterConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new RecursiveCharacterSplitterConfig.

func (*RecursiveCharacterSplitterConfig) DeepCopyInto 

func (in *RecursiveCharacterSplitterConfig) DeepCopyInto(out *RecursiveCharacterSplitterConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type S3Config 

type S3Config struct {
	Bucket string `json:"bucket,omitempty"`
	Prefix string `json:"prefix,omitempty"`
}

func (*S3Config) DeepCopy 

func (in *S3Config) DeepCopy() *S3Config

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new S3Config.

func (*S3Config) DeepCopyInto 

func (in *S3Config) DeepCopyInto(out *S3Config)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SQSConsumer 

type SQSConsumer struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   SQSConsumerSpec   `json:"spec,omitempty"`
	Status SQSConsumerStatus `json:"status,omitempty"`
}

SQSConsumer is the Schema for the sqsconsumers API

func (*SQSConsumer) DeepCopy 

func (in *SQSConsumer) DeepCopy() *SQSConsumer

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SQSConsumer.

func (*SQSConsumer) DeepCopyInto 

func (in *SQSConsumer) DeepCopyInto(out *SQSConsumer)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*SQSConsumer) DeepCopyObject 

func (in *SQSConsumer) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

func (*SQSConsumer) SetWaiting 

func (c *SQSConsumer) SetWaiting()

func (*SQSConsumer) UpdateStatus 

func (c *SQSConsumer) UpdateStatus(message string, err error)

UpdateStatus updates the status of the SQSConsumer CR It takes a message and an error, and updates the status of the CR accordingly If the error is nil, the status is set to True and the message is set to the message If the error is not nil, the status is set to False and the message is set to the message and the error

type SQSConsumerList 

type SQSConsumerList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []SQSConsumer `json:"items"`
}

SQSConsumerList contains a list of SQSConsumer

func (*SQSConsumerList) DeepCopy 

func (in *SQSConsumerList) DeepCopy() *SQSConsumerList

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SQSConsumerList.

func (*SQSConsumerList) DeepCopyInto 

func (in *SQSConsumerList) DeepCopyInto(out *SQSConsumerList)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*SQSConsumerList) DeepCopyObject 

func (in *SQSConsumerList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type SQSConsumerSpec 

type SQSConsumerSpec struct {
	QueueURL string `json:"queueURL,omitempty"`
}

SQSConsumerSpec defines the desired state of SQSConsumer

func (*SQSConsumerSpec) DeepCopy 

func (in *SQSConsumerSpec) DeepCopy() *SQSConsumerSpec

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SQSConsumerSpec.

func (*SQSConsumerSpec) DeepCopyInto 

func (in *SQSConsumerSpec) DeepCopyInto(out *SQSConsumerSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SQSConsumerStatus 

type SQSConsumerStatus struct {
	LastAppliedGeneration int64              `json:"lastAppliedGeneration,omitempty"`
	Conditions            []metav1.Condition `json:"conditions,omitempty"`
}

SQSConsumerStatus defines the observed state of SQSConsumer

func (*SQSConsumerStatus) DeepCopy 

func (in *SQSConsumerStatus) DeepCopy() *SQSConsumerStatus

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SQSConsumerStatus.

func (*SQSConsumerStatus) DeepCopyInto 

func (in *SQSConsumerStatus) DeepCopyInto(out *SQSConsumerStatus)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SnowflakeConfig 

type SnowflakeConfig struct {
	Name             string `json:"name"`
	Account          string `json:"account"`
	User             string `json:"user"`
	Role             string `json:"role"`
	Region           string `json:"region,omitempty"`
	Warehouse        string `json:"warehouse"`
	PrivateKeySecret string `json:"privateKeySecret"`
}

func (*SnowflakeConfig) DeepCopy 

func (in *SnowflakeConfig) DeepCopy() *SnowflakeConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SnowflakeConfig.

func (*SnowflakeConfig) DeepCopyInto 

func (in *SnowflakeConfig) DeepCopyInto(out *SnowflakeConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SnowflakeInternalStageConfig 

type SnowflakeInternalStageConfig struct {
	Stage    string `json:"stage,omitempty"`
	Database string `json:"database,omitempty"`
	Schema   string `json:"schema,omitempty"`
}

func (*SnowflakeInternalStageConfig) DeepCopy 

func (in *SnowflakeInternalStageConfig) DeepCopy() *SnowflakeInternalStageConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SnowflakeInternalStageConfig.

func (*SnowflakeInternalStageConfig) DeepCopyInto 

func (in *SnowflakeInternalStageConfig) DeepCopyInto(out *SnowflakeInternalStageConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SourceConfig 

type SourceConfig struct {
	Type     UnstructuredDataSourceType `json:"type,omitempty"`
	S3Config S3Config                   `json:"s3Config,omitempty"`
}

func (*SourceConfig) DeepCopy 

func (in *SourceConfig) DeepCopy() *SourceConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SourceConfig.

func (*SourceConfig) DeepCopyInto 

func (in *SourceConfig) DeepCopyInto(out *SourceConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type TokenSplitterConfig 

type TokenSplitterConfig struct {
	ChunkSize         int      `json:"chunkSize,omitempty"`
	ChunkOverlap      int      `json:"chunkOverlap,omitempty"`
	ModelName         string   `json:"modelName,omitempty"`
	EncodingName      string   `json:"encodingName,omitempty"`
	AllowedSpecial    []string `json:"allowedSpecial,omitempty"`
	DisallowedSpecial []string `json:"disallowedSpecial,omitempty"`
}

func (*TokenSplitterConfig) DeepCopy 

func (in *TokenSplitterConfig) DeepCopy() *TokenSplitterConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new TokenSplitterConfig.

func (*TokenSplitterConfig) DeepCopyInto 

func (in *TokenSplitterConfig) DeepCopyInto(out *TokenSplitterConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type UnstructuredDataDestinationType 

type UnstructuredDataDestinationType string

type UnstructuredDataProcessingConfigSpec 

type UnstructuredDataProcessingConfigSpec struct {
	MaxConcurrentDoclingTasks   int `json:"maxConcurrentDoclingTasks,omitempty"`
	MaxConcurrentLangchainTasks int `json:"maxConcurrentLangchainTasks,omitempty"`

	IngestionBucket string `json:"ingestionBucket,omitempty"`
	DoclingServeURL string `json:"doclingServeURL,omitempty"`
	DoclingSecret   string `json:"doclingSecret,omitempty"`

	CacheDirectory    string `json:"cacheDirectory,omitempty"`
	DataStorageBucket string `json:"dataStorageBucket,omitempty"`
}

func (*UnstructuredDataProcessingConfigSpec) DeepCopy 

func (in *UnstructuredDataProcessingConfigSpec) DeepCopy() *UnstructuredDataProcessingConfigSpec

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProcessingConfigSpec.

func (*UnstructuredDataProcessingConfigSpec) DeepCopyInto 

func (in *UnstructuredDataProcessingConfigSpec) DeepCopyInto(out *UnstructuredDataProcessingConfigSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type UnstructuredDataProduct 

type UnstructuredDataProduct struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   UnstructuredDataProductSpec   `json:"spec,omitempty"`
	Status UnstructuredDataProductStatus `json:"status,omitempty"`
}

UnstructuredDataProduct is the Schema for the unstructureddataproducts API

func (*UnstructuredDataProduct) DeepCopy 

func (in *UnstructuredDataProduct) DeepCopy() *UnstructuredDataProduct

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProduct.

func (*UnstructuredDataProduct) DeepCopyInto 

func (in *UnstructuredDataProduct) DeepCopyInto(out *UnstructuredDataProduct)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*UnstructuredDataProduct) DeepCopyObject 

func (in *UnstructuredDataProduct) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

func (*UnstructuredDataProduct) SetWaiting 

func (u *UnstructuredDataProduct) SetWaiting()

func (*UnstructuredDataProduct) UpdateStatus 

func (u *UnstructuredDataProduct) UpdateStatus(message string, err error)

type UnstructuredDataProductList 

type UnstructuredDataProductList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []UnstructuredDataProduct `json:"items"`
}

UnstructuredDataProductList contains a list of UnstructuredDataProduct

func (*UnstructuredDataProductList) DeepCopy 

func (in *UnstructuredDataProductList) DeepCopy() *UnstructuredDataProductList

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProductList.

func (*UnstructuredDataProductList) DeepCopyInto 

func (in *UnstructuredDataProductList) DeepCopyInto(out *UnstructuredDataProductList)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*UnstructuredDataProductList) DeepCopyObject 

func (in *UnstructuredDataProductList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type UnstructuredDataProductSpec 

type UnstructuredDataProductSpec struct {
	SourceConfig            SourceConfig            `json:"sourceConfig,omitempty"`
	DestinationConfig       DestinationConfig       `json:"destinationConfig,omitempty"`
	DocumentProcessorConfig DocumentProcessorConfig `json:"documentProcessorConfig,omitempty"`
	ChunksGeneratorConfig   ChunksGeneratorConfig   `json:"chunksGeneratorConfig,omitempty"`
}

UnstructuredDataProductSpec defines the desired state of UnstructuredDataProduct

func (*UnstructuredDataProductSpec) DeepCopy 

func (in *UnstructuredDataProductSpec) DeepCopy() *UnstructuredDataProductSpec

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProductSpec.

func (*UnstructuredDataProductSpec) DeepCopyInto 

func (in *UnstructuredDataProductSpec) DeepCopyInto(out *UnstructuredDataProductSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type UnstructuredDataProductStatus 

type UnstructuredDataProductStatus struct {
	LastAppliedGeneration int64              `json:"lastAppliedGeneration,omitempty"`
	Conditions            []metav1.Condition `json:"conditions,omitempty"`
}

UnstructuredDataProductStatus defines the observed state of UnstructuredDataProduct

func (*UnstructuredDataProductStatus) DeepCopy 

func (in *UnstructuredDataProductStatus) DeepCopy() *UnstructuredDataProductStatus

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new UnstructuredDataProductStatus.

func (*UnstructuredDataProductStatus) DeepCopyInto 

func (in *UnstructuredDataProductStatus) DeepCopyInto(out *UnstructuredDataProductStatus)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type UnstructuredDataSourceType 

type UnstructuredDataSourceType string

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.