store

package
v1.4.0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Sep 2, 2024 License: MIT Imports: 18 Imported by: 0

Documentation

Index

Constants

View Source 
const (
	StateCreated   = "CREATED"
	StateUploaded  = "UPLOADED"
	StatePublished = "PUBLISHED"
	StateMoved     = "MOVED"
)

Variables

View Source 
var (
	ErrDuplicateFile                   = errors.New("duplicate file path")
	ErrFileNotRegistered               = errors.New("file not registered")
	ErrFileNotInCreatedState           = errors.New("file state is not in state created")
	ErrFileNotInUploadedState          = errors.New("file state is not in state uploaded")
	ErrFileStateMismatch               = errors.New("file state mismatch")
	ErrFileIsNotPublishable            = errors.New("file is not set as publishable")
	ErrNoFilesInCollection             = errors.New("no files found in collection")
	ErrCollectionIDAlreadySet          = errors.New("collection ID already set")
	ErrCollectionIDNotSet              = errors.New("collection ID not set")
	ErrCollectionAlreadyPublished      = errors.New("collection with the given id is already published")
	ErrCollectionMetadataNotRegistered = errors.New("collection metadata not registered")
	ErrEtagMismatchWhilePublishing     = errors.New("etag mismatch")
)

Functions

This section is empty.

Types

type ChangeFileState added in v1.4.0 

type ChangeFileState struct {
	State string `schema:"state" validate:"required"`
	Etag  string `schema:"etag" validate:"required"`
}

type Store 

type Store struct {
	// contains filtered or unexported fields
}

func NewStore 

func NewStore(metadataCollection mongo.MongoCollection, collectionsCollection mongo.MongoCollection, kafkaProducer kafka.IProducer, clk clock.Clock, c aws.S3Clienter, cfg *config.Config) *Store

func (*Store) AreAllFilesPublished added in v1.3.0 

func (store *Store) AreAllFilesPublished(ctx context.Context, collectionID string) (bool, error)

func (*Store) BatchSendKafkaMessages added in v1.2.0 

func (store *Store) BatchSendKafkaMessages(
	ctx context.Context,
	cursor mongodriver.Cursor,
	wg *sync.WaitGroup,
	collectionID string,
	offset,
	batch_size,
	batch_num int,
)

func (*Store) GetCollectionPublishedMetadata added in v1.3.0 

func (store *Store) GetCollectionPublishedMetadata(ctx context.Context, id string) (files.StoredCollection, error)

func (*Store) GetFileMetadata 

func (store *Store) GetFileMetadata(ctx context.Context, path string) (files.StoredRegisteredMetaData, error)

func (*Store) GetFilesMetadata 

func (store *Store) GetFilesMetadata(ctx context.Context, collectionID string) ([]files.StoredRegisteredMetaData, error)

GetFilesMetadata godoc @Description GETs metadata for a file @Tags File upload started @Produce json @Success 200 @Failure 400 @Failure 403 @Failure 404 @Failure 500 @Router /files [get]

func (*Store) IsCollectionEmpty added in v1.2.0 

func (store *Store) IsCollectionEmpty(ctx context.Context, collectionID string) (bool, error)

func (*Store) IsCollectionPublished added in v1.3.0 

func (store *Store) IsCollectionPublished(ctx context.Context, collectionID string) (bool, error)

func (*Store) IsCollectionUploaded added in v1.2.0 

func (store *Store) IsCollectionUploaded(ctx context.Context, collectionID string) (bool, error)

func (*Store) MarkCollectionPublished 

func (store *Store) MarkCollectionPublished(ctx context.Context, collectionID string) error

GetFilesMetadata godoc @Description PATCH metadata state for a file, (i.e. when an upload has completed). @Tags Patch metadata state @Produce json @Param file_path path string true "Filepath of required file" @Param patch_file body ChangeFileState true "Change the state of a file in the metadata" @Success 201 @Failure 400 @Failure 403 @Failure 409 @Failure 500 @Router /files/{filepath} [patch]

func (*Store) MarkFileMoved added in v1.3.0 

func (store *Store) MarkFileMoved(ctx context.Context, metaData files.FileEtagChange) error

func (*Store) MarkFilePublished 

func (store *Store) MarkFilePublished(ctx context.Context, path string) error

func (*Store) MarkUploadComplete 

func (store *Store) MarkUploadComplete(ctx context.Context, metaData files.FileEtagChange) error

func (*Store) NotifyCollectionPublished added in v1.2.0 

func (store *Store) NotifyCollectionPublished(ctx context.Context, collectionID string)

func (*Store) PatchFilePublishMetadata added in v1.3.0 

func (store *Store) PatchFilePublishMetadata(metadata *files.StoredRegisteredMetaData, collection *files.StoredCollection)

For the optimisation purposes, we store the Florence collection publishing information in a separate DB collection. This makes the collection publishing instantaneous by removing a need to update the publish state of all the files in the collection, which takes a very long time for large collections. Because of this, we need to patch the file metadata in a specific case documented below.

func (*Store) RegisterFileUpload 

func (store *Store) RegisterFileUpload(ctx context.Context, metaData files.StoredRegisteredMetaData) error

GetFilesMetadata godoc @Description POSTs metadata for a file when an upload has started. @Tags File upload started @Produce json @Param request formData files.StoredRegisteredMetaData false "StoredRegisteredMetaData" @Success 200 @Failure 400 @Failure 403 @Failure 404 @Failure 500 @Router /files [post]

func (*Store) UpdateCollectionID 

func (store *Store) UpdateCollectionID(ctx context.Context, path, collectionID string) error

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.