actors

type Actor ¶

type Actor interface {
	Run()
}

Actor is something that can be run in its own goroutine. This package contains various structs that satisfy this interface, and which make up the bulk of the behavior of swift-http-import.

type Report ¶

type Report struct {
	Input     <-chan ReportEvent
	Statsd    objects.StatsdConfiguration
	StartTime time.Time

	ExitCode int
}

Report is an actor that counts scraped directories and transferred files. It emits StatsD metrics (if desired), logs the final report, and decides whether to exit with an error status.

Events are read from the `Input` channel until it is closed. The `Done` channel can be closed to interrupt the actor. If the `Statter` is not nil, statsd metrics will be emitted. The `StartTime` is used to measure this run's duration at the end. The `ExitCode` can be read after the actor is done.

func (r *Report) Run()

type ReportEvent ¶

type ReportEvent struct {
	IsDirectory     bool
	DirectoryFailed bool

	IsFile             bool
	FileTransferResult objects.TransferResult
}

ReportEvent counts either a directory that was scraped, or a file that was found (and maybe transferred). It is consumed by the Report actor.

type Scraper ¶

type Scraper struct {
	Context context.Context
	Jobs    []*objects.Job
	Output  chan<- objects.File
	Report  chan<- ReportEvent
}

Scraper is an actor that reads directory listings on the source side to enumerate all files that need to be transferred.

Scraping starts from the root directories of each job in the `Jobs` list. For each input file, a File struct is sent into the `Output` channel. For each directory, a report is sent into the `Report` channel.

func (s *Scraper) Run()

type Transferor ¶

type Transferor struct {
	Context context.Context
	Input   <-chan objects.File
	Report  chan<- ReportEvent
}

Transferor is an actor that transfers files from a Source to a target SwiftLocation.

Files to transfer are read from the `Input` channel until it is closed. For each input file, a report is sent into the `Report` channel.

func (t *Transferor) Run()