Documentation
¶
Index ¶
- func AppendEventSequencesFromPreemptedJobs(eventSequences []*armadaevents.EventSequence, ...) ([]*armadaevents.EventSequence, error)
- func AppendEventSequencesFromReconciliationFailureJobs(eventSequences []*armadaevents.EventSequence, ...) ([]*armadaevents.EventSequence, error)
- func AppendEventSequencesFromScheduledJobs(eventSequences []*armadaevents.EventSequence, ...) ([]*armadaevents.EventSequence, error)
- func EventsFromSchedulerResult(result *scheduling.SchedulerResult, time time.Time) ([]*armadaevents.EventSequence, error)
- func Run(config schedulerconfig.Configuration) error
- type ExecutorApi
- type GangValidator
- type MetricsCollector
- type Scheduler
- type SubmitChecker
- type SubmitGangValidator
- type SubmitScheduleChecker
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func AppendEventSequencesFromPreemptedJobs ¶ added in v0.3.90
func AppendEventSequencesFromPreemptedJobs(eventSequences []*armadaevents.EventSequence, jctxs []*schedulercontext.JobSchedulingContext, time time.Time) ([]*armadaevents.EventSequence, error)
func AppendEventSequencesFromReconciliationFailureJobs ¶ added in v0.20.24
func AppendEventSequencesFromReconciliationFailureJobs(eventSequences []*armadaevents.EventSequence, reconciliationResult *scheduling.ReconciliationResult, time time.Time) ([]*armadaevents.EventSequence, error)
func AppendEventSequencesFromScheduledJobs ¶ added in v0.3.90
func AppendEventSequencesFromScheduledJobs(eventSequences []*armadaevents.EventSequence, jctxs []*schedulercontext.JobSchedulingContext) ([]*armadaevents.EventSequence, error)
func EventsFromSchedulerResult ¶ added in v0.3.90
func EventsFromSchedulerResult(result *scheduling.SchedulerResult, time time.Time) ([]*armadaevents.EventSequence, error)
EventsFromSchedulerResult generates necessary EventSequences from the provided SchedulerResult.
func Run ¶
func Run(config schedulerconfig.Configuration) error
Run sets up a Scheduler application and runs it until a SIGTERM is received
Types ¶
type ExecutorApi ¶
type ExecutorApi struct {
// contains filtered or unexported fields
}
ExecutorApi is the gRPC service executors use to synchronise their state with that of the scheduler.
func NewExecutorApi ¶
func NewExecutorApi(publisher pulsarutils.Publisher[*armadaevents.EventSequence], jobRepository database.JobRepository, executorRepository database.ExecutorRepository, allowedPriorities []int32, allowedResources []string, nodeIdLabel string, priorityClassNameOverride *string, priorityClasses map[string]priorityTypes.PriorityClass, authorizer auth.ActionAuthorizer, ) (*ExecutorApi, error)
func (*ExecutorApi) LeaseJobRuns ¶
func (srv *ExecutorApi) LeaseJobRuns(stream executorapi.ExecutorApi_LeaseJobRunsServer) error
LeaseJobRuns reconciles the state of the executor with that of the scheduler. Specifically it: 1. Stores job and capacity information received from the executor to make it available to the scheduler. 2. Notifies the executor if any of its jobs are no longer active, e.g., due to being preempted by the scheduler. 3. Transfers any jobs scheduled on this executor cluster that the executor don't already have.
func (*ExecutorApi) ReportEvents ¶
func (srv *ExecutorApi) ReportEvents(grpcCtx context.Context, list *executorapi.EventList) (*types.Empty, error)
ReportEvents publishes all eventSequences to Pulsar. The eventSequences are compacted for more efficient publishing.
type GangValidator ¶ added in v0.20.13
type GangValidator struct{}
func NewGangValidator ¶ added in v0.20.13
func NewGangValidator() *GangValidator
type MetricsCollector ¶ added in v0.3.54
type MetricsCollector struct {
// contains filtered or unexported fields
}
MetricsCollector is a Prometheus Collector that handles scheduler metrics. The metrics themselves are calculated asynchronously every refreshPeriod
func NewMetricsCollector ¶ added in v0.3.54
func NewMetricsCollector( jobDb *jobdb.JobDb, queueCache queue.QueueCache, bidPriceProvider pricing.BidPriceProvider, executorRepository database.ExecutorRepository, pools []configuration.PoolConfig, queuedJobPrimaryPoolReportingOrder []string, refreshPeriod time.Duration, floatingResourceTypes *floatingresources.FloatingResourceTypes, scalableUnitLabel string, ) *MetricsCollector
func (*MetricsCollector) Collect ¶ added in v0.3.54
func (c *MetricsCollector) Collect(metrics chan<- prometheus.Metric)
Collect returns the current state of all metrics of the collector.
func (*MetricsCollector) Describe ¶ added in v0.3.54
func (c *MetricsCollector) Describe(out chan<- *prometheus.Desc)
Describe returns all descriptions of the collector.
func (*MetricsCollector) Run ¶ added in v0.3.54
func (c *MetricsCollector) Run(ctx *armadacontext.Context) error
Run enters s a loop which updates the metrics every refreshPeriod until the supplied context is cancelled
type Scheduler ¶
type Scheduler struct {
// contains filtered or unexported fields
}
Scheduler is the main Armada scheduler. It periodically performs the following cycle: 1. Update state from postgres (via the jobRepository). 2. Determine if leader and exit if not. 3. Generate any necessary eventSequences resulting from the state update. 4. Expire any jobs assigned to clusters that have timed out. 5. Schedule jobs. 6. Publish any Armada eventSequences resulting from the scheduling cycle.
func NewScheduler ¶
func NewScheduler( jobDb *jobdb.JobDb, jobRepository database.JobRepository, executorRepository database.ExecutorRepository, runner runner.SchedulingRunner, leaderController leaderelection.LeaderController, publisher publisher.Publisher, submitChecker SubmitScheduleChecker, gangValidator SubmitGangValidator, cyclePeriod time.Duration, schedulePeriod time.Duration, executorTimeout time.Duration, shortJobPenalty *scheduling.ShortJobPenalty, maxAttemptedRuns uint, nodeIdLabel string, metrics *metrics.Metrics, bidPriceProvider pricing.BidPriceProvider, marketDrivenPools []string, queueCache queue.QueueCache, ) (*Scheduler, error)
func (*Scheduler) EnableAssertions ¶ added in v0.4.12
func (s *Scheduler) EnableAssertions()
type SubmitChecker ¶
type SubmitChecker struct {
// contains filtered or unexported fields
}
func NewSubmitChecker ¶
func NewSubmitChecker( schedulingConfig configuration.SchedulingConfig, submitCheckConfig configuration.SubmitCheckConfig, executorRepository database.ExecutorRepository, queueCache queue.QueueCache, floatingResourceTypes *floatingresources.FloatingResourceTypes, resourceListFactory *internaltypes.ResourceListFactory, ) *SubmitChecker
func (*SubmitChecker) Check ¶
func (srv *SubmitChecker) Check(ctx *armadacontext.Context, jobs []*jobdb.Job) (map[string]schedulingResult, map[string]time.Duration, error)
func (*SubmitChecker) Initialise ¶ added in v0.16.5
func (srv *SubmitChecker) Initialise(ctx *armadacontext.Context) error
func (*SubmitChecker) Run ¶ added in v0.3.49
func (srv *SubmitChecker) Run(ctx *armadacontext.Context) error
type SubmitGangValidator ¶ added in v0.20.13
Source Files
¶
Directories
¶
| Path | Synopsis |
|---|---|
|
kubernetesobjects
|
|
|
Package schedulermocks is a generated GoMock package.
|
Package schedulermocks is a generated GoMock package. |
|
Package retry decides whether a failed job run should be retried or failed permanently.
|
Package retry decides whether a failed job run should be retried or failed permanently. |