prowloader

package
v0.0.0-...-8075060 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Oct 12, 2026 License: Apache-2.0 Imports: 46 Imported by: 0

Documentation

Index

Constants

View Source
const DefaultLookbackDays = 14
View Source
const LabelsDatasetEnv = "JOB_LABELS_DATASET"
View Source
const LabelsTableName = "job_labels"

Variables

This section is empty.

Functions

func GatherLabelsFromBQ

func GatherLabelsFromBQ(ctx context.Context, bqClient *bqcachedclient.Client, buildIDs []string, startTime time.Time) (map[string]pq.StringArray, error)

GatherLabelsFromBQ queries BigQuery for labels for multiple job runs. Large ID lists are automatically batched to avoid exceeding BigQuery's request size limit. The startTime is used to constrain the scan to recent date partitions. Returns a map of buildID → labels. If a batch fails, the returned map contains labels from previously completed batches and the error is also returned.

func GetClusterDataBytes

func GetClusterDataBytes(ctx context.Context, bkt *storage.BucketHandle, path string, matches []string) ([]byte, error)

func GetGCSPathForProwJobURL

func GetGCSPathForProwJobURL(pjLog log.FieldLogger, prowJobURL string) (string, error)

func ParseVariantDataFile

func ParseVariantDataFile(bytes []byte) (map[string]string, error)

Types

type DateTimeName

type DateTimeName struct {
	Name string
	Date string
	Time string
}

type ProwLoader

type ProwLoader struct {
	// contains filtered or unexported fields
}

func New

func New(
	ctx context.Context,
	dbc *db.DB,
	gcsClient *storage.Client,
	bigQueryClient *bqcachedclient.Client,
	githubClient *github.Client,
	variantManager testidentification.VariantManager,
	syntheticTestManager synthetictests.SyntheticTestManager,
	releases []string,
	config *v1config.SippyConfig,
	ghCommenter *commenter.GitHubCommenter,
	promPusher *push.Pusher,
	loadSince *time.Time,
	syntheticReleaseJobOverrides *releaseoverride.SyntheticReleaseOverrides) *ProwLoader

func (*ProwLoader) Errors

func (pl *ProwLoader) Errors() []error

func (*ProwLoader) Load

func (pl *ProwLoader) Load()

func (*ProwLoader) Name

func (pl *ProwLoader) Name() string

type ReleaseAttributor

type ReleaseAttributor struct {
	// contains filtered or unexported fields
}

ReleaseAttributor applies the same release matching rules to Prow jobs no matter whether they are being loaded or independently verified.

func NewReleaseAttributor

func NewReleaseAttributor(releases []string, config *v1config.SippyConfig, syntheticReleaseJobOverrides *releaseoverride.SyntheticReleaseOverrides) *ReleaseAttributor

func (*ReleaseAttributor) Match

func (a *ReleaseAttributor) Match(pj *prow.ProwJob) string

Match returns the release a Prow job belongs to, or an empty string when it does not match one of the releases supplied to the attributor.

Directories

Path Synopsis

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL