evalcoverage

package
v0.1.13 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Oct 11, 2026 License: MIT Imports: 5 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func Markdown

func Markdown(m Matrix) string

Markdown renders the matrix as a markdown table.

Types

type Matrix

type Matrix struct {
	Semantic    map[string]row `json:"semantic"`
	Governance  map[string]row `json:"governance"`
	Behaviors   map[string]int `json:"behaviors"`
	PromptLevel map[string]int `json:"promptLevel"`
}

Matrix summarizes coverage counts per capability dimension.

func BuildMatrix

func BuildMatrix(tasks []Task) Matrix

BuildMatrix computes coverage statistics from tasks.

type Task

type Task struct {
	ID               string `yaml:"id"`
	PromptLevel      string `yaml:"prompt_level"`
	ExpectedBehavior string `yaml:"expected_behavior"`
	Dimensions       struct {
		SemanticChallenges   []string `yaml:"semantic_challenges"`
		GovernanceChallenges []string `yaml:"governance_challenges"`
	} `yaml:"dimensions"`
	Violation bool `yaml:"violation"`
}

Task is a minimal view of a diagnostic task for coverage reporting.

func LoadTasks

func LoadTasks(v4MetaPath, additionsPath, dimensionsPath string) ([]Task, error)

LoadTasks merges v4 guided metadata with v5 additions and validates tags.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL