adoption

package
v1.1.0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Sep 7, 2026 License: Apache-2.0 Imports: 10 Imported by: 0

Documentation

Overview

Package adoption defines the private discoverability experiment contract.

Index

Constants

View Source 
const (
	// ArmBaseline is the no-focus control condition.
	ArmBaseline = "baseline"
	// ArmDiscoverability exposes focus through MCP only.
	ArmDiscoverability = "discoverability"
	// ArmGuidance adds generic prompt guidance to the focus condition.
	ArmGuidance = "guidance"
	// ArmIntegrated is a diagnostic condition with the shipped skill injected
	// into an isolated Codex home. It is not part of the canonical matrix.
	ArmIntegrated = "integrated"
	// IntegratedInstructionSurface identifies the complete diagnostic surface.
	IntegratedInstructionSurface = "mcp-server-instructions+agentic-go-context-skill"
)
View Source 
const Guidance = "" /* 235-byte string literal not displayed */

Guidance is the generic treatment instruction.

View Source 
const Schema = "agentic.eval.adoption/v1alpha1"

Schema identifies the adoption record contract.

View Source 
const SkillName = "agentic-go-context"

SkillName identifies the shipped model-invoked skill used by the integrated adoption diagnostic.

Variables

This section is empty.

Functions

func Aggregate 

func Aggregate(rs []Run) map[string]any

Aggregate summarizes adoption runs by arm.

func DigestString 

func DigestString(s string) string

DigestString returns the SHA-256 digest of s.

func MatrixArms 

func MatrixArms() []string

MatrixArms returns the conditions required by the canonical matrix.

func ValidArm 

func ValidArm(arm string) bool

ValidArm reports whether arm is a canonical matrix condition or the separate integrated diagnostic condition.

func ValidateMatrix 

func ValidateMatrix(ss []Scenario, rs []Run) error

ValidateMatrix verifies the complete adoption matrix.

Types

type Run 

type Run struct {
	SchemaVersion               string            `json:"schema_version"`
	ScenarioID                  string            `json:"scenario_id"`
	TaskID                      string            `json:"task_id"`
	Arm                         string            `json:"arm"`
	Repetition                  int               `json:"repetition"`
	Model                       string            `json:"model"`
	Reasoning                   string            `json:"reasoning"`
	Prompt                      string            `json:"prompt"`
	PromptSHA256                string            `json:"prompt_sha256"`
	MCPDescriptionSHA256        string            `json:"mcp_description_sha256"`
	SkillSHA256                 string            `json:"skill_sha256,omitempty"`
	EffectiveInstructionSurface string            `json:"effective_instruction_surface,omitempty"`
	SourceSHA256                string            `json:"source_sha256"`
	BinarySHA256                string            `json:"binary_sha256"`
	InitialWorkspaceSHA256      string            `json:"initial_workspace_sha256"`
	PostWorkspaceSHA256         string            `json:"post_workspace_sha256"`
	Transcript                  []json.RawMessage `json:"transcript"`
	TranscriptSHA256            string            `json:"transcript_sha256"`
	Patch                       string            `json:"patch"`
	PatchSHA256                 string            `json:"patch_sha256"`
	Stderr                      string            `json:"stderr,omitempty"`
	ProcessError                string            `json:"process_error,omitempty"`
	FocusDelivery               string            `json:"focus_delivery"`
	WorkspaceSHA256             string            `json:"workspace_sha256"`
	DecisionObligations         []string          `json:"decision_obligations"`
	AcceptanceEvidenceSHA256    string            `json:"acceptance_evidence_sha256"`
	Acceptance                  string            `json:"acceptance"`
	ScopeViolations             []string          `json:"scope_violations"`
	EvidenceBytes               int64             `json:"evidence_bytes"`
	ToolCalls                   int               `json:"tool_calls"`
	FocusToolCalls              int               `json:"focus_tool_calls"`
	FocusFailedCalls            int               `json:"focus_failed_calls"`
	FocusErrorCategories        map[string]int    `json:"focus_error_categories"`
	FirstFocusCallPosition      int               `json:"first_focus_call_position"`
	RefreshUse                  bool              `json:"refresh_use"`
	FocusEvidenceUse            bool              `json:"focus_evidence_use"`
	FocusResultFollowedByEdit   bool              `json:"focus_result_followed_by_edit"`
	RefreshCompleted            bool              `json:"refresh_completed"`
	SkillDiscovered             bool              `json:"skill_discovered"`
	DurationMS                  int64             `json:"duration_ms"`
	OperatorIntervention        bool              `json:"operator_intervention"`
	Uncertainty                 []string          `json:"uncertainty"`
	Qualifying                  bool              `json:"qualifying"`
}

Run records one adoption experiment cell.

func LoadRun 

func LoadRun(path string) (Run, error)

LoadRun loads and canonicalizes one adoption run.

func LoadRuns 

func LoadRuns(path string) ([]Run, error)

LoadRuns loads and canonicalizes an ingested adoption result set.

func SanitizeRun 

func SanitizeRun(r Run) Run

SanitizeRun normalizes private process evidence before it is re-ingested. Hashes are recomputed because sanitization intentionally changes text.

func (Run) FocusEvidenceUseInt 

func (r Run) FocusEvidenceUseInt() int

FocusEvidenceUseInt converts evidence use to an integer count.

type Scenario 

type Scenario struct {
	SchemaVersion string   `json:"schema_version"`
	ID            string   `json:"id"`
	TaskID        string   `json:"task_id"`
	Prompt        string   `json:"prompt"`
	Obligations   []string `json:"obligations"`
}

Scenario describes an adoption task.

func LoadScenarios 

func LoadScenarios(root string) ([]Scenario, error)

LoadScenarios loads the two adoption scenarios from root.

type Skill 

type Skill struct {
	Root   string
	Digest string
	Files  map[string][]byte
}

Skill is the validated, content-addressed skill payload.

func LoadSkill 

func LoadSkill(root string) (Skill, error)

LoadSkill validates the minimal shipped skill and computes a deterministic digest over its two instruction files.

func (Skill) Install 

func (s Skill) Install(home string) (string, error)

Install copies the validated skill to an isolated Codex home. The returned path is outside the candidate workspace and is suitable for CODEX_HOME.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.