accuracy

package
v0.0.2 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Apr 22, 2026 License: AGPL-3.0 Imports: 5 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type ExpectedAux

type ExpectedAux struct {
	Name string `json:"name"`
	Type string `json:"type"`
}

ExpectedAux is an auxiliary entity assertion in a test case.

type ExpectedRel

type ExpectedRel struct {
	From string `json:"from"`
	To   string `json:"to"`
	Type string `json:"type"`
}

ExpectedRel is a relation assertion in a test case.

type GroundTruth

type GroundTruth struct {
	Version string     `json:"version"`
	Cases   []TestCase `json:"cases"`
}

GroundTruth is the root structure of ground_truth.json.

type ParserStats

type ParserStats struct {
	Type       string
	TP, FP, FN int
	Precision  float64
	Recall     float64
	F1         float64
}

ParserStats holds accuracy metrics for one parser type.

type Results

type Results struct {
	ByParser map[string]*ParserStats
	Overall  ParserStats
}

Results holds accuracy results across all parser types.

func Run

func Run(fsys fs.FS) (*Results, error)

Run executes the accuracy benchmark against all cases in ground_truth.json. fsys must be an fs.FS rooted at the benchmark/testdata directory.

type TestCase

type TestCase struct {
	ID                string        `json:"id"`
	Parser            string        `json:"parser"`
	InputFile         string        `json:"input_file"`
	ExpectedName      string        `json:"expected_entity_name"`
	ExpectedType      string        `json:"expected_entity_type"`
	ExpectedObsSubset []string      `json:"expected_obs_subset"`
	ExpectedRels      []ExpectedRel `json:"expected_rels"`
	ExpectedAux       []ExpectedAux `json:"expected_aux"`
}

TestCase is one entry in ground_truth.json.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL