evalmem

package
v0.4.1 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Aug 29, 2026 License: MIT Imports: 7 Imported by: 0

Documentation

Overview

Package evalmem provides an in-memory eval.Store — for local dev, CI, and one-shot eval runs. Not for production traffic: no durability, no cross-process visibility. Mirrors agentloopmem's role for SessionStore/StepStore, for eval.Store.

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type InMemoryStore

type InMemoryStore struct {
	// contains filtered or unexported fields
}

InMemoryStore is a thread-safe, map-backed eval.Store. Cases and runs cascade on DeleteSuite.

func New

func New() *InMemoryStore

New returns an empty InMemoryStore.

func (*InMemoryStore) AddCase

func (s *InMemoryStore) AddCase(_ context.Context, suiteID, name, input, criteria string, passThreshold int32, items []eval.CriterionItem) (eval.Case, error)

func (*InMemoryStore) CreateRun

func (s *InMemoryStore) CreateRun(_ context.Context, suiteID string) (eval.Run, error)

func (*InMemoryStore) CreateSuite

func (s *InMemoryStore) CreateSuite(_ context.Context, name, judgeModel string) (eval.Suite, error)

func (*InMemoryStore) DeleteCase

func (s *InMemoryStore) DeleteCase(_ context.Context, id string) error

func (*InMemoryStore) DeleteSuite

func (s *InMemoryStore) DeleteSuite(_ context.Context, id string) error

func (*InMemoryStore) FinishRun

func (s *InMemoryStore) FinishRun(_ context.Context, id, status string, results []eval.CaseResult, summary eval.RunSummary) error

func (*InMemoryStore) GetRun

func (s *InMemoryStore) GetRun(_ context.Context, id string) (eval.Run, error)

func (*InMemoryStore) GetSuite

func (s *InMemoryStore) GetSuite(_ context.Context, id string) (eval.Suite, error)

func (*InMemoryStore) ListCases

func (s *InMemoryStore) ListCases(_ context.Context, suiteID string) ([]eval.Case, error)

func (*InMemoryStore) ListRuns

func (s *InMemoryStore) ListRuns(_ context.Context, suiteID string) ([]eval.Run, error)

func (*InMemoryStore) ListSuites

func (s *InMemoryStore) ListSuites(_ context.Context) ([]eval.Suite, error)

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL