dmr

package
v1.2.2 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Apr 13, 2026 License: MIT Imports: 8 Imported by: 0

Documentation

Overview

Package dmr implements the Deep Memory Retrieval benchmark runner for Cortex.

DMR uses the MSC-Self-Instruct dataset (500 conversations). Each conversation has multiple dialog sessions and self-instruct Q&A pairs that test retrieval from earlier sessions.

Reference: arXiv:2310.08560 (MemGPT)

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func Run 

func Run(cfg Config) (*common.BenchmarkResult, error)

Run executes the DMR benchmark against Cortex.

Types

type Config 

type Config struct {
	DataPath   string
	Limit      int
	JudgeCfg   *common.JudgeConfig
	GraphBoost bool
}

Config controls the benchmark run.

type DialogTurn 

type DialogTurn struct {
	Text string `json:"text"`
	ID   string `json:"id"`
}

DialogTurn represents a single turn.

type MSCConversation 

type MSCConversation struct {
	Personas        [][]string        `json:"personas"`
	Dialog          []DialogTurn      `json:"dialog"`
	PreviousDialogs []PreviousDialog  `json:"previous_dialogs"`
	SelfInstruct    map[string]string `json:"self_instruct"` // {"B": question, "A": answer}
	Summary1        json.RawMessage   `json:"summary_speaker_1"`
	Summary2        json.RawMessage   `json:"summary_speaker_2"`
}

MSCConversation represents a single MSC-Self-Instruct conversation.

type PreviousDialog 

type PreviousDialog struct {
	Personas [][]string   `json:"personas"`
	Dialog   []DialogTurn `json:"dialog"`
}

PreviousDialog represents a previous conversation session.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.