Documentation
¶
Overview ¶
Package longmemeval implements the LongMemEval benchmark runner for Cortex.
LongMemEval tests 500 questions across 5 memory abilities: Information Extraction, Multi-Session Reasoning, Temporal Reasoning, Knowledge Updates, and Abstention.
Reference: arXiv:2410.10813
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
Types ¶
type ChatTurn ¶
type ChatTurn struct {
Role string `json:"role"`
Content string `json:"content"`
SessionID int `json:"session_id"`
Timestamp string `json:"timestamp"`
}
ChatTurn represents a single turn in the chat history.
type Config ¶
type Config struct {
DataPath string
Limit int
JudgeCfg *common.JudgeConfig
GraphBoost bool
}
Config controls the benchmark run.
Click to show internal directories.
Click to hide internal directories.