benchdriver

command
v0.49.1 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Nov 13, 2026 License: MIT Imports: 27 Imported by: 0

Documentation

Overview

Command benchdriver runs a scripted scenario against Peen inside a networkless benchmark task container.

The benchmark adapter copies it into the container next to the Peen binary when a harness task ships a scenario. It starts `peen run` as a child process, opens the scenario's sessions in the control agent space, and executes the steps: sending messages over the WebSocket, answering questions, posting session events, stopping turns, killing the worker or the controller at a chosen tool call, restarting the controller, running commands that change the workspace, and sampling memory. At the end it writes every session's durable feed as a frames file and stops the controller, so graders read the same records an exec trial leaves.

The driver log records every step, kill, and restart with its time, so the audit can line them up with Peen's records. See docs/benchmarks.md.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL