eino-ext

Package activity exposes a Kilocode-style live "activity" stream of what agents, LLMs and tools are doing during an eino run, suitable for fan-out to a UI over SSE (or any other transport).

Package metrics provides an optional Prometheus collector for the activity package: it subscribes to a Bus session and, on step.ended events, records per-model/agent token and cost counters.

Package sse fans an activity.Bus out over HTTP Server-Sent Events using Hertz.

Package log provides a callbacks.Handler that logs eino component lifecycle events via logrus with structured fields, making it easy to inspect agent execution in production and development.

Package oteltrace provides a callbacks.Handler that records OpenTelemetry spans for eino component lifecycle: a span per chat-model generate (with token-usage attributes) and a span per tool call (with name + error attributes).

Package file provides a simple JSONL-backed MemoryStore implementation.

Package opensearch provides an OpenSearch-backed implementation of the MemoryStore interface for persistent, production-grade agent memory storage with BM25 text search and optional kNN vector search via eino's indexer/opensearch and retriever/opensearch components.

Package profilesupervisor provides a profile supervisor agent factory that dynamically selects, at runtime, the sub-agent whose shell sandbox uses the right OCI base image for the task.

Package prune provides a document.Transformer that removes documents whose trimmed content is below a configurable minimum length.

Package opensearch provides an Indexer implementation backed by OpenSearch, plus supporting utilities for index lifecycle management (field mapping merges, source-hash lookups, bulk reconciliation).

Command contextopt_persistent demonstrates how to combine the cross-request session condenser (components/memory/session) with the intra-run context optimizer (components/middleware/contextopt) WITHOUT paying the LLM summarization cost twice.

Package runner bridges an eino adk.Runner run to the cross-request session lifecycle (session.Turn) so that any eino project gets streaming + history persistence out of the box, without re-implementing the glue per project.

Package session provides the generic, cross-request lifecycle for persisting a conversation history on top of a memory.Memory store.

Package agentattr provides an adk.ChatModelAgentMiddleware that attributes the callbacks/activity event stream to a named agent.

Package contextopt provides context-window optimization strategies (inspired by kilocode's session compaction) for the eino ecosystem.

Package promptenhance provides an ADK middleware that enhances user prompts through a small model and optionally asks for human approval before sending the enhanced version to the supervisor.

Package safety provides an adk.ChatModelAgentMiddleware that enforces a safety control layer around LLM tool invocations.

Package cachestab provides a deterministic, non-destructive normalization of tool definitions to maximize prompt-cache stability (port of headroom's tool_def_normalize).

Package chatmodel provides a provider-generic factory for constructing an eino model.ToolCallingChatModel from a single, additive Config.

Package copilot provides a GitHub Copilot provider implementation.

Package prompt provides a base of solid system prompts by type, extensible per project.

Package github provides eino tools that interact with GitHub repositories, issues, pull requests, releases, branches, and webhooks.

Package opensearch_retriever provides a generic tool.InvokableTool that wraps the existing OpenSearch retriever, enabling semantic document search via natural-language queries as an invokable tool.

Package shell provides an eino shell tool backed by the Dagger engine.

Package websearch provides eino tools for DuckDuckGo web search and URL fetching with anti-bot mitigations (cookie jar, browser headers, session warm-up), HTML-to-Markdown conversion, and SSRF protection.

Package contentcomp defines the shared, dependency-free contracts used by the deterministic per-message content compressors (jsoncrush, shellout) and by the contextopt middleware that orchestrates them.

Package jsoncrush provides a deterministic, lossless "crush" of JSON arrays of objects: keys common to every row (with an identical value) are hoisted into a shared "_defaults" block, leaving only per-row deviations.

Package shellout provides deterministic, opt-in compressors for noisy CLI / log / diff output (ported in spirit from headroom's log/diff/search compressors and lean-ctx's pattern table).

Package costtrack provides a facade for real-time LLM cost tracking: it wires the activity bus, models.dev catalog pricer, Prometheus metrics collector, cost-saver analysis, and per-session real-time aggregation into a single builder API.

Package otel implements costtrack.Recorder against the OpenTelemetry global metric scope (libs/otelmetrics).

Package docid provides shared helpers to compute deterministic document base IDs and content hashes, usable both inside indexing graphs (as a lambda) and outside of them (e.g.

Package modelsdev provides a provider-generic models.dev catalog: per-model context/output limits and USD-per-million-token cost, mirroring kilocode's core/models-dev.

Command gen refreshes the committed libs/modelsdev/api.json snapshot from models.dev.

Package otelmetrics is a thin, reusable wrapper over the OpenTelemetry global MeterProvider.

Package promptenhance provides prompt rewriting using a small/cheap model.

Package checkup provides types and helpers for component connectivity and RBAC diagnostics.

Package confirm provides shared helpers for gating destructive tool operations behind an explicit confirmation flag.

Package dagger provides a wrapper around the Dagger engine client for building and managing OCI containers with shared cache volumes and egress proxy bindings.

Package egress provides a policy-driven HTTP/HTTPS egress proxy that enforces "local network forbidden by default" with an allowlist and AllowLocalNetwork toggle.

Package osclient provides a shared constructor for the eino-ext OpenSearch v4 client (github.com/disaster37/opensearch/v4).

Package profile provides project-type detection and base-image selection.

Package safety provides shared primitives for building a safety control layer around LLM tool invocations.

Package strutil provides small string helpers shared across components: length-capped truncation with a marker, and extraction of a JSON block from free-form LLM output.

Package toolutil provides small shared helpers for tool components: consistent "not found" errors for named instances/clusters and sorted map key extraction for configuration maps.