runtime

module
v2.12.1 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Oct 3, 2026 License: Apache-2.0

Directories

Path Synopsis
a2a
Package a2a provides types for the Agent-to-Agent (A2A) protocol.
Package a2a provides types for the Agent-to-Agent (A2A) protocol.
mock
Package mock provides a configurable mock A2A server for use in tests.
Package mock provides a configurable mock A2A server for use in tests.
Package annotations provides out-of-band annotations for session recordings.
Package annotations provides out-of-band annotations for session recordings.
Package audio provides voice activity detection (VAD), turn detection, and audio session management for real-time voice AI applications.
Package audio provides voice activity detection (VAD), turn detection, and audio session management for real-time voice AI applications.
Package classify defines task-oriented inference interfaces for non-LLM workloads.
Package classify defines task-oriented inference interfaces for non-LLM workloads.
backends/all
Package all blank-imports every classify backend so their factories self-register.
Package all blank-imports every classify backend so their factories self-register.
backends/hf
Package hf implements the runtime/classify interfaces against the HuggingFace Inference API.
Package hf implements the runtime/classify interfaces against the HuggingFace Inference API.
backends/topiccontrol
Package topiccontrol implements classify.TopicClassifier against NVIDIA's Llama-3.1-NemoGuard-8B TopicControl model, served by NIM over an OpenAI-compatible chat-completions endpoint.
Package topiccontrol implements classify.TopicClassifier against NVIDIA's Llama-3.1-NemoGuard-8B TopicControl model, served by NIM over an OpenAI-compatible chat-completions endpoint.
Package composition defines RFC 0010 workflow-composition types and their validation.
Package composition defines RFC 0010 workflow-composition types and their validation.
engine
Package engine is the deterministic orchestrator core for RFC 0010 workflow compositions.
Package engine is the deterministic orchestrator core for RFC 0010 workflow compositions.
Package credentials provides credential management for LLM provider authentication.
Package credentials provides credential management for LLM provider authentication.
Package evals provides the core evaluation framework for PromptPack.
Package evals provides the core evaluation framework for PromptPack.
handlers
Package handlers provides eval type handler implementations.
Package handlers provides eval type handler implementations.
Package events provides event storage and replay for session recording.
Package events provides event storage and replay for session recording.
Package hooks provides synchronous interception points for provider calls, tool execution, and session lifecycle in the PromptKit runtime.
Package hooks provides synchronous interception points for provider calls, tool execution, and session lifecycle in the PromptKit runtime.
execconfig
Package execconfig holds the declarative shape of exec-hook, exec-eval and sandbox bindings.
Package execconfig holds the declarative shape of exec-hook, exec-eval and sandbox bindings.
guardrails
Package guardrails provides built-in ProviderHook implementations that bridge the unified eval system to the pipeline's hook infrastructure.
Package guardrails provides built-in ProviderHook implementations that bridge the unified eval system to the pipeline's hook infrastructure.
sandbox
Package sandbox defines the Sandbox interface used by exec-backed hooks to externalize where and how the hook subprocess is spawned.
Package sandbox defines the Sandbox interface used by exec-backed hooks to externalize where and how the hook subprocess is spawned.
sandbox/direct
Package direct provides the default Sandbox implementation for exec hooks: it spawns the command as a local subprocess via exec.CommandContext.
Package direct provides the default Sandbox implementation for exec hooks: it spawns the command as a local subprocess via exec.CommandContext.
Package httputil provides shared HTTP client construction utilities for the PromptKit project.
Package httputil provides shared HTTP client construction utilities for the PromptKit project.
Package inference defines a single generic Provider interface for every classification-shaped inference call PromptKit makes against a vendor API (zero-shot text classification, topic control, moderation, and similar label-scoring tasks).
Package inference defines a single generic Provider interface for every classification-shaped inference call PromptKit makes against a vendor API (zero-shot text classification, topic control, moderation, and similar label-scoring tasks).
all
Package all blank-imports every inference provider so their factories self-register.
Package all blank-imports every inference provider so their factories self-register.
huggingface
Package huggingface implements inference.Provider over the HuggingFace Inference API: HF's serverless router (router.huggingface.co/hf-inference) or a dedicated HF Inference Endpoint.
Package huggingface implements inference.Provider over the HuggingFace Inference API: HF's serverless router (router.huggingface.co/hf-inference) or a dedicated HF Inference Endpoint.
openai
Package openai implements inference.Provider over any OpenAI-compatible chat-completions endpoint that returns token logprobs — OpenAI itself, NVIDIA's hosted NemoGuard models, vLLM, LiteLLM and most gateways.
Package openai implements inference.Provider over any OpenAI-compatible chat-completions endpoint that returns token logprobs — OpenAI itself, NVIDIA's hosted NemoGuard models, vLLM, LiteLLM and most gateways.
systemone
Package systemone implements inference.Provider over the "typed decision" wire protocol: POST {base}/systemone with a shared state and a named typed question, answered with a probability distribution rather than generated text.
Package systemone implements inference.Provider over the "typed decision" wire protocol: POST {base}/systemone with a shared state and a named typed question, answered with a probability distribution rather than generated text.
internal
lru
Package lru provides a generic least-recently-used cache.
Package lru provides a generic least-recently-used cache.
Package logger provides structured logging with automatic PII redaction.
Package logger provides structured logging with automatic PII redaction.
Package mcp is PromptKit's Model Context Protocol client.
Package mcp is PromptKit's Model Context Protocol client.
Package media provides utilities for processing media content.
Package media provides utilities for processing media content.
Package mediagen provides the built-in image__generate and video__generate tools.
Package mediagen provides the built-in image__generate and video__generate tools.
Package memory defines interfaces and types for agentic memory — cross-session knowledge that persists beyond a single conversation.
Package memory defines interfaces and types for agentic memory — cross-session knowledge that persists beyond a single conversation.
corpus
Package corpus provides a reference memory.Retriever over a fixed set of documents — a knowledge base the host supplies, separate from the memory.Store the memory tools read and write.
Package corpus provides a reference memory.Retriever over a fixed set of documents — a knowledge base the host supplies, separate from the memory.Store the memory tools read and write.
Package metrics provides the unified PromptKit metrics collector.
Package metrics provides the unified PromptKit metrics collector.
Package packspec holds the Go types generated from the PromptPack schema.
Package packspec holds the Go types generated from the PromptPack schema.
Package persistence provides persistence interfaces and common errors.
Package persistence provides persistence interfaces and common errors.
common
Package common provides shared functionality for persistence repositories.
Package common provides shared functionality for persistence repositories.
json
Package json provides JSON file-based implementations of persistence repositories.
Package json provides JSON file-based implementations of persistence repositories.
memory
Package memory provides in-memory implementations of persistence repositories.
Package memory provides in-memory implementations of persistence repositories.
yaml
Package yaml provides YAML file-based implementations of persistence repositories.
Package yaml provides YAML file-based implementations of persistence repositories.
Package pipeline provides types and configuration for stage-based pipeline execution.
Package pipeline provides types and configuration for stage-based pipeline execution.
stage
Package stage provides the reactive streams architecture for pipeline execution.
Package stage provides the reactive streams architecture for pipeline execution.
Package prompt provides template-based prompt management and assembly.
Package prompt provides template-based prompt management and assembly.
agentcard
Package agentcard generates A2A Agent Cards from a compiled Pack's agents section.
Package agentcard generates A2A Agent Cards from a compiled Pack's agents section.
schema
Package schema provides embedded PromptPack schema for offline validation.
Package schema provides embedded PromptPack schema for offline validation.
Package providers implements multi-LLM provider support with unified interfaces.
Package providers implements multi-LLM provider support with unified interfaces.
all
Package all provides a convenient way to register all PromptKit providers with a single import.
Package all provides a convenient way to register all PromptKit providers with a single import.
base
Package base defines the unified provider abstraction shared across all PromptKit provider types (inference, TTS, STT, embedding, image generation).
Package base defines the unified provider abstraction shared across all PromptKit provider types (inference, TTS, STT, embedding, image generation).
bedrock
Package bedrock provides embedding generation via AWS Bedrock's platform-native models.
Package bedrock provides embedding generation via AWS Bedrock's platform-native models.
claude
Package claude provides Anthropic Claude LLM provider integration.
Package claude provides Anthropic Claude LLM provider integration.
cohere
Package cohere provides reranking via the Cohere Rerank API.
Package cohere provides reranking via the Cohere Rerank API.
conformance
Package conformance contains integration tests that verify each inference provider implementation satisfies the base.Provider interface.
Package conformance contains integration tests that verify each inference provider implementation satisfies the base.Provider interface.
gemini
Package gemini provides Gemini Live API streaming support.
Package gemini provides Gemini Live API streaming support.
huggingface
Package huggingface implements providers.EmbeddingProvider against Hugging Face's feature-extraction API: the serverless Inference Providers router (https://router.huggingface.co/hf-inference) and dedicated Inference Endpoints, which serve the same request and response shape.
Package huggingface implements providers.EmbeddingProvider against Hugging Face's feature-extraction API: the serverless Inference Providers router (https://router.huggingface.co/hf-inference) and dedicated Inference Endpoints, which serve the same request and response shape.
imagen
Package imagen provides Google Imagen image generation provider integration.
Package imagen provides Google Imagen image generation provider integration.
internal/streaming
Package streaming provides a common WebSocket streaming session abstraction used by provider implementations (OpenAI Realtime, Gemini Live, etc.).
Package streaming provides a common WebSocket streaming session abstraction used by provider implementations (OpenAI Realtime, Gemini Live, etc.).
mock
Package mock provides mock provider implementation for testing and development.
Package mock provides mock provider implementation for testing and development.
ollama
Package ollama provides Ollama LLM provider integration for local development.
Package ollama provides Ollama LLM provider integration for local development.
openai
Package openai provides OpenAI LLM provider integration.
Package openai provides OpenAI LLM provider integration.
replay
Package replay provides a provider that replays recorded sessions deterministically.
Package replay provides a provider that replays recorded sessions deterministically.
schemaadapt
Package schemaadapt walks a JSON Schema so provider adapters can rewrite it into the dialect their API accepts.
Package schemaadapt walks a JSON Schema so provider adapters can rewrite it into the dialect their API accepts.
vertex
Package vertex provides embedding generation via Google Vertex AI's text-embedding models.
Package vertex provides embedding generation via Google Vertex AI's text-embedding models.
vllm
Package vllm provides vLLM LLM provider integration for high-performance inference.
Package vllm provides vLLM LLM provider integration for high-performance inference.
voyageai
Package voyageai provides embedding generation via the Voyage AI API.
Package voyageai provides embedding generation via the Voyage AI API.
Package recording provides session recording export and import for replay and analysis.
Package recording provides session recording export and import for replay and analysis.
Package safe provides panic-safe goroutine helpers.
Package safe provides panic-safe goroutine helpers.
Package selection defines the externalized selector interface that narrows a candidate set of skills or tools down to the items most relevant for the current turn.
Package selection defines the externalized selector interface that narrows a candidate set of skills or tools down to the items most relevant for the current turn.
Package skills provides types and utilities for loading, parsing, and managing PromptKit skills defined via the AgentSkills.io SKILL.md format.
Package skills provides types and utilities for loading, parsing, and managing PromptKit skills defined via the AgentSkills.io SKILL.md format.
Package statestore provides conversation state persistence and management.
Package statestore provides conversation state persistence and management.
file
Package file provides a filesystem-backed statestore implementation.
Package file provides a filesystem-backed statestore implementation.
Package storage exposes the MediaStorageService interface for media persistence, plus instrumentation that wires storage operations into the runtime's event bus and OpenTelemetry spans.
Package storage exposes the MediaStorageService interface for media persistence, plus instrumentation that wires storage operations into the runtime's event bus and OpenTelemetry spans.
local
Package local provides local filesystem-based storage implementation.
Package local provides local filesystem-based storage implementation.
policy
Package policy provides storage retention and cleanup policy management.
Package policy provides storage retention and cleanup policy management.
Package streaming provides generic utilities for bidirectional streaming communication with LLM providers.
Package streaming provides generic utilities for bidirectional streaming communication with LLM providers.
Package stt provides speech-to-text services for converting audio to text.
Package stt provides speech-to-text services for converting audio to text.
Package telemetry provides OpenTelemetry integration for PromptKit, including TracerProvider management and an event-to-span listener.
Package telemetry provides OpenTelemetry integration for PromptKit, including TracerProvider management and an event-to-span listener.
Package template provides template rendering and variable substitution.
Package template provides template rendering and variable substitution.
Package testutil provides shared test helper utilities.
Package testutil provides shared test helper utilities.
Package tokenizer provides token counting functionality for LLM context management.
Package tokenizer provides token counting functionality for LLM context management.
Package tools provides tool/function calling infrastructure for LLM testing.
Package tools provides tool/function calling infrastructure for LLM testing.
tts
Package tts provides text-to-speech services.
Package tts provides text-to-speech services.
markup
Package markup is the canonical scanner for TTS characterization tags.
Package markup is the canonical scanner for TTS characterization tags.
Package variables provides dynamic variable resolution for prompt templates.
Package variables provides dynamic variable resolution for prompt templates.
Package version provides version information for the PromptKit runtime.
Package version provides version information for the PromptKit runtime.
Package workflow defines types and logic for PromptPack workflow state machines (RFC 0005).
Package workflow defines types and logic for PromptPack workflow state machines (RFC 0005).

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL