semengine

module
v0.1.0-alpha.4 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Nov 11, 2026 License: MIT

Directories

Path Synopsis
Package component defines the Discoverable interface and related types
Package component defines the Discoverable interface and related types
Package composition validates a component composition — the boot configuration's components composed with the catalog a binary registers — as a pure function, and projects it as a graph.
Package composition validates a component composition — the boot configuration's components composed with the catalog a binary registers — as a pure function, and projects it as a graph.
Package config reads a SemEngine process's configuration and declares the JetStream streams it needs, and its Manager keeps that configuration in a NATS key-value bucket across restarts.
Package config reads a SemEngine process's configuration and declares the JetStream streams it needs, and its Manager keeps that configuration in a NATS key-value bucket across restarts.
gateway
graph-gateway
Package graphgateway provides graph-gateway, a read-only GraphQL view of the graph.
Package graphgateway provides graph-gateway, a read-only GraphQL view of the graph.
Package graph holds the data model and the wire types of SemEngine's entity graph.
Package graph holds the data model and the wire types of SemEngine's entity graph.
clustering
Package clustering groups entities by entity-ID prefix and publishes one bounded record per group to the COMMUNITY_INDEX bucket.
Package clustering groups entities by entity-ID prefix and publishes one bounded record per group to the COMMUNITY_INDEX bucket.
embedding
Package embedding turns the text of graph entities into vectors, stores them, and finds the nearest ones.
Package embedding turns the text of graph entities into vectors, stores them, and finds the nearest ones.
follower
Package follower follows ENTITY_STATES for a projection owner: it waits for the bucket, holds the one watch on it, replays the stored entities and then the live writes in delivery order, and keeps the owner's readiness: the watermark of applied revisions, the bootstrap latch, the reset latch, the lost-feed state, and the envelope it publishes to GRAPH_STATUS on every heartbeat (ADR-108 D4).
Package follower follows ENTITY_STATES for a projection owner: it waits for the bucket, holds the one watch on it, replays the stored entities and then the live writes in delivery order, and keeps the owner's readiness: the watermark of applied revisions, the bootstrap latch, the reset latch, the lost-feed state, and the envelope it publishes to GRAPH_STATUS on every heartbeat (ADR-108 D4).
inference
Package inference derives an entity's hierarchy statements from its 6-part ID (org.platform.system.domain.type.instance, ADR-102).
Package inference derives an entity's hierarchy statements from its 6-part ID (org.platform.system.domain.type.instance, ADR-102).
kvcatalog
Package kvcatalog holds the framework KV bucket catalog: the ONE literal table of every KV bucket whose write-ownership or retention the framework guarantees.
Package kvcatalog holds the framework KV bucket catalog: the ONE literal table of every KV bucket whose write-ownership or retention the framework guarantees.
query
Package query classifies a natural-language question into search hints: the time range, area, path start, aggregation or ranking it asks for.
Package query classifies a natural-language question into search hints: the time range, area, path start, aggregation or ranking it asks for.
readiness
Package readiness writes and reads the readiness envelope a producer keeps in the GRAPH_STATUS KV bucket, and holds the gate that judges one.
Package readiness writes and reads the readiness envelope a producer keeps in the GRAPH_STATUS KV bucket, and holds the gate that judges one.
Package health holds the health report a service gives, and the two functions that turn several reports, or a component's own report, into one.
Package health holds the health report a service gives, and the two functions that turn several reports, or a component's own report, into one.
internal
cache
Package cache provides generic, thread-safe cache implementations with configurable eviction policies.
Package cache provides generic, thread-safe cache implementations with configurable eviction policies.
dispatch
Package dispatch provides KeyedPool, a worker pool that keeps per-key order: work items that share a key are processed one at a time, in the order they were submitted, while items with different keys run concurrently.
Package dispatch provides KeyedPool, a worker pool that keeps per-key order: work items that share a key are processed one at a time, in the order they were submitted, while items with different keys run concurrently.
flowgraph
Package flowgraph builds a graph of how components connect through their declared ports and reports what that graph shows: which components are connected, which have no connections, and which ports nothing matches.
Package flowgraph builds a graph of how components connect through their declared ports and reports what that graph shows: which components are connected, which have no connections, and which ports nothing matches.
graphmutation
Package graphmutation owns the in-repository graph mutation protocol identity.
Package graphmutation owns the in-repository graph mutation protocol identity.
harness/contract
Package contract holds SemEngine's machine-checked harness boundaries (openspec change setup-02-isolated-harness, contract tests T-B1..T-B7).
Package contract holds SemEngine's machine-checked harness boundaries (openspec change setup-02-isolated-harness, contract tests T-B1..T-B7).
harness/lifecycletest
Package lifecycletest is the portable owner-lifecycle floor (openspec change setup-02-isolated-harness, capability lifecycle-suite), adapted from SemStreams component/lifecycle_test_suite.go at 5457b345 (ledger row L4) without testify, without aggregate goroutine or memory counts (they cannot prove an owner's join), and as error-returning checks so each one's sensitivity is testable against a failpoint double.
Package lifecycletest is the portable owner-lifecycle floor (openspec change setup-02-isolated-harness, capability lifecycle-suite), adapted from SemStreams component/lifecycle_test_suite.go at 5457b345 (ledger row L4) without testify, without aggregate goroutine or memory counts (they cannot prove an owner's join), and as error-returning checks so each one's sensitivity is testable against a failpoint double.
harness/mutcheck command
Package main is the program behind `task mutate:check` (spec mutation-check).
Package main is the program behind `task mutate:check` (spec mutation-check).
harness/natsfixture
Package natsfixture gives one test one disposable, real NATS server in a container (openspec change setup-02-isolated-harness, capability nats-fixture).
Package natsfixture gives one test one disposable, real NATS server in a container (openspec change setup-02-isolated-harness, capability nats-fixture).
harness/payloadfixture
Package payloadfixture holds payload-registry fixtures for tests: an empty registry, a registry built from chosen registration functions, and a schema-less stub type.
Package payloadfixture holds payload-registry fixtures for tests: an empty registry, a registry built from chosen registration functions, and a schema-less stub type.
harness/pindiff command
Package main is the program behind `task ledger:check` and `task ledger:diff`.
Package main is the program behind `task ledger:check` and `task ledger:diff`.
harness/probe
Package probe lets a test observe an owner's joins and retained state instead of inferring them from timing or goroutine counts (openspec change setup-02-isolated-harness, capability lifecycle-suite).
Package probe lets a test observe an owner's joins and retained state instead of inferring them from timing or goroutine counts (openspec change setup-02-isolated-harness, capability lifecycle-suite).
harness/prochost
Package prochost hosts a helper process for process-kill proofs (openspec change setup-04a-01-floor, capability process-host).
Package prochost hosts a helper process for process-kill proofs (openspec change setup-04a-01-floor, capability process-host).
harness/semantictest
Package semantictest provides grammar-only helpers for positive semantic test fixtures.
Package semantictest provides grammar-only helpers for positive semantic test fixtures.
harness/toolcheck
Package toolcheck holds the tests of SemEngine's own tooling: the scripts, Taskfile.yml and the CI workflow (openspec change fix-416-tool-test-gating).
Package toolcheck holds the tests of SemEngine's own tooling: the scripts, Taskfile.yml and the CI workflow (openspec change fix-416-tool-test-gating).
httpadmission
Package httpadmission counts the requests an HTTP handler has admitted and not yet returned from, so a server's stop can wait for them after a forced close.
Package httpadmission counts the requests an HTTP handler has admitted and not yet returned from, so a server's stop can wait for them after a forced close.
keycase
Package keycase refuses a configuration key that differs from the name of the struct field it decodes into only in letter case.
Package keycase refuses a configuration key that differs from the name of the struct field it decodes into only in letter case.
kvwatch
Package kvwatch stops a NATS KV watch and waits for its delivery to close, so a caller that returns after stopping its watch leaves no nats.go delivery running behind it.
Package kvwatch stops a NATS KV watch and waits for its delivery to close, so a caller that returns after stopping its watch leaves no nats.go delivery running behind it.
lifecycleguard
Package lifecycleguard is the one-shot owner-lifecycle state a SemEngine component composes (SemStreams issue 1411; design D13 of setup-04a-02-ingest-kernel).
Package lifecycleguard is the one-shot owner-lifecycle state a SemEngine component composes (SemStreams issue 1411; design D13 of setup-04a-02-ingest-kernel).
logforwarderpolicy
Package logforwarderpolicy owns the repository-internal semantics of the log-forwarder service's inner configuration.
Package logforwarderpolicy owns the repository-internal semantics of the log-forwarder service's inner configuration.
resource
Package resource provides utilities for monitoring resource availability.
Package resource provides utilities for monitoring resource availability.
revlag
Package revlag provides a revision-lag "caught up" watermark for async, write-driven, lagging pipelines fed by a NATS KV watch (ADR-066).
Package revlag provides a revision-lag "caught up" watermark for async, write-driven, lagging pipelines fed by a NATS KV watch (ADR-066).
smoke
Package smoke is a test-only package: its integration tests boot the tier-0 graph stack the way a product's own main would, from one JSON configuration through config.Manager, ServiceManager and ComponentManager, in a child process, and check what a consumer can read of it (openspec change test-557-composed-stack-smoke, capability composed-stack).
Package smoke is a test-only package: its integration tests boot the tier-0 graph stack the way a product's own main would, from one JSON configuration through config.Manager, ServiceManager and ComponentManager, in a child process, and check what a consumer can read of it (openspec change test-557-composed-stack-smoke, capability composed-stack).
timestamp
Package timestamp provides standardized Unix timestamp handling utilities.
Package timestamp provides standardized Unix timestamp handling utilities.
tlsutil
Package tlsutil provides TLS configuration utilities for secure connections.
Package tlsutil provides TLS configuration utilities for secure connections.
Package message provides the core message infrastructure for SemEngine.
Package message provides the core message infrastructure for SemEngine.
Package metric provides Prometheus-based metrics collection and an HTTP server for monitoring and observability.
Package metric provides Prometheus-based metrics collection and an HTTP server for monitoring and observability.
Package model provides a unified model registry for centralized endpoint configuration, capability-based routing, and tool capability metadata.
Package model provides a unified model registry for centralized endpoint configuration, capability-based routing, and tool capability metadata.
Package natsclient provides a client for managing NATS connections and their health status.
Package natsclient provides a client for managing NATS connections and their health status.
storagereport
Package storagereport produces and reads the account storage report.
Package storagereport produces and reads the account storage report.
output
websocket
Package websocket is the websocket output component: an HTTP server whose upgrade path streams frames to WebSocket clients.
Package websocket is the websocket output component: an HTTP server whose upgrade path streams frames to WebSocket clients.
Package payloadregistry is the single type authority for a binary (ADR-103): a message.Type is a type of the deployment if and only if it is registered here.
Package payloadregistry is the single type authority for a binary (ADR-103): a message.Type is a type of the deployment if and only if it is registered here.
pkg
buffer
Package buffer provides generic, thread-safe buffer implementations with various overflow policies.
Package buffer provides generic, thread-safe buffer implementations with various overflow policies.
errs
Package errs provides standardized error handling patterns for SemStreams components.
Package errs provides standardized error handling patterns for SemStreams components.
fusion
Package fusion is the deterministic lens-driven fusion engine (ADR-062): it resolves a query to seed entities, walks the structure around them, ranks and budgets the result, and returns an answer keyed by what a human reads, never by an entity ID.
Package fusion is the deterministic lens-driven fusion engine (ADR-062): it resolves a query to seed entities, walks the structure around them, ranks and budgets the result, and returns an answer keyed by what a human reads, never by an entity ID.
fusion/fusionnats
Package fusionnats is the NATS implementation of fusion.RetrievalClient (ADR-062): it maps the engine's resolve and expand calls onto graph-query's public verbs, so the fusion engine can run against a live graph.
Package fusionnats is the NATS implementation of fusion.RetrievalClient (ADR-062): it maps the engine's resolve and expand calls onto graph-query's public verbs, so the fusion engine can run against a live graph.
fusion/fusionvocab
Package fusionvocab is the production implementation of fusion.RankSignals (ADR-062 increment 5, gh#396): it wires the lens engine's ranking signals onto the vocabulary registry (predicate salience) and an ontology's ancestor function (class specificity).
Package fusionvocab is the production implementation of fusion.RankSignals (ADR-062 increment 5, gh#396): it wires the lens engine's ranking signals onto the vocabulary registry (predicate salience) and an ontology's ancestor function (class specificity).
graphview
Package graphview provides a shared read-side fan-out primitive over a NATS KV bucket (ADR-081): ONE WatchAll feeding one validated in-memory current-state projection, coalesced to a view-rate tick and fanned out to N local subscribers with snapshot+delta consistency, per-subscriber at-most-once backpressure, and an honest degraded-path contract.
Package graphview provides a shared read-side fan-out primitive over a NATS KV bucket (ADR-081): ONE WatchAll feeding one validated in-memory current-state projection, coalesced to a view-rate tick and fanned out to N local subscribers with snapshot+delta consistency, per-subscriber at-most-once backpressure, and an honest degraded-path contract.
lifecycle
Package lifecycle provides a substrate convention layer for workflow-shaped entities — named instances with declared phases, restart recovery, operator visibility, and rule integration.
Package lifecycle provides a substrate convention layer for workflow-shaped entities — named instances with declared phases, restart recovery, operator visibility, and rule integration.
lifecyclecleanup
Package lifecyclecleanup releases what a component's failed Start acquired, under a bounded context that the failure cannot cancel.
Package lifecyclecleanup releases what a component's failed Start acquired, under a bounded context that the failure cannot cancel.
platform
Package platform holds the platform-identity struct, Config.
Package platform holds the platform-identity struct, Config.
projection
Package projection provides a small contract-validating client for graph mutations.
Package projection provides a small contract-validating client for graph mutations.
projection/contract
Package contract holds the projection contract data types and their shape validation (ADR-103).
Package contract holds the projection contract data types and their shape validation (ADR-103).
retry
Package retry provides simple exponential backoff retry logic for transient failures.
Package retry provides simple exponential backoff retry logic for transient failures.
rulepack
Package rulepack owns the identity contract for composed rule processors: the grammar and byte bound of a rule pack's pack_id.
Package rulepack owns the identity contract for composed rule processors: the grammar and byte bound of a rule pack's pack_id.
security
Package security provides platform-wide security configuration types
Package security provides platform-wide security configuration types
types
Package types provides core type definitions for the semantic event mesh.
Package types provides core type definitions for the semantic event mesh.
processor
graph-clustering
Package graphclustering is the graph-clustering component: it follows ENTITY_STATES and keeps COMMUNITY_INDEX current, one bounded record per entity-ID prefix group, through the graph/clustering Maintainer, and reports on the graph-clustering readiness key.
Package graphclustering is the graph-clustering component: it follows ENTITY_STATES and keeps COMMUNITY_INDEX current, one bounded record per entity-ID prefix group, through the graph/clustering Maintainer, and reports on the graph-clustering readiness key.
graph-embedding
Package graphembedding is the graph-embedding component: it follows ENTITY_STATES and keeps one BM25 embedding record per entity with text in EMBEDDING_INDEX, with its dedup keys in EMBEDDING_DEDUP, and reports its progress on the graph-embedding readiness key.
Package graphembedding is the graph-embedding component: it follows ENTITY_STATES and keeps one BM25 embedding record per entity with text in EMBEDDING_INDEX, with its dedup keys in EMBEDDING_DEDUP, and reports its progress on the graph-embedding readiness key.
graph-index
Package graphindex provides graph-index, the component that keeps the graph's relationship indexes: it follows the ENTITY_STATES bucket through graph/follower, writes five index buckets it owns (OUTGOING_INDEX, INCOMING_INDEX, ALIAS_INDEX, PREDICATE_INDEX and NAME_INDEX), and answers the eight graph.index.query.* verbs declared for it in graph.QueryVerbs.
Package graphindex provides graph-index, the component that keeps the graph's relationship indexes: it follows the ENTITY_STATES bucket through graph/follower, writes five index buckets it owns (OUTGOING_INDEX, INCOMING_INDEX, ALIAS_INDEX, PREDICATE_INDEX and NAME_INDEX), and answers the eight graph.index.query.* verbs declared for it in graph.QueryVerbs.
graph-ingest
Package graphingest provides the graph-ingest component for entity and triple ingestion.
Package graphingest provides the graph-ingest component for entity and triple ingestion.
graph-query
Package graphquery provides graph-query, the component that answers the graph.query.* verbs declared for it in graph.QueryVerbs.
Package graphquery provides graph-query, the component that answers the graph.query.* verbs declared for it in graph.QueryVerbs.
Package service holds what every long-running SemEngine service shares: BaseService, which a service embeds for its name, status and health check, and the Service interface a service manager drives.
Package service holds what every long-running SemEngine service shares: BaseService, which a service embeds for its name, status and health check, and the Service interface a service manager drives.
Package storage provides pluggable backend interfaces for storage operations.
Package storage provides pluggable backend interfaces for storage operations.
objectstore
Package objectstore is a storage.StreamableStore over one NATS ObjectStore bucket.
Package objectstore is a storage.StreamableStore over one NATS ObjectStore bucket.
storeregistry
Package storeregistry provides a concurrency-safe registry mapping a message.StorageReference.StorageInstance to the live store that backs it (ADR-063).
Package storeregistry provides a concurrency-safe registry mapping a message.StorageReference.StorageInstance to the live store that backs it (ADR-063).
Package types contains shared domain types used across the semstreams platform
Package types contains shared domain types used across the semstreams platform
Package vocabulary provides semantic vocabulary management for SemEngine.
Package vocabulary provides semantic vocabulary management for SemEngine.
export
Package export serializes []message.Triple to standard RDF formats.
Package export serializes []message.Triple to standard RDF formats.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL