marmot

module
v0.10.0-preview2 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: May 9, 2026 License: MIT

README

Marmot

Discover any data asset in seconds. Then let your AI do the same.

The open-source context layer for your AI. Catalog your tables, topics, queues and APIs then expose real metadata to your AI agents.

DocumentationLive DemoDeployCommunity

What is Marmot?

Marmot is an open-source data catalog for teams who want powerful data discovery without enterprise complexity. Catalog every data asset, enrich it with the context that matters and make it accessible to your team and your AI tools.

Unlike traditional catalogs that require extensive infrastructure and configuration, Marmot ships as a single binary with an intuitive UI, making it easy to deploy and start cataloging in minutes.

Features

  • Search everything: Find any data asset in seconds with full-text search plus structured queries, boolean logic and metadata filters.
  • Interactive lineage: Trace data flows from source to destination and analyse impact before making changes.
  • Metadata-first: Store rich metadata for any asset type, from tables and topics to APIs and dashboards.
  • Team collaboration: Assign ownership, document business context and maintain shared glossaries.
  • AI-ready: Expose certified context through MCP, the API and the UI.
Marmot context layer showing plugins, integrations and AI agents

Deploy

New to Marmot? Follow the Deploy documentation for a guided setup, or try the live demo.

Development

See Local Development for how to get started developing locally.

Community

Join our Discord community for help, feedback and updates on new features.

Contributing

All types of contributions are encouraged and valued!

  • Report bugs or suggest features via GitHub Issues
  • Improve documentation
  • Build new plugins for data sources

Before contributing, please check out the Contributing Guide.

License

Marmot is open-source software licensed under the MIT License.

Directories

Path Synopsis
client module
Package docs Code generated by swaggo/swag.
Package docs Code generated by swaggo/swag.
internal
cmd
docgen/cmd command
mcp
mrn
operator/api/v1alpha1
Package v1alpha1 contains API Schema definitions for the runs.marmotdata.io v1alpha1 API group.
Package v1alpha1 contains API Schema definitions for the runs.marmotdata.io v1alpha1 API group.
plugin/providers/airflow
+marmot:name=Airflow +marmot:description=Ingests metadata from Apache Airflow including DAGs, tasks, and dataset lineage.
+marmot:name=Airflow +marmot:description=Ingests metadata from Apache Airflow including DAGs, tasks, and dataset lineage.
plugin/providers/asyncapi
+marmot:name=AsyncAPI +marmot:description=This plugin ingests metadata from AsyncAPI v3 specifications, discovering services, channels, and message schemas.
+marmot:name=AsyncAPI +marmot:description=This plugin ingests metadata from AsyncAPI v3 specifications, discovering services, channels, and message schemas.
plugin/providers/azureblob
+marmot:name=Azure Blob Storage +marmot:description=Discovers containers and blobs from Azure Blob Storage accounts.
+marmot:name=Azure Blob Storage +marmot:description=Discovers containers and blobs from Azure Blob Storage accounts.
plugin/providers/bigquery
+marmot:name=BigQuery +marmot:description=This plugin discovers datasets and tables from Google BigQuery projects.
+marmot:name=BigQuery +marmot:description=This plugin discovers datasets and tables from Google BigQuery projects.
plugin/providers/clickhouse
+marmot:name=ClickHouse +marmot:description=Discovers databases, tables, and views from ClickHouse instances.
+marmot:name=ClickHouse +marmot:description=Discovers databases, tables, and views from ClickHouse instances.
plugin/providers/confluent
+marmot:name=Confluent Cloud +marmot:description=Discover Kafka topics from Confluent Cloud clusters.
+marmot:name=Confluent Cloud +marmot:description=Discover Kafka topics from Confluent Cloud clusters.
plugin/providers/dbt
+marmot:name=DBT +marmot:description=This plugin ingests metadata from DBT (Data Build Tool) projects, including models, tests, and lineage.
+marmot:name=DBT +marmot:description=This plugin ingests metadata from DBT (Data Build Tool) projects, including models, tests, and lineage.
plugin/providers/deltalake
+marmot:name=Delta Lake +marmot:description=This plugin discovers tables from Delta Lake transaction logs on local filesystems.
+marmot:name=Delta Lake +marmot:description=This plugin discovers tables from Delta Lake transaction logs on local filesystems.
plugin/providers/duckdb
+marmot:name=DuckDB +marmot:description=Discovers schemas, tables, views and foreign key relationships from DuckDB database files.
+marmot:name=DuckDB +marmot:description=Discovers schemas, tables, views and foreign key relationships from DuckDB database files.
plugin/providers/dynamodb
+marmot:name=DynamoDB +marmot:description=This plugin discovers DynamoDB tables from AWS accounts.
+marmot:name=DynamoDB +marmot:description=This plugin discovers DynamoDB tables from AWS accounts.
plugin/providers/elasticsearch
+marmot:name=Elasticsearch +marmot:description=This plugin discovers indices, data streams, and aliases from Elasticsearch clusters.
+marmot:name=Elasticsearch +marmot:description=This plugin discovers indices, data streams, and aliases from Elasticsearch clusters.
plugin/providers/gcs
+marmot:name=Google Cloud Storage +marmot:description=Discovers buckets from Google Cloud Storage.
+marmot:name=Google Cloud Storage +marmot:description=Discovers buckets from Google Cloud Storage.
plugin/providers/glue
+marmot:name=Glue +marmot:description=This plugin discovers jobs, databases, tables and crawlers from AWS Glue.
+marmot:name=Glue +marmot:description=This plugin discovers jobs, databases, tables and crawlers from AWS Glue.
plugin/providers/iceberg
+marmot:name=Iceberg +marmot:description=This plugin discovers namespaces, tables and views from Iceberg catalogs (REST and AWS Glue).
+marmot:name=Iceberg +marmot:description=This plugin discovers namespaces, tables and views from Iceberg catalogs (REST and AWS Glue).
plugin/providers/kafka
+marmot:name=Kafka +marmot:description=This plugin discovers Kafka topics from Kafka clusters.
+marmot:name=Kafka +marmot:description=This plugin discovers Kafka topics from Kafka clusters.
plugin/providers/lambda
+marmot:name=Lambda +marmot:description=This plugin discovers Lambda functions from AWS accounts.
+marmot:name=Lambda +marmot:description=This plugin discovers Lambda functions from AWS accounts.
plugin/providers/mongodb
+marmot:name=MongoDB +marmot:description=This plugin discovers databases and collections from MongoDB instances.
+marmot:name=MongoDB +marmot:description=This plugin discovers databases and collections from MongoDB instances.
plugin/providers/mysql
+marmot:name=MySQL +marmot:description=This plugin discovers databases and tables from MySQL instances.
+marmot:name=MySQL +marmot:description=This plugin discovers databases and tables from MySQL instances.
plugin/providers/nats
+marmot:name=NATS +marmot:description=Discovers JetStream streams from NATS servers.
+marmot:name=NATS +marmot:description=Discovers JetStream streams from NATS servers.
plugin/providers/openapi
+marmot:name=OpenAPI +marmot:description=This plugin discovers OpenAPI v3 specifications.
+marmot:name=OpenAPI +marmot:description=This plugin discovers OpenAPI v3 specifications.
plugin/providers/opensearch
+marmot:name=OpenSearch +marmot:description=This plugin discovers indices, data streams, and aliases from OpenSearch clusters.
+marmot:name=OpenSearch +marmot:description=This plugin discovers indices, data streams, and aliases from OpenSearch clusters.
plugin/providers/postgresql
+marmot:name=PostgreSQL +marmot:description=This plugin discovers databases and tables from PostgreSQL instances.
+marmot:name=PostgreSQL +marmot:description=This plugin discovers databases and tables from PostgreSQL instances.
plugin/providers/redis
+marmot:name=Redis +marmot:description=Discovers databases from Redis instances.
+marmot:name=Redis +marmot:description=Discovers databases from Redis instances.
plugin/providers/redpanda
+marmot:name=Redpanda +marmot:description=Discover topics from Redpanda clusters.
+marmot:name=Redpanda +marmot:description=Discover topics from Redpanda clusters.
plugin/providers/s3
+marmot:name=S3 +marmot:description=This plugin discovers S3 buckets from AWS accounts.
+marmot:name=S3 +marmot:description=This plugin discovers S3 buckets from AWS accounts.
plugin/providers/sns
+marmot:name=SNS +marmot:description=This plugin discovers SNS topics from AWS accounts.
+marmot:name=SNS +marmot:description=This plugin discovers SNS topics from AWS accounts.
plugin/providers/sqs
+marmot:name=SQS +marmot:description=This plugin discovers SQS queues from AWS accounts.
+marmot:name=SQS +marmot:description=This plugin discovers SQS queues from AWS accounts.
plugin/providers/trino
+marmot:name=Trino +marmot:description=Discovers catalogs, schemas, tables, and views from Trino clusters with optional AI enrichment.
+marmot:name=Trino +marmot:description=Discovers catalogs, schemas, tables, and views from Trino clusters with optional AI enrichment.
pkg

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL