marmot

module
v0.8.3 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Apr 3, 2026 License: MIT

README

Marmot

Discover any data asset in seconds. Then let your AI do the same.

The open-source context layer for your AI. Catalog your tables, topics, queues and APIs then expose real metadata to your AI agents.

DocumentationLive DemoDeployCommunity

What is Marmot?

Marmot is an open-source data catalog designed for teams who want powerful data discovery without enterprise complexity. Catalog every data asset, enrich it with the context that matters and make it accessible to your team and your AI tools.

Unlike traditional catalogs that require extensive infrastructure and configuration, Marmot ships as a single binary with an intuitive UI, making it easy to deploy and start cataloging in minutes.

Marmot context layer showing plugins, integrations and AI agents
  • Discover - One place for AI and engineers to find every table, topic, queue and API
  • Understand - Trace how data flows and what depends on what with lineage
  • Contextualize - Ownership, business definitions and custom fields that give AI the full picture
  • Share - Expose certified context through MCP, the API and the UI

Features

Search Everything

Find any data asset across your entire organisation in seconds. Combine full-text search with structured queries using metadata filters, boolean logic, and comparison operators.

Marmot search interface showing filters and search results

Interactive Lineage Visualisation

Trace data flows from source to destination with interactive dependency graphs. Understand upstream and downstream dependencies, identify bottlenecks, and analyse impact before making changes.

Interactive lineage graph showing data flow and dependencies

Metadata-First Architecture

Store rich metadata for any asset type. From tables and topics to APIs and dashboards.

Asset detail page showing rich metadata and documentation

Team Collaboration

Assign ownership, document business context, and create glossaries. Keep your entire team aligned with centralised knowledge about your data assets.

Team management interface showing ownership and collaboration features

Deploy

New to Marmot? Follow the Deploy documentation for a guided setup.

Interested in exploring Marmot? Check out the live demo

Development

See Local Development for how to get started developing locally.

Community

Join our Discord community to:

  • Get help and support
  • Share feedback and ideas
  • Stay updated on new features

Contributing

All types of contributions are encouraged and valued!

Ways to Contribute:

  • Report bugs or suggest features via GitHub Issues
  • Improve documentation
  • Build new plugins for data sources

Before contributing, please check out the Contributing Guide.

License

Marmot is open-source software licensed under the MIT License.

Directories

Path Synopsis
Package docs Code generated by swaggo/swag.
Package docs Code generated by swaggo/swag.
internal
cmd
docgen/cmd command
mcp
mrn
plugin/providers/airflow
+marmot:name=Airflow +marmot:description=Ingests metadata from Apache Airflow including DAGs, tasks, and dataset lineage.
+marmot:name=Airflow +marmot:description=Ingests metadata from Apache Airflow including DAGs, tasks, and dataset lineage.
plugin/providers/asyncapi
+marmot:name=AsyncAPI +marmot:description=This plugin ingests metadata from AsyncAPI v3 specifications, discovering services, channels, and message schemas.
+marmot:name=AsyncAPI +marmot:description=This plugin ingests metadata from AsyncAPI v3 specifications, discovering services, channels, and message schemas.
plugin/providers/azureblob
+marmot:name=Azure Blob Storage +marmot:description=Discovers containers and blobs from Azure Blob Storage accounts.
+marmot:name=Azure Blob Storage +marmot:description=Discovers containers and blobs from Azure Blob Storage accounts.
plugin/providers/bigquery
+marmot:name=BigQuery +marmot:description=This plugin discovers datasets and tables from Google BigQuery projects.
+marmot:name=BigQuery +marmot:description=This plugin discovers datasets and tables from Google BigQuery projects.
plugin/providers/clickhouse
+marmot:name=ClickHouse +marmot:description=Discovers databases, tables, and views from ClickHouse instances.
+marmot:name=ClickHouse +marmot:description=Discovers databases, tables, and views from ClickHouse instances.
plugin/providers/confluent
+marmot:name=Confluent Cloud +marmot:description=Discover Kafka topics from Confluent Cloud clusters.
+marmot:name=Confluent Cloud +marmot:description=Discover Kafka topics from Confluent Cloud clusters.
plugin/providers/dbt
+marmot:name=DBT +marmot:description=This plugin ingests metadata from DBT (Data Build Tool) projects, including models, tests, and lineage.
+marmot:name=DBT +marmot:description=This plugin ingests metadata from DBT (Data Build Tool) projects, including models, tests, and lineage.
plugin/providers/deltalake
+marmot:name=Delta Lake +marmot:description=This plugin discovers tables from Delta Lake transaction logs on local filesystems.
+marmot:name=Delta Lake +marmot:description=This plugin discovers tables from Delta Lake transaction logs on local filesystems.
plugin/providers/dynamodb
+marmot:name=DynamoDB +marmot:description=This plugin discovers DynamoDB tables from AWS accounts.
+marmot:name=DynamoDB +marmot:description=This plugin discovers DynamoDB tables from AWS accounts.
plugin/providers/gcs
+marmot:name=Google Cloud Storage +marmot:description=Discovers buckets from Google Cloud Storage.
+marmot:name=Google Cloud Storage +marmot:description=Discovers buckets from Google Cloud Storage.
plugin/providers/glue
+marmot:name=Glue +marmot:description=This plugin discovers jobs, databases, tables and crawlers from AWS Glue.
+marmot:name=Glue +marmot:description=This plugin discovers jobs, databases, tables and crawlers from AWS Glue.
plugin/providers/iceberg
+marmot:name=Iceberg +marmot:description=This plugin discovers namespaces, tables and views from Iceberg catalogs (REST and AWS Glue).
+marmot:name=Iceberg +marmot:description=This plugin discovers namespaces, tables and views from Iceberg catalogs (REST and AWS Glue).
plugin/providers/kafka
+marmot:name=Kafka +marmot:description=This plugin discovers Kafka topics from Kafka clusters.
+marmot:name=Kafka +marmot:description=This plugin discovers Kafka topics from Kafka clusters.
plugin/providers/lambda
+marmot:name=Lambda +marmot:description=This plugin discovers Lambda functions from AWS accounts.
+marmot:name=Lambda +marmot:description=This plugin discovers Lambda functions from AWS accounts.
plugin/providers/mongodb
+marmot:name=MongoDB +marmot:description=This plugin discovers databases and collections from MongoDB instances.
+marmot:name=MongoDB +marmot:description=This plugin discovers databases and collections from MongoDB instances.
plugin/providers/mysql
+marmot:name=MySQL +marmot:description=This plugin discovers databases and tables from MySQL instances.
+marmot:name=MySQL +marmot:description=This plugin discovers databases and tables from MySQL instances.
plugin/providers/nats
+marmot:name=NATS +marmot:description=Discovers JetStream streams from NATS servers.
+marmot:name=NATS +marmot:description=Discovers JetStream streams from NATS servers.
plugin/providers/openapi
+marmot:name=OpenAPI +marmot:description=This plugin discovers OpenAPI v3 specifications.
+marmot:name=OpenAPI +marmot:description=This plugin discovers OpenAPI v3 specifications.
plugin/providers/postgresql
+marmot:name=PostgreSQL +marmot:description=This plugin discovers databases and tables from PostgreSQL instances.
+marmot:name=PostgreSQL +marmot:description=This plugin discovers databases and tables from PostgreSQL instances.
plugin/providers/redis
+marmot:name=Redis +marmot:description=Discovers databases from Redis instances.
+marmot:name=Redis +marmot:description=Discovers databases from Redis instances.
plugin/providers/redpanda
+marmot:name=Redpanda +marmot:description=Discover topics from Redpanda clusters.
+marmot:name=Redpanda +marmot:description=Discover topics from Redpanda clusters.
plugin/providers/s3
+marmot:name=S3 +marmot:description=This plugin discovers S3 buckets from AWS accounts.
+marmot:name=S3 +marmot:description=This plugin discovers S3 buckets from AWS accounts.
plugin/providers/sns
+marmot:name=SNS +marmot:description=This plugin discovers SNS topics from AWS accounts.
+marmot:name=SNS +marmot:description=This plugin discovers SNS topics from AWS accounts.
plugin/providers/sqs
+marmot:name=SQS +marmot:description=This plugin discovers SQS queues from AWS accounts.
+marmot:name=SQS +marmot:description=This plugin discovers SQS queues from AWS accounts.
plugin/providers/trino
+marmot:name=Trino +marmot:description=Discovers catalogs, schemas, tables, and views from Trino clusters with optional AI enrichment.
+marmot:name=Trino +marmot:description=Discovers catalogs, schemas, tables, and views from Trino clusters with optional AI enrichment.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL