cli

What is Colonies?

Colonies is a Process Orchestration framework for managing AI/ML workloads across heterogeneous computing platforms.

• It provides a meta-layer where complex workflows can be described and managed as meta-processes independently on their implementation and where they are executed.
• AI applications can then be broken down into composable functions executed by remote workers anywhere on the Internet, enabling a compute continuum spanning devices, cloud, edge, and HPC.
• A build-in zero-trust protocol makes it possible to organize remote workers as a single unit called a Colony, thus making it possible for users to keep control even if workloads are spread out and executed on many different platforms at the same time.

More information

Installation

• Installation

Presentations

• Process Orchestration with ColonyOS

Guides

• Introduction
• Getting started
• How to implement a Colonies worker
• How to implement a FibonacciwWorker in Go
• How to create workflows DAGs
• How to use generators
• How to use crons
• How to use the Colonies CLI

Design

• Overall design
• HTTP RPC protocol
• Security design

SDKs

• Golang Colonies SDK
• Rust Colonies SDK
• Julia Colonies SDK
• JavaScript Colonies SDK
• Python Colonies SDK
• Haskell Colonies SDK

Deployment

• High-availability deployment
• Grafana/Prometheus monitoring
• Kubernetes Helm charts

More information can also be found here.

Current users

• Colonies is currently being used by RockSigma AB to build a compute engine for automatic seismic processing in underground mines.

Running the tests

Follow the instructions at Installation Guide then type:

make test