scitq

README.md

scitq

A distributed task queue for scientific and cloud workloads, built in Go with PostgreSQL and gRPC.

Quick Start

This example demonstrates how to quickly set up and run a minimal instance locally.

make install

docker run -d \
  --name scitq-db \
  -e POSTGRES_USER=scitq \
  -e POSTGRES_PASSWORD=scitq \
  -e POSTGRES_DB=scitq \
  -p 5432:5432 \
  postgres:16

scitq-server &
scitq-client &
export SCITQ_TOKEN="quickstart" 
scitq worker list
scitq task create --command "ls -la" --container ubuntu --shell bash
scitq task list
scitq task output --id 1

Architecture

The scitq architecture includes a Go backend, a Python DSL for workflow definition, and a Svelte.js UI for monitoring.

• Server: Manages tasks, workers, and logs (PostgreSQL-backed).
• Client: Executes tasks.
• CLI: Provides manual interactions using command line.
• UI: Provides manual interactions using a web interface (in Svelte.js).
• DSL: Provides a descriptive language for task workflows using Python and a custom library.

Status

scitq is currently in beta. It is feature-complete but under active refinement and testing.

Documentation

Refer to docs/index.md for documentation.

Contributing

For development details, see docs/dev.md.