mqtt/

MQTT Test Scripts

Test utilities for MQTT ingestion development and debugging.

Prerequisites

Start an MQTT broker (e.g., Mosquitto):

# macOS
brew install mosquitto
brew services start mosquitto

# Docker
docker run -d --name mosquitto -p 1883:1883 eclipse-mosquitto

Producer

Sends test sensor data to an MQTT broker.

# Basic usage - 10 msg/s to sensors/temperature
go run scripts/mqtt/producer/main.go

# High throughput test - 1000 msg/s for 60 seconds
go run scripts/mqtt/producer/main.go -rate 1000 -duration 60s

# Send 1000 messages then stop
go run scripts/mqtt/producer/main.go -count 1000

# JSON format instead of MessagePack
go run scripts/mqtt/producer/main.go -format json

# Batch multiple records per message
go run scripts/mqtt/producer/main.go -batch 100 -rate 100

# Custom broker and topic
go run scripts/mqtt/producer/main.go -broker tcp://broker.example.com:1883 -topic iot/sensors

# With authentication
go run scripts/mqtt/producer/main.go -username user -password secret

Producer Flags

Consumer

Receives and displays MQTT messages (for debugging).

# Subscribe to all sensor topics
go run scripts/mqtt/consumer/main.go -topic "sensors/#"

# Show message contents
go run scripts/mqtt/consumer/main.go -topic "sensors/#" -verbose

# Custom stats interval
go run scripts/mqtt/consumer/main.go -stats 10s

Consumer Flags

Test Scenarios

Basic Integration Test

1. Start Arc with MQTT enabled
2. Create a subscription via API:

   curl -X POST http://localhost:8080/api/v1/mqtt/subscriptions \
     -H "Content-Type: application/json" \
     -H "Authorization: Bearer $TOKEN" \
     -d '{
       "name": "test-sensors",
       "broker": "tcp://localhost:1883",
       "client_id": "arc-test",
       "topics": ["sensors/#"],
       "database": "mqtt_test"
     }'
   

3. Start the subscription:

   curl -X POST http://localhost:8080/api/v1/mqtt/subscriptions/{id}/start \
     -H "Authorization: Bearer $TOKEN"
   

4. Run the producer:

   go run scripts/mqtt/producer/main.go -count 100
   

5. Query the data:

   curl "http://localhost:8080/api/v1/query?db=mqtt_test&q=SELECT%20*%20FROM%20mqtt_test%20LIMIT%2010"
   

Throughput Test

# Terminal 1: Monitor Arc stats
watch -n1 'curl -s http://localhost:8080/api/v1/mqtt/stats | jq'

# Terminal 2: High-rate producer
go run scripts/mqtt/producer/main.go -rate 10000 -batch 100 -duration 60s

Format Compatibility Test

# Test JSON
go run scripts/mqtt/producer/main.go -format json -count 10 -verbose

# Test MessagePack
go run scripts/mqtt/producer/main.go -format msgpack -count 10 -verbose