quote_engine

Quote Engine

Quote Engine

行情引擎，透過 websocket 串流行情資料，並透過 share memory 來傳遞行情資料。

Index

• Introduction
• Environment
• Installation
• Build
• Execute
• Config 格式
• Config 說明
• GRPC API

Environment

• Go version: go version go1.22.6 linux/amd64
• OS: Ubuntu Ubuntu 22.04.3 LTS

Installation

there are two ways to install and use the package, one is to clone the repository and refer to local path and the other is to use the go get command set to go.mod.

Git clone the repository

1. first clone the repository into your project directory

git clone https://github.com/lianyun0502/quote_engine.git

Your directory structure should look like this:

your_project/
├── build/
├── main.go
├── config.yaml
└── go.mod

1. install the package from your go.mod file

  go mod tidy

Example

package main

import (
  "github.com/sirupsen/logrus"
  . "github.com/lianyun0502/quote_engine/engine"
)

func main() {
  // load config file
  config, err := LoadConfig("config.yaml")
  if err != nil {
    logrus.Println(err)
    return
  } 

  // create quote engine
  quoteEngine := NewQuoteEngine(config)

  // start the quote engine
  quoteEngine.WsAgent.StartLoop()

  // wait for done signal
  <- quoteEngine.DoneSignal
}

Build

1. entry the build directory

cd build

1. build the project

go build -o ./you_dir/excutable_file_name 

Execute

After building the project, put config file config.yaml in directory and you can execute the project by the following command.

1. execute the project

./excutable_file_name

Config 格式

# logger 相關設定
Log:
  dir: "log/"                                 # log file directory
  link_name: "latest_log.log"                
  level: "debug"                              # log level ( debug, info, warn, error, fatal, panic )
  report_caller: false                        # whether report the caller info           
  format: "2006-01-02 15:04:05.000000"
  writer:
  - name: "Info"
    path: "%Y%m%d_%H%M.log"
    max_age: 480
    rotation_time: 2
  - name: "Warn"
    path: "warn/%Y%m%d_%H%M.log"
    max_age: 480
    rotation_time: 2
  write_map:
  panic: "Warn"
  fatal: "Warn"
  error: "Warn"
  warn: "Warn"
  info: "Info"
  debug: "Info"

Data:                                         # 資料存放設定
  save: true                                  # 是否儲存資料
  dir: "data/"                                # 資料存放root     
  max_age: 480                                # 資料存放最大時間 (單位: 小時)
  rotation_time: 2                            # 每個資料檔案存放時間 (單位: 小時)      

GRPCServer:                                   # grpc server 相關設定
  port: "1687"                                # grpc server port
  host: "localhost"                           # grpc server host

  
Websocket:                                    # websocket client 相關設定
  - exchange: "binance"                       # 交易所名稱          
  url: "wss://stream.bybit.com/v5/public/spot" # 已棄用
  host_type: "spot"                         # 交易商品類型 (spot, future)
  ws_pool_size: 1                           # websocket pool size，開啟WS連線數量
  subscribe: 
  reconn_time: -1                           # 重連次數，-1 代表無限重連
  cmd:                                      # 已棄用
    - method: "depth"
    params:
      symbol: "BTCUSDT"
      limit: 5
  publisher:                                # 設定要發布的topic，及對應的share memory skey設定
    - topic: "orderbook"                    # orderbook topic
    skey: 158
    size: 1073741 #1GB
    store: true
    - topic: "Trade"                        # trade topic 
    skey: 258
    size: 1073741 #1GB
    store: true
    - topic: "ticker"                       # market data ticker topic
    skey: 358
    size: 1073741 #1GB
    store: true

Config 說明

Log

logger 設定，可以設定多個log file writer，透過設定write_map來將log level對應到writer去分檔寫入不同 level 的 log。

Log.writer

log writter 設定，max_age 為 log file 最大存放時間 (單位: 小時)，rotation_time 為每個 log file 紀錄時間長度 (單位: 小時)。

Data

資料儲存設定，決定是否儲存接收的行情資料及存放位置。

GRPCServer

gRPC 服務設定，用於提供API服務。

Websocket

行情 streaming client 設定，可以設定多個交易所的多種行情資料串流。 透過設定subscribe來訂閱所需行情，透過設定Websocket.publisher去建立publisher來發布行情。

Websocket.publisher

可以設定多個topic，每個topic會建立一個share memory buffer，用來傳遞data。

GRPC API

subscribes.json

{
  "0":[
    { "coin":"BTC",
      "symbol":"BTCUSDT",
      "topics":
        ["btcusdt@depth@100ms","btcusdt@aggTrade","btcusdt@ticker"]},
    { "coin":"ETH",
      "symbol":"ETHUSDT",
      "topics":
        ["ethusdt@depth@100ms","ethusdt@aggTrade","ethusdt@ticker"]}
      ]
}

說明：

• "0" : WS pool id，開啟的WS連線流水號，須對應到config.yaml中的ws_pool_size的個數， "0"代表第一個WS連線，"1" 代表第二個WS連線，以此類推。
• "coin" : 交易幣別
• "symbol" : 交易對
• "topics" : 訂閱的topic，請參考交易所文件，topic名稱會隨著交易所不同而不同。

如果是使用GRPC API來訂閱的話，則不需要在這裡設定，會自動幫你訂閱。