xw-cli

module
v0.0.1 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Feb 12, 2026 License: Apache-2.0

README

玄武CLI｜xw-cli 实现国产算力的大模型自由，打造国产版Ollama

为多元国产算力平台深度优化模型性能。告别繁琐的环境配置与算子适配，一条命令启动生产级服务，即刻释放大模型潜能。

里程碑

  • 2026.02.02 玄武CLI正式开源，并支持华为Ascend系列芯片。

✨ 特性

🇨🇳 国产原生

  • 深度优化国产硬件性能
  • 本地化完整支持

⚡ 低门槛，一键启动

  • 无需复杂配置，开箱即用
  • 自动硬件检测与引擎推荐

🔧 多引擎支持

  • 内置多个推理引擎适配与自动路由
  • 保证性能与模型覆盖广度

📦 安装

前置要求

极速安装

curl -o- http://xw.tsingmao.com/install.sh | bash

🚀 快速开始

1. 启动xw-cli server

xw serve

2. 拉取模型

xw pull qwen3-8b

更多模型详见 xw 模型仓库。

3. 运行模型

xw run qwen3-8b

开始对话，输入 /quit 退出。

4. 查看本地模型

# 本地存储的模型
xw ls

# 正在运行的模型
xw ps

📚 文档

🐛 反馈

如遇到问题或有建议，欢迎 提交 Issue

💬 社区交流

欢迎加入 xw-cli 微信交流群，与开发者和用户一起讨论技术问题、分享使用经验：

微信群4
微信群 4 		微信群5
微信群 5 		微信群6
微信群 6 		微信群7
微信群 7

如群二维码失效，请通过 Issue 联系我们

本项目由清昴智能团队维护。更多信息访问 清昴智能官网

Directories

Path Synopsis
cmd
xw command
Package main is the entry point for the xw CLI application.
 Package main is the entry point for the xw CLI application.
xw/app
Package app provides the command-line interface implementation for xw.
 Package app provides the command-line interface implementation for xw.
xw/client
Package client provides an HTTP client for communicating with the xw server.
 Package client provides an HTTP client for communicating with the xw server.
internal
api
Package api defines the API types and contracts for the xw application.
 Package api defines the API types and contracts for the xw application.
config
Package config provides configuration management for the xw application.
 Package config provides configuration management for the xw application.
device
Package device provides domestic chip device detection and management.
 Package device provides domestic chip device detection and management.
hooks
Package hooks provides a pluggable system for checking and installing dependencies.
 Package hooks provides a pluggable system for checking and installing dependencies.
logger
Package logger provides structured logging for the xw application.
 Package logger provides structured logging for the xw application.
models
Package models - config_loader.go provides configuration-based model loading.
 Package models - config_loader.go provides configuration-based model loading.
runtime
Package runtime provides runtime management for model instances.
 Package runtime provides runtime management for model instances.
runtime/mindie-docker
Package mindiedocker implements MindIE runtime with Docker deployment.
 Package mindiedocker implements MindIE runtime with Docker deployment.
runtime/mlguider-docker
Package mlguiderdocker implements MLGuider runtime with Docker deployment.
 Package mlguiderdocker implements MLGuider runtime with Docker deployment.
runtime/omni-infer-docker
Package omniinferdocker implements Omni-Infer runtime with Docker deployment.
 Package omniinferdocker implements Omni-Infer runtime with Docker deployment.
runtime/vllm-docker
Package vllmdocker implements vLLM runtime with Docker deployment.
 Package vllmdocker implements vLLM runtime with Docker deployment.
server
Package server provides the HTTP server implementation for the xw application.
 Package server provides the HTTP server implementation for the xw application.
server/handlers
Package handlers provides HTTP request handlers for the xw server API.
 Package handlers provides HTTP request handlers for the xw server API.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.