litellm-manage

name	litellm_manage
description	LiteLLM Gateway Management - Official API Implementation
metadata	{"openclaw":{"emoji":"🖥️","requires":{"env":["LITELLM_SSH_KEY"]}}}

LiteLLM Management Skill

Comprehensive CLI for LiteLLM gateway management using official API.

Docs: https://docs.litellm.ai/docs/proxy/management_cli

Quick Start

# Set SSH key path
export LITELLM_SSH_KEY=~/.ssh/ecs_key_backup

# Get help
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py --help

# Check status
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py status

# Generate opencode config (for using with opencode CLI)
python3 openclaw_skill/litellm_manage/scripts/scan_models.py \
  -u https://www.gsaisg.top/v1 -k sk-xxxx

For detailed email documentation, see [email.md].

---

Commands

1. Status

# Check service health
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py status

Shows: Service health, available models, key count, team count

---

2. Key Management

注意： 使用 --budget 创建 key 时，会自动设置 budget_duration 为 1month（每月重置预算）。

# List keys
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py key list

# Generate key (budget_duration 自动设置为 1month)
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py key generate \
  --alias "员工A" --budget 20

# Generate key with models
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py key generate \
  --alias "研发" --budget 10 --models "qwen3.5-plus,kimi-k2.5"

# Update key settings
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py key update \
  --key sk-xxx --budget 30 --models "qwen3.5-plus"

# Suspend (disable) key
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py key suspend \
  --key sk-xxx

# Activate (re-enable) key
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py key activate \
  --key sk-xxx --budget 20

# Reset key quota/spend
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py key quota-reset \
  --key sk-xxx

# Get key info
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py key info \
  --key sk-xxx

# Delete key
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py key delete \
  --key sk-xxx

# Regenerate (rotate) key
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py key regenerate \
  --key sk-xxx

---

3. User Management

注意： 使用 --budget 创建 user 时，会自动设置 budget_duration 为 1month（每月重置预算）。

# List users
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py user list

# Create user (budget_duration 自动设置为 1month)
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py user new \
  --username "员工" --budget 20 --email "[e-mail]"

# Get user info
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py user info \
  --user-id xxx

# Update user
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py user update \
  --user-id xxx --budget 50 --alias "新员工"

# Delete user
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py user delete \
  --user-id xxx

---

4. Team Management

注意： 使用 --budget 创建 team 时，会自动设置 budget_duration 为 1month（每月重置预算）。

# List teams
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py team list

# Create team (budget_duration 自动设置为 1month)
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py team new \
  --name "研发组" --budget 100

# Get team info
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py team info \
  --team-id xxx

# Update team
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py team update \
  --team-id xxx --budget 200 --alias "新研发组"

# Add member to team
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py team add-member \
  --team-id xxx --user-id yyy --role admin

# Remove member from team
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py team remove-member \
  --team-id xxx --user-id yyy

# Delete team
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py team delete \
  --team-id xxx

---

5. Model Testing

# Test model (uses admin key by default)
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py test \
  --model qwen3.5-plus

# Test with specific key
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py test \
  --model kimi-k2.5 --key sk-xxx

---

6. Config Generation

# Generate OpenAI-compatible config
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py config openai \
  --output ~/.openai.json

---

7. Opencode Config Generator (scan_models.py)

扫描 LiteLLM 可用模型并生成 opencode 配置文件。

功能特点：

• 自动扫描 /v1/models 接口获取所有可用模型
• 根据模型 ID 智能推断参数（context window、output limit、capabilities）
• 支持 GPT、Claude、Llama、Gemini、Qwen、DeepSeek 等主流模型
• 自动过滤 embedding、dall-e、tts、whisper 等非聊天模型

使用方法：

# 基础用法 - 输出到 stdout
python3 openclaw_skill/litellm_manage/scripts/scan_models.py \
  -u https://www.gsaisg.top/v1 \
  -k sk-litellm-admin-key-change-me

# 保存到文件
python3 openclaw_skill/litellm_manage/scripts/scan_models.py \
  -u https://www.gsaisg.top/v1 \
  -k sk-litellm-admin-key-change-me \
  -o ~/opencode_config.json

# 生成压缩格式的 JSON
python3 openclaw_skill/litellm_manage/scripts/scan_models.py \
  -u https://www.gsaisg.top/v1 \
  -k sk-litellm-admin-key-change-me \
  --compact

# 使用生成的 key（推荐）
python3 openclaw_skill/litellm_manage/scripts/scan_models.py \
  -u https://www.gsaisg.top/v1 \
  -k sk-xxxx \
  -o ~/.config/opencode/opencode.json

参数说明：

参数	说明	示例
-u, --url	API Base URL	https://www.gsaisg.top/v1
-k, --key	API Key	sk-xxxx
-o, --output	输出文件路径	~/.config/opencode/opencode.json
-p, --pretty	格式化 JSON（默认）	-
-c, --compact	压缩 JSON	-

当前可用模型（2026-03-10）：

模型	参数	能力
qwen3.5-plus	32K / 8K	tool_call
kimi-k2.5	128K / 4K	tool_call
deepseek-v3.2-exp	64K / 4K	tool_call
glm-5	32K / 4K	tool_call
claude-haiku-4.5	100K / 4K	tool_call
gpt-3.5-turbo	4K / 4K	tool_call
gemini-3.1-pro	32K / 4K	tool_call
gemini-3-flash	32K / 4K	tool_call

安全建议：

如果担心 API key 泄露，生成配置后可手动修改：

# 1. 设置环境变量
export GSAI_API_KEY=your-api-key

# 2. 编辑配置文件，将 apiKey 改为：
"apiKey": "{env:GSAI_API_KEY}"

配置示例：

生成的配置文件格式：

{
  "$schema": "https://opencode.ai/config.json",
  "provider": {
    "gsai": {
      "name": "GSAI",
      "npm": "@ai-sdk/openai-compatible",
      "env": [],
      "models": {
        "qwen3-5-plus": {
          "id": "qwen3.5-plus",
          "name": "qwen3.5-plus",
          "tool_call": true,
          "reasoning": false,
          "limit": {
            "context": 32000,
            "output": 8192
          }
        }
      },
      "options": {
        "baseURL": "https://www.gsaisg.top/v1",
        "apiKey": "sk-xxxx"
      }
    }
  }
}

---

8. Budget Management

注意： 设置预算时默认使用 budget_duration: 1month（每月重置预算）。

# Set key budget (自动设置 budget_duration 为 1month)
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py budget key sk-xxx 50

# Remove key budget
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py budget key sk-xxx --unset

# Set user budget (自动设置 budget_duration 为 1month)
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py budget user user-xxx 100

# Remove user budget
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py budget user user-xxx --unset

# Set team budget (自动设置 budget_duration 为 1month)
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py budget team team-xxx 500

# Remove team budget
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py budget team team-xxx --unset

---

9. Service Control

# Restart LiteLLM service (docker-compose)
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py restart

# View LiteLLM logs
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py logs --lines 100

# View system load (using Atop)
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py load

# View system load (raw Atop output)
python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py load --raw

说明：

• restart 使用 docker-compose restart litellm 重启服务
• logs 查看 LiteLLM 容器日志
• load 使用 VPS 上已安装的 Atop 高级性能监控工具显示系统负载

---

Scripts Overview

脚本	用途	位置
litellm_manager.py	LiteLLM 管理 CLI	scripts/litellm_manager.py
scan_models.py	扫描模型并生成 opencode 配置	scripts/scan_models.py

---

Official API Endpoints

Feature	Endpoint	Method
Key List	/key/list	GET
Key Generate	/key/generate	POST
Key Update	/key/update	POST
Key Delete	/key/delete	POST
Key Info	/key/info	GET
Key Regenerate	/key/regenerate	POST
User List	/user/list	GET
User Create	/user/new	POST
User Update	/user/update	POST
User Delete	/user/delete	POST
User Info	/user/info	GET
Team List	/team/list	GET
Team Create	/team/new	POST
Team Update	/team/update	POST
Team Delete	/team/delete	POST
Team Info	/team/info	GET
Team Member Add	/team/member_add	POST
Team Member Delete	/team/member_delete	POST
Key Budget Update	/key/update	POST
User Budget Update	/user/update	POST
Team Budget Update	/team/update	POST
Health	/health	GET
Restart	/admin/reload	POST

---

Configuration

The skill uses environment variables for configuration:

Variable	Description	Default
LITELLM_HOST	LiteLLM host	8.216.45.80
LITELLM_PORT	LiteLLM API port	4000
LITELLM_SSH_PORT	SSH port for VPS access	2222
LITELLM_SSH_KEY	Path to SSH private key	~/.ssh/ecs_key
SSH_USER	SSH username	root

---

新建用户完整流程 (New User Workflow)

当需要新建一个 LiteLLM 用户时，按以下步骤执行：

步骤 1: 创建用户

python3 ~/.openclaw/workspace/skills/litellm_manage/scripts/litellm_manager.py user new \
  --username <用户名> \
  --email <邮箱> \
  --budget <预算>

示例：

python3 ~/.openclaw/workspace/skills/litellm_manage/scripts/litellm_manager.py user new \
  --username yfzhao \
  --email [e-mail] \
  --budget 20

步骤 2: 设置预算周期

python3 ~/.openclaw/workspace/skills/litellm_manage/scripts/litellm_manager.py budget user <user_id> <预算>

这会自动设置 budget_duration: 1month

步骤 3: 生成 API Key

python3 ~/.openclaw/workspace/skills/litellm_manage/scripts/litellm_manager.py key generate \
  --alias <用户名> \
  --budget <预算> \
  --models <模型列表>

示例：

python3 ~/.openclaw/workspace/skills/litellm_manage/scripts/litellm_manager.py key generate \
  --alias yfzhao \
  --budget 20 \
  --models "glm-5,kimi-k2.5,deepseek-v3.2-exp,claude-haiku-4-5,minimax-m2.5"

步骤 4: 生成 opencode 配置文件

python3 ~/.openclaw/workspace/skills/litellm_manage/scripts/scan_models.py \
  -u https://www.gsaisg.top/v1 \
  -k <API_KEY> \
  -o /tmp/opencode_config.json

步骤 5: 发送通知邮件

使用 gog 发送邮件，包含：

• API Key
• 可用模型列表
• 预算信息
• opencode 配置文件附件

gog gmail send \
  --to <邮箱> \
  --subject "[LiteLLM] Your API Key is Ready - <用户名>" \
  --body "<邮件内容>" \
  --attach /tmp/opencode_config.json

快速命令汇总

# 完整流程 (需要手动填参数)
USER="yfzhao"
EMAIL="[e-mail]"
BUDGET=20
MODELS="glm-5,kimi-k2.5,deepseek-v3.2-exp,claude-haiku-4-5,minimax-m2.5"

# 1. 创建用户
python3 ~/.openclaw/workspace/skills/litellm_manage/scripts/litellm_manager.py user new --username $USER --email $EMAIL --budget $BUDGET

# 2. 设置预算周期
python3 ~/.openclaw/workspace/skills/litellm_manage/scripts/litellm_manager.py budget user <user_id> $BUDGET

# 3. 生成 Key
python3 ~/.openclaw/workspace/skills/litellm_manage/scripts/litellm_manager.py key generate --alias $USER --budget $BUDGET --models "$MODELS"

# 4. 生成配置
python3 ~/.openclaw/workspace/skills/litellm_manage/scripts/scan_models.py -u https://www.gsaisg.top/v1 -k <API_KEY> -o /tmp/opencode_config.json

# 5. 发邮件
gog gmail send --to $EMAIL --subject "[LiteLLM] Your API Key is Ready - $USER" --body "..." --attach /tmp/opencode_config.json

---

故障排查

SSH Connection Issues

# Test SSH connection
ssh -i ~/.ssh/ecs_key_backup -p 2222 root@8.216.45.80 "echo 'OK'"

# Check SSH key permissions
chmod 600 ~/.ssh/ecs_key_backup

API Errors

• Ensure master key is accessible via SSH
• Check LiteLLM service status: python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py status
• View logs: python3 openclaw_skill/litellm_manage/scripts/litellm_manager.py logs --lines 100

---

Testing

For detailed testing documentation, see TEST.md.

Quick test commands:

cd openclaw_skill/litellm_manage

# Run all tests
python -m pytest tests/ -v

# Run with coverage
python -m pytest tests/ --cov=scripts --cov-report=html

# Run live integration test
export LITELLM_SSH_KEY=~/.ssh/ecs_key_backup
python3 tests/integration_test_live.py

Test Summary: 81 test cases covering all commands (Key, User, Team, Config, Service).

---

Last updated: 2026-03-10