来源信息
- 仓库
- modbender/skill-library-mcp
- 最近来源活动
- 2026年3月6日 18:33
- 检测到的 SKILL.md 语言
- 英语
- 星标
- 12
- 分支
- 3
安装方式
默认使用会先检查来源的 Prompt；你也可以切换为直接命令，或下载本地副本。
检查来源文件
决定是否安装前，请先阅读 SKILL.md，以及 SkillsMP 当前展示的配套文件。
正在显示 SKILL.md
SKILL.md
来源说明 · 只读预览- name
- A/B Testing Framework
- version
- 1.0.0
- description
- Compare models with A/B testing for selection
- author
- OpenClaw SysAdmin Community
- tags
- [20,"sysadmin","manual"]
- trigger
- {"type":"manual","schedule":"","enabled":true}
- input
- {"model_a":{"type":"string","description":"First model","required":true},"model_b":{"type":"string","description":"Second model","required":true},"test_prompts":{"type":"array","description":"Test prompts","required":true}}
- output
- {"status":"string","details":"object","winner":"string","confidence":"number"}
- dependencies
- ["openclaw/llm","stats-library"]
- security
- ["A/B test security per Category 8; prevent test manipulation","Validate all inputs per Category 8","Use least privilege principle","Log all operations for audit"]
# A/B Testing Framework
## Description
Compare models with A/B testing for selection
## Source Reference
This skill is derived from **20. Testing & Quality Assurance** of the OpenClaw Agent Mastery Index v4.1.
**Sub-heading**: A/B Testing Frameworks for Model Selection
**Complexity**: high
## Input Parameters
| Name | Type | Required | Description |
|------|------|----------|-------------|
| `model_a` | string | Yes | First model |
| `model_b` | string | Yes | Second model |
| `test_prompts` | array | Yes | Test prompts |
## Output Format
```json
{
"status": <string>,
"details": <object>,
"winner": <string>,
"confidence": <number>
}
```
## Usage Examples
### Example 1: Basic Usage
```javascript
const result = await openclaw.skill.run('ab-test-framework', {
model_a: "value",
model_b: "value",
test_prompts: 123
});
```
### Example 2: With Optional Parameters
```javascript
const result = await openclaw.skill.run('ab-test-framework', {
model_a: "value",
model_b: "value",
test_prompts: []
});
```
## Security Considerations
A/B test security per Category 8; prevent test manipulation
### Additional Security Measures
1. **Input Validation**: All inputs are validated before processing
2. **Least Privilege**: Operations run with minimal required permissions
3. **Audit Logging**: All actions are logged for security review
4. **Error Handling**: Errors are sanitized before returning to caller
## Troubleshooting
### Common Issues
| Issue | Cause | Solution |
|-------|-------|----------|
| Permission denied | Insufficient privileges | Check file/directory permissions |
| Invalid input | Malformed parameters | Validate input format |
| Dependency missing | Required module not installed | Run `npm install` |
### Debug Mode
Enable debug logging:
```javascript
openclaw.logger.setLevel('debug');
const result = await openclaw.skill.run('ab-test-framework', { ... });
```
## Related Skills
- `model-routing-manager`
- `performance-benchmarker`
* @param {string} params.model_a - First model
* @param {string} params.model_b - Second model
* @param {Array} params.test_prompts - Test prompts
在 GitHub 查看