ai-red-teaming
Run structured AI red team exercises for jailbreak resistance, data exfiltration risk, harmful output controls, and agent tool abuse resilience.
来源信息
- 仓库
- Njones17/AI-agent-master-cyber-skills-list
- 最近来源活动
- 2026年3月6日 16:13
- 检测到的 SKILL.md 语言
- 英语
- 星标
- 23
- 分支
- 6
安装方式
默认使用会先检查来源的 Prompt；你也可以切换为直接命令，或下载本地副本。
检查来源文件
决定是否安装前，请先阅读 SKILL.md，以及 SkillsMP 当前展示的配套文件。
正在显示 SKILL.md
SKILL.md
来源说明 · 只读预览- name
- ai-red-teaming
- description
- Run structured AI red team exercises for jailbreak resistance, data exfiltration risk, harmful output controls, and agent tool abuse resilience.
- license
- MIT
- metadata
- {"author":"devops-skills","version":"1.0"}
# AI Red Teaming
Continuously test AI applications like an adversary to discover exploitable failure modes before attackers do.
## Program Design
- Define threat scenarios: jailbreaks, policy evasion, prompt injection, model abuse.
- Build reusable attack suites by domain (support bot, coding agent, RAG assistant).
- Include multilingual and obfuscated attack prompts.
- Track results in a risk register with severity and exploitability.
## Test Categories
1. **Jailbreak robustness**: bypassing safety instructions.
2. **Data exfiltration**: extracting secrets, system prompts, tenant data.
3. **Tool abuse**: unauthorized API calls or command execution.
4. **Social engineering**: inducing unsafe business actions.
5. **Availability abuse**: token amplification and DoS-style prompts.
## Exercise Cadence
- Pre-release blocking red-team gate.
- Monthly deep-dive campaigns.
- Post-incident targeted retests.
## Scoring Model
- Likelihood (1-5)
- Impact (1-5)
- Detectability (1-5)
- Control maturity (low/medium/high)
Use scores to prioritize fixes and define SLA for remediation.
## Reporting Essentials
- Reproducible prompt traces
- Model/version and config used
- Successful attack chain narrative
- Recommended mitigations + verification steps
## Related Skills
- [agent-evals](../../../devops/ai/agent-evals/) - Convert findings into regression tests
- [prompt-injection-defense](../prompt-injection-defense/) - Implement injection countermeasures
- [penetration-testing](../../operations/penetration-testing/) - Broader offensive security process
在 GitHub 查看