llm-redteam-overview
LLM red team category — full AATMF v3 tactic coverage (T01–T15). Routing skill: read this first to identify which tactic applies, then load the matching sub-skill. Maps to MITRE ATLAS where overlap exists.
- License 许可
- Apache-2.0
- 最近更新
- 2026-07-22
- Stars
- ★ 3
- Forks
- 0
01 前言 Front Matter
- name
- llm-redteam-overview
- metadata
- { "tags": "ai-security, llm, aatmf, atlas", "subdomain": "ai-security", "when_to_use": "llm, ai, model, gpt, claude, prompt, jailbreak, ai red team, prompt injection, llm exploit, aatmf, atlas, agentic, rag, multimodal, training data, model poisoning, output filter bypass", "mitre_attack": "T1606", "aatmf_framework": "v3" }
- description
- LLM red team category — full AATMF v3 tactic coverage (T01–T15). Routing skill: read this first to identify which tactic applies, then load the matching sub-skill. Maps to MITRE ATLAS where overlap exists.
- allowed-tools
- Bash Read Write
03 SKILL.md 正文
LLM Red Team Skill Catalog — AATMF v3
This is the routing skill for AI/LLM red-team work. The 15 sub-skills below cover every tactic in the AI/ML Adversarial Tactics, Techniques & Mitigations Framework (AATMF v3). Load the specific sub-skill that matches the attacker objective.
Tactic Map
| Tactic | Sub-Skill | Covers | Load Path |
|---|---|---|---|
| T01 | prompt-injection | Direct + indirect prompt injection, ASCII smuggling, payload-in-image, prompt leaking | load_skill("/skills/plugins/llm-redteam/t01-prompt-injection/SKILL.md") |
| T02 | linguistic-evasion | Translation/transliteration bypass, base64/leetspeak/emoji encoding, low-resource-language jailbreak, multi-lingual context split | load_skill("/skills/plugins/llm-redteam/t02-linguistic-evasion/SKILL.md") |
| T03 | reasoning-exploit | CoT / ReAct hijack, math/logic distractor, role-play escalation, hypothetical / counterfactual framing | load_skill("/skills/plugins/llm-redteam/t03-reasoning-exploit/SKILL.md") |
| T04 | memory-manipulation | Long-context overflow, conversation rewrite, sliding-window poisoning, "previous turn" forgery | load_skill("/skills/plugins/llm-redteam/t04-memory-manipulation/SKILL.md") |
| T05 | api-exploitation | Function-calling abuse, tool-schema confusion, parameter pollution, response-format coercion | load_skill("/skills/plugins/llm-redteam/t05-api-exploitation/SKILL.md") |
| T06 | training-poisoning | Backdoor trigger injection, label flip, RLHF reward hacking, fine-tune dataset contamination | load_skill("/skills/plugins/llm-redteam/t06-training-poisoning/SKILL.md") |
| T07 | output-exfil | Data-leak via reflection, side-channel via length/timing, watermark stripping, token-by-token exfil | load_skill("/skills/plugins/llm-redteam/t07-output-exfil/SKILL.md") |
| T08 | deception | Confident-hallucination weaponization, persona impersonation, source spoofing, "as the system says" framings | load_skill("/skills/plugins/llm-redteam/t08-deception/SKILL.md") |
| T09 | multimodal | Image/audio prompt injection, OCR-payload, steganographic prompts, adversarial perturbations | load_skill("/skills/plugins/llm-redteam/t09-multimodal/SKILL.md") |
| T10 | confidentiality-breach | System-prompt extraction, weight inference, training-data extraction, PII echo | load_skill("/skills/plugins/llm-redteam/t10-confidentiality-breach/SKILL.md") |
| T11 | agentic-exploit | Tool-chain hijack, autonomous-loop poisoning, plan-injection, sub-agent confusion | load_skill("/skills/plugins/llm-redteam/t11-agentic-exploit/SKILL.md") |
| T12 | rag-poisoning | RAG index injection, document smuggling, embedding-collision, retrieval-rank gaming | load_skill("/skills/plugins/llm-redteam/t12-rag-poisoning/SKILL.md") |
| T13 | supply-chain | Model registry tampering, dependency confusion (HF Hub, Ollama, MCP), serialization payload abuse | load_skill("/skills/plugins/llm-redteam/t13-supply-chain/SKILL.md") |
| T14 | infra-warfare | GPU resource abuse, billing-amplification, rate-limit DoS, cold-start abuse, region failover poisoning | load_skill("/skills/plugins/llm-redteam/t14-infra-warfare/SKILL.md") |
| T15 | human-ai-coupling | Operator manipulation via AI output, social engineering uplift, dark-pattern UX exploiting AI trust | load_skill("/skills/plugins/llm-redteam/t15-human-ai-coupling/SKILL.md") |
Quick Routing
Target type identified?
├── Chat-only LLM endpoint → T01, T02, T03, T10
├── LLM with tools / function calling → T05, T11
├── LLM with RAG / retrieval → T12, T01 (indirect)
├── LLM with multimodal input → T09
├── Fine-tuned / custom model → T06, T10 (extraction)
├── Cross-tenant / shared infra → T14, T13
└── Human-in-the-loop product → T15, T08
Tooling
| Tool | Use |
|---|---|
promptfoo |
Plugin-based red-team eval — declarative test cases, runs all 15 tactic plugins |
garak |
NVIDIA's LLM vulnerability scanner — alignment, jailbreak, leak probes |
pyrit |
Microsoft's open red-team automation framework |
agentdojo |
Agentic-system specific (T11) — sandboxed tool-chain attack benchmark |
LangSmith / Langfuse |
Observation surface — replay attacks against deployed agents |
Cross-Reference
- MITRE ATLAS — covers tactic-level coverage (Reconnaissance → Impact). AATMF is more attacker-procedure focused. Most AATMF techniques map to one or more ATLAS techniques; the sub-skills note the mapping in their frontmatter.
- OWASP LLM Top 10 — risk-class level. AATMF tactics map across LLM01-LLM10.
- NIST AI RMF AI 600-1 — governance lens; AATMF gives the offensive counterpart.
When in doubt
If the target's surface or behavior doesn't cleanly match one tactic, run a T01 + T05 probe first — direct prompt injection and function-call abuse are the most common, highest-yield starting points and their results inform which other tactics are reachable.
04 同仓库更多 Skills
wps-pixie-dust
WPS Pixie-Dust offline nonce attack (reaver -K / pixiewps) and fallback online PIN brute (bully) to recover the AP's WPA PSK without capturing a handshake.
wpa3-sae
WPA3-SAE transition-mode downgrade (DragonShift), SSID Confusion CVE-2023-52424, Dragonblood side-channels, and SAE captive-portal credential recovery against WPA3-Personal networks.
wpa2-psk
WPA/WPA2-PSK handshake capture via targeted deauth + PMKID (no deauth required) + offline hashcat cracking. The most common consumer/SMB encryption mode in 2026.
wpa-enterprise-eap
WPA/WPA2/WPA3-Enterprise (802.1X/EAP) rogue-RADIUS evil-twin for MSCHAPv2 capture, GTC downgrade, and PEAP relay. MSCHAPv2 capture equals a NetNTLM hash — the primary wireless on-ramp to Active Directory.
krack-fragattacks
KRACK key-reinstallation (CVE-2017-13077..13082) and FragAttacks fragmentation/aggregation flaws (CVE-2020-24586..24588, CVE-2020-26139..26147) against legacy or embedded 802.11 supplicants with poor patch cadence.
evil-twin-karma
Evil-twin rogue AP with KARMA/Mana PNL-probe response, captive-portal credential capture, and post-association MITM for PSK/open networks. Distinct from wpa-enterprise-eap which targets 802.1X.