llm-council
Run Fireworks-hosted open-weight model councils that compare responses and synthesize a final answer.
- License 许可
- MIT
- 最近更新
- 2026-11-09
- Stars
- ★ 0
- Forks
- 0
01 前言 Front Matter
- name
- llm-council
- risk
- safe
- tags
- [ "dair-academy", "ai", "workflow" ]
- tools
- [ "claude-code", "codex-cli", "cursor" ]
- author
- DAIR.AI
- source
- official
- license
- MIT
- category
- ai-ml
- date_added
- 2026-06-19
- description
- Run Fireworks-hosted open-weight model councils that compare responses and synthesize a final answer.
- source_repo
- dair-ai/dair-academy-plugins
- source_type
- official
- allowed-tools
- Read, Write, Bash, AskUserQuestion
- license_source
- https://github.com/dair-ai/dair-academy-plugins/blob/main/README.md#license
02 资源文件 2
- 其他.env.example275 B
- 参考文档references/detailed-guide.md18.2 KB
03 SKILL.md 正文
LLM Council (Fireworks AI)
Detailed Guide
Read the detailed guide before executing this skill. It retains the complete procedure and reference material. Treat its safety, prerequisites, and validation requirements as mandatory. For focused work, load the relevant sections; for end-to-end work, read the guide completely.
When to Use
Use when this workflow matches the user request: Use this skill for its documented workflow.
Source: dair-ai/dair-academy-plugins (MIT).
This skill implements Karpathy's LLM Council concept where multiple open-weight LLMs deliberate on a query, powered entirely by Fireworks AI:
- Phase 1: All models respond to the query independently (parallel)
- Phase 2: Models rank each other's anonymized responses
- Phase 3: A Chairman LLM synthesizes the final answer
All inference runs through Fireworks AI using open-weight models. The speed and pricing of Fireworks makes it practical to run multi-model deliberation that would be slow or expensive on other providers.
CRITICAL RULES
- ALWAYS use AskUserQuestion to let the user select council models (multiselect) and the Chairman model
- ALWAYS save raw responses to files - never summarize or truncate API outputs
- ALWAYS show full transparency - display all individual responses, all rankings, AND the final synthesis
- NEVER skip the ranking phase - it is essential to the council deliberation process
- Read from files for display - ensures content is shown unmodified
- ALWAYS display the final output to the user after Phase 3 completes
Limitations
- Requires the upstream tool, account, API key, or local setup when the workflow names one.
- Does not authorize destructive, production, paid, or external-message actions without explicit user approval.
- Validate generated artifacts or recommendations against the user's real sources before treating them as final.
04 同仓库更多 Skills
dei-assessment
Assess diversity, equity, and inclusion with metrics. TRIGGERS - Use when user needs help with dei-assessment related tasks.
dei-action-plan
Create DEI action plans with goals and initiatives. TRIGGERS - Use when user needs help with dei-action-plan related tasks.
culture-fit-assessment
Design culture add assessment processes. TRIGGERS - Use when user needs help with culture-fit-assessment related tasks.
cowork-to-code-bridge
Use an already-installed, independently verified cowork-to-code bridge to run narrowly approved actions on the user's own macOS, Linux, or WSL2 machine through a local file queue.
counter-offer-response
Draft counter-offer responses for retention. TRIGGERS - Use when user needs help with counter-offer-response related tasks.
continuous-feedback-system
Design continuous feedback systems. TRIGGERS - Use when user needs help with continuous-feedback-system related tasks.