multi-teacher-distill-lite
LinkedIn/InfoQ multi-teacher offline distillation with per-shard cache, stability switch, prune+compress (docs/MULTI_TEACHER_DISTILL.md).
- License 许可
- MIT
- 最近更新
- 2026-11-09
- Stars
- ★ 1
- Forks
- 0
01 前言 Front Matter
- name
- multi-teacher-distill-lite
- description
- LinkedIn/InfoQ multi-teacher offline distillation with per-shard cache, stability switch, prune+compress (docs/MULTI_TEACHER_DISTILL.md).
02 资源文件 1
- 参考文档agents/openai.yaml299 B
03 SKILL.md 正文
Skill: multi-teacher-distill-lite
Follow docs/MULTI_TEACHER_DISTILL.md.
- Primary: https://www.linkedin.com/blog/engineering/infrastructure/the-training-infrastructure-behind-ai-powered-job-search-eight-x-faster-multi-teacher-distillation
- Digest: https://www.infoq.com/news/2026/09/linkedin-ai-multi-teacher/
python3 scripts/multi_teacher_distill_gate.py --json
Rules:
- Offline first — cache teacher soft labels/embeddings; iterate the student without re-running teachers.
- Per-shard invalidation — never all-or-nothing teacher cache clears.
- Pluggable teachers — relevance | engagement | embedding | policy | click | critic.
- Compact student for serving — distill into skills/gates/fixtures; do not serve teacher fleets live.
- Stream, don’t full-stage the corpus each run.
- Online while exploring teachers; offline when stable (InfoQ).
- Compound gains — stack moderate local wins; do not default FP8 on small models.
- Prune + compress student serving; demand NDCG (or peer) before quality claims.
- No GPU multi-node training SaaS under the hard monthly cap.
04 同仓库更多 Skills
writing-plans
Use when you have a spec or requirements for a multi-step task, before touching code
workflow-economics-lite
Escape AI pilot purgatory: require completion-loop workflows with one owner, baseline, economic metric, system-of-record integration, and audit trail. Block orphan chatbots and interest-as-ROI claims.
verification-before-completion
Use when about to claim work is complete, fixed, or passing, before committing or creating PRs - requires running verification commands and confirming output before making any success claims; evidence before assertions always
value-center-lite
Apply InfoQ Rohrer value-center / VSM five questions (agency + coherence). Use when planning work, shipping releases, or auditing agent autonomy claims. Fail closed on product-only slogans without WQTU/paywall value.
using-superpowers
Use when starting any conversation - establishes how to find and use skills, requiring skill invocation before ANY response including clarifying questions
using-git-worktrees
Use when starting feature work that needs isolation from current workspace or before executing implementation plans - ensures an isolated workspace exists via native tools or git worktree fallback