evaluate-skill
Evaluate a local Codex skill in engineer-friendly terms. Use when the user says "evaluate this skill", "give me an analysis of the game dev skill", "audit this skill", "why did this score that way", "what should I fix first", or asks for a skill-specific report before benchmarking it.
- License 许可
- MIT
- 最近更新
- 2026-07-19
- Stars
- ★ 1
- Forks
- 1
01 前言 Front Matter
- name
- evaluate-skill
- description
- Evaluate a local Codex skill in engineer-friendly terms. Use when the user says "evaluate this skill", "give me an analysis of the game dev skill", "audit this skill", "why did this score that way", "what should I fix first", or asks for a skill-specific report before benchmarking it.
02 资源文件 1
- 参考文档agents/openai.yaml96 B
03 SKILL.md 正文
Evaluate Skill
Use this skill when the target is a local skill directory or SKILL.md file.
Workflow
- Treat "Evaluate this skill." as the default entrypoint.
- If the user names a skill instead of giving a path, resolve it locally first, preferring
~/.codex/skills/<skill-name>and then repo-localskills/<skill-name>. - If the user says the request in natural language first, use
plugin-eval start <skill-path> --request "<user request>" --format markdownto show the routed path clearly. - Run
plugin-eval analyze <skill-path> --format markdown. - Review
At a Glance,Why It Matters,Fix First, andRecommended Next Stepbefore drilling into details. - Explain which findings are structural, which are budget-related, and which are code-related.
- If the user asks for an "analysis" of the skill, do not stop at the report. Also run
plugin-eval init-benchmark <skill-path>and show the setup questions for refining the starter scenarios in.plugin-eval/benchmark.json. - If the user wants real usage numbers, switch to "Measure the real token usage of this skill." and run the benchmark flow.
- After observed usage is available, use
plugin-eval measurement-plan <skill-path> --observed-usage <usage.jsonl> --format markdownto recommend what to instrument or improve next. - If the user wants a rewrite plan, route to
../improve-skill/SKILL.md.
Skill-Specific Priorities
- frontmatter validity
nameanddescriptionquality- progressive disclosure and reference usage
- broken relative links
- oversized
SKILL.mdor descriptions - helper script quality for TypeScript and Python files
Chat Requests To Recognize
Evaluate this skill.Give me an analysis of the game dev skill.Audit this skill.Why did this skill score that way?What should I fix first?Measure the real token usage of this skill.
Commands
plugin-eval start <skill-path> --request "Evaluate this skill." --format markdown
plugin-eval analyze <skill-path> --format markdown
plugin-eval explain-budget <skill-path> --format markdown
plugin-eval measurement-plan <skill-path> --format markdown
plugin-eval init-benchmark <skill-path>
plugin-eval benchmark <skill-path> --dry-run
Reference
../../references/chat-first-workflows.md
04 同仓库更多 Skills
Zotero
Use Zotero Desktop from Codex to enable/probe the local API, search a local Zotero library, list items/collections/tags, export BibTeX, insert citation keys into LaTeX or Markdown drafts, read indexed full text when requested, and import BibTeX/RIS records into Zotero through the connector server. Use when the user mentions Zotero, citations, references.bib, BibTeX export, local Zotero API, localhost:23119, or adding citations from a Zotero library.
zoom-apps-sdk
Use when using Apps SDK.
youtube
Obtain accurate, timestamped YouTube video transcripts (preferring manual captions over auto-generated) as the primary deliverable, then derive summaries, key claims, or notes from that transcript. Use when the user provides a YouTube URL (or video ID) and wants the transcript, a faithful summary, key claims with attribution, timestamped notes, or "what does this video actually say". The skill is transcript-first: never substitute metadata, title, description, or search snippets for the spoken content. Triggers: "youtube transcript", "get the transcript of this video", "summarize this youtube video", "what did they say in https://youtube.com/...", "key claims from this talk".
yeet
Publish local changes to GitHub by confirming scope, committing intentionally, pushing the branch, and opening a draft PR through the GitHub app from this plugin, with `gh` used only as a fallback where connector coverage is insufficient.
x-post-creator
Create X-ready post threads and co-located story packages from the active conversation or referenced project material. Use when the user says turn this into an X-post, /x-post, make this into an X thread, or wants plain-language social posts with supporting images saved to docs/x-posts/[story-name]/.
x-api
Search, read, and write X posts through the local X API MCP server (the same backend used by the Codex x-api skill). Use for searching X/x.com, reading threads and replies, creating lists, staging/publishing posts for @alltheputs, finding high-visibility reply targets for research outreach, ingesting public context, or any request that mentions /x-api or "search X".