[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6KB7ZVMPPKA0YK3HA0SKCXA":3,"skill-same:01M6KB7ZVMPPKA0YK3HA0SKCXA":61},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":23,"publishedAt":33,"linkOnly":34,"markdownContent":35,"markdownBody":36,"frontMatter":37,"refName":39,"commitSha":40,"skillDirectory":41,"forksCount":42,"repositoryHtmlUrl":43,"repositoryHomepageUrl":6,"ownerHtmlUrl":44,"ownerBlogUrl":45,"ownerDescription":6,"updatedAt":46,"install":47,"resources":60},"01M6KB7ZVMPPKA0YK3HA0SKCXA","eval",null,"Evaluate and rank agent results by metric or LLM judge for an AgentHub session.","afaizalam2003\u002FMaster-claude-skill","afaizalam2003","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F222019359?v=4","01M6K8F2XNT0HKBPF00JQ78SV3","Faiz Alam","01M6K8F31EBXAPER0EG8R9HTR5",3,"MIT","https:\u002F\u002Fgithub.com\u002Fafaizalam2003\u002FMaster-claude-skill\u002Fblob\u002Fmain\u002Fengineering\u002Fagenthub\u002Fskills\u002Feval\u002FSKILL.md",[18],{"categoryNo":19,"categoryName":20,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000023","Skill与智能体开发","SCENARIO","使用场景",[5,24,25,26,27,28,29,30,31,32],"llm judge","agenthub","results","session","hub","judge","for","evaluate","metric","2026-11-10 10:12:30",false,"---\nname: \"eval\"\ndescription: \"Evaluate and rank agent results by metric or LLM judge for an AgentHub session.\"\ncommand: \u002Fhub:eval\n---\n\n# \u002Fhub:eval — Evaluate Agent Results\n\nRank all agent results for a session. Supports metric-based evaluation (run a command), LLM judge (compare diffs), or hybrid.\n\n## Usage\n\n```\n\u002Fhub:eval                           # Eval latest session using configured criteria\n\u002Fhub:eval 20260317-143022           # Eval specific session\n\u002Fhub:eval --judge                   # Force LLM judge mode (ignore metric config)\n```\n\n## What It Does\n\n### Metric Mode (eval command configured)\n\nRun the evaluation command in each agent's worktree:\n\n```bash\npython {skill_path}\u002Fscripts\u002Fresult_ranker.py \\\n  --session {session-id} \\\n  --eval-cmd \"{eval_cmd}\" \\\n  --metric {metric} --direction {direction}\n```\n\nOutput:\n```\nRANK  AGENT       METRIC      DELTA      FILES\n1     agent-2     142ms       -38ms      2\n2     agent-1     165ms       -15ms      3\n3     agent-3     190ms       +10ms      1\n\nWinner: agent-2 (142ms)\n```\n\n### LLM Judge Mode (no eval command, or --judge flag)\n\nFor each agent:\n1. Get the diff: `git diff {base_branch}...{agent_branch}`\n2. Read the agent's result post from `.agenthub\u002Fboard\u002Fresults\u002Fagent-{i}-result.md`\n3. Compare all diffs and rank by:\n   - **Correctness** — Does it solve the task?\n   - **Simplicity** — Fewer lines changed is better (when equal correctness)\n   - **Quality** — Clean execution, good structure, no regressions\n\nPresent rankings with justification.\n\nExample LLM judge output for a content task:\n```\nRANK  AGENT    VERDICT                               WORD COUNT\n1     agent-1  Strong narrative, clear CTA            1480\n2     agent-3  Good data points, weak intro           1520\n3     agent-2  Generic tone, no differentiation       1350\n\nWinner: agent-1 (strongest narrative arc and call-to-action)\n```\n\n### Hybrid Mode\n\n1. Run metric evaluation first\n2. If top agents are within 10% of each other, use LLM judge to break ties\n3. Present both metric and qualitative rankings\n\n## After Eval\n\n1. Update session state:\n```bash\npython {skill_path}\u002Fscripts\u002Fsession_manager.py --update {session-id} --state evaluating\n```\n\n2. Tell the user:\n   - Ranked results with winner highlighted\n   - Next step: `\u002Fhub:merge` to merge the winner\n   - Or `\u002Fhub:merge {session-id} --agent {winner}` to be explicit\n","# \u002Fhub:eval — Evaluate Agent Results\n\nRank all agent results for a session. Supports metric-based evaluation (run a command), LLM judge (compare diffs), or hybrid.\n\n## Usage\n\n```\n\u002Fhub:eval                           # Eval latest session using configured criteria\n\u002Fhub:eval 20260317-143022           # Eval specific session\n\u002Fhub:eval --judge                   # Force LLM judge mode (ignore metric config)\n```\n\n## What It Does\n\n### Metric Mode (eval command configured)\n\nRun the evaluation command in each agent's worktree:\n\n```bash\npython {skill_path}\u002Fscripts\u002Fresult_ranker.py \\\n  --session {session-id} \\\n  --eval-cmd \"{eval_cmd}\" \\\n  --metric {metric} --direction {direction}\n```\n\nOutput:\n```\nRANK  AGENT       METRIC      DELTA      FILES\n1     agent-2     142ms       -38ms      2\n2     agent-1     165ms       -15ms      3\n3     agent-3     190ms       +10ms      1\n\nWinner: agent-2 (142ms)\n```\n\n### LLM Judge Mode (no eval command, or --judge flag)\n\nFor each agent:\n1. Get the diff: `git diff {base_branch}...{agent_branch}`\n2. Read the agent's result post from `.agenthub\u002Fboard\u002Fresults\u002Fagent-{i}-result.md`\n3. Compare all diffs and rank by:\n   - **Correctness** — Does it solve the task?\n   - **Simplicity** — Fewer lines changed is better (when equal correctness)\n   - **Quality** — Clean execution, good structure, no regressions\n\nPresent rankings with justification.\n\nExample LLM judge output for a content task:\n```\nRANK  AGENT    VERDICT                               WORD COUNT\n1     agent-1  Strong narrative, clear CTA            1480\n2     agent-3  Good data points, weak intro           1520\n3     agent-2  Generic tone, no differentiation       1350\n\nWinner: agent-1 (strongest narrative arc and call-to-action)\n```\n\n### Hybrid Mode\n\n1. Run metric evaluation first\n2. If top agents are within 10% of each other, use LLM judge to break ties\n3. Present both metric and qualitative rankings\n\n## After Eval\n\n1. Update session state:\n```bash\npython {skill_path}\u002Fscripts\u002Fsession_manager.py --update {session-id} --state evaluating\n```\n\n2. Tell the user:\n   - Ranked results with winner highlighted\n   - Next step: `\u002Fhub:merge` to merge the winner\n   - Or `\u002Fhub:merge {session-id} --agent {winner}` to be explicit\n",{"name":5,"command":38,"description":7},"\u002Fhub:eval","main","0b48cbb0e6d5be6ff68c0f6b28bc0c65ee21c4a1","engineering\u002Fagenthub\u002Fskills\u002Feval",2,"https:\u002F\u002Fgithub.com\u002Fafaizalam2003\u002FMaster-claude-skill","https:\u002F\u002Fgithub.com\u002Fafaizalam2003","https:\u002F\u002Fwww.linkedin.com\u002Fin\u002Fmdfaizalam2003\u002F","2026-04-01 04:35:43",{"source":8,"skillName":5,"commands":48,"prompt":58,"zipAvailable":59},[49,52,55],{"tool":50,"command":51},"npx","npx skills add afaizalam2003\u002FMaster-claude-skill --skill eval",{"tool":53,"command":54},"bunx","bunx skills add afaizalam2003\u002FMaster-claude-skill --skill eval",{"tool":56,"command":57},"pnpm","pnpm dlx skills add afaizalam2003\u002FMaster-claude-skill --skill eval","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fafaizalam2003\u002FMaster-claude-skill\u002Fblob\u002Fmain\u002Fengineering\u002Fagenthub\u002Fskills\u002Feval\u002FSKILL.md",true,[],[62,93,118,143,173,193],{"skillNo":63,"name":64,"nameZh":6,"description":65,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":66,"categories":67,"keywords":73,"publishedAt":33},"01M6KC4E8MYR9DBAZTAXHKYMMH","soc2-compliance","Use when the user asks to prepare for SOC 2 audits, map Trust Service Criteria, build control matrices, collect audit evidence, perform gap analysis, or assess SOC 2 Type I vs Type II readiness.","https:\u002F\u002Fgithub.com\u002Fafaizalam2003\u002FMaster-claude-skill\u002Fblob\u002Fmain\u002Fra-qm-team\u002Fsoc2-compliance\u002FSKILL.md",[68],{"categoryNo":69,"categoryName":70,"taxonomyType":71,"taxonomyTypeDesc":72},"01JBSEEDCAT000000000000037","律师与法务","PROFESSION","适用职业",[74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,30],"compliance","soc2","soc2 compliance","audit evidence","audit","collect","soc","analysis","use","evidence","trust","build","map","control","type","gap","readiness","gap analysis","assess",{"skillNo":94,"name":95,"nameZh":6,"description":96,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":97,"categories":98,"keywords":99,"publishedAt":33},"01M6KC461R3GKGZ1TAYHVR1MW9","risk-management-specialist","Medical device risk management specialist implementing ISO 14971 throughout product lifecycle. Provides risk analysis, risk evaluation, risk control, and post-production information analysis. Use when user mentions risk management, ISO 14971, risk analysis, FMEA, fault tree analysis, hazard identification, risk control, risk matrix, benefit-risk analysis, residual risk, risk acceptability, or post-market risk.","https:\u002F\u002Fgithub.com\u002Fafaizalam2003\u002FMaster-claude-skill\u002Fblob\u002Fmain\u002Fra-qm-team\u002Frisk-management-specialist\u002FSKILL.md",[],[100,101,102,103,104,105,106,107,81,82,108,109,110,111,112,113,114,115,116,117],"risk","risk management specialist","management","risk management","risk evaluation","product","Evaluation","lifecycle","risk matrix","iso","medical","iso 14971","identification","information","post-production","tree","matrix","implementing",{"skillNo":119,"name":120,"nameZh":6,"description":121,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":122,"categories":123,"keywords":124,"publishedAt":33},"01M6KC3HF5ZFSSP2NZF68PEPFB","regulatory-affairs-head","Senior Regulatory Affairs Manager for HealthTech and MedTech companies. Prepares FDA 510(k), De Novo, and PMA submission packages; analyzes regulatory pathways for new medical devices; drafts responses to FDA deficiency letters and Notified Body queries; develops CE marking technical documentation under EU MDR 2017\u002F745; coordinates multi-market approval strategies across FDA, EU, Health Canada, PMDA, and NMPA; and maintains regulatory intelligence on evolving standards. Use when users need to plan or execute FDA submissions, navigate 510(k) or PMA approval processes, achieve CE marking, prepare pre-submission meeting materials, write regulatory strategy documents, respond to agency queries, or manage compliance documentation for medical device market access.","https:\u002F\u002Fgithub.com\u002Fafaizalam2003\u002FMaster-claude-skill\u002Fblob\u002Fmain\u002Fra-qm-team\u002Fregulatory-affairs-head\u002FSKILL.md",[],[125,126,127,128,129,130,131,132,133,82,134,135,136,137,138,139,140,141,142,30],"regulatory affairs head","regulatory","head","documents","devices","health","plan","write","strategy","standards","queries","manage","strategies","de","users","respond","medical devices","manager",{"skillNo":144,"name":145,"nameZh":6,"description":146,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":147,"categories":148,"keywords":155,"publishedAt":33},"01M6KC34Z8M1559EY1CXYBJB1A","quality-manager-qms-iso13485","ISO 13485 Quality Management System implementation and maintenance for medical device organizations. Provides QMS design, documentation control, internal auditing, CAPA management, and certification support. Use when working with medical device quality systems, preparing for ISO 13485 audits, managing regulatory compliance documentation, setting up corrective actions, or building audit preparation programs. Useful for quality management, audit preparation, regulatory compliance, medical device documentation, and corrective action workflows.","https:\u002F\u002Fgithub.com\u002Fafaizalam2003\u002FMaster-claude-skill\u002Fblob\u002Fmain\u002Fra-qm-team\u002Fquality-manager-qms-iso13485\u002FSKILL.md",[149,152],{"categoryNo":150,"categoryName":151,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000015","视觉设计",{"categoryNo":153,"categoryName":154,"taxonomyType":71,"taxonomyTypeDesc":72},"01JBSEEDCAT000000000000032","设计师",[156,157,142,158,159,160,161,162,163,82,164,165,166,167,168,169,170,171,30,172],"quality manager qms iso13485","quality","design","workflows","validation","actions","certification","system","maintenance","document","systems","records","ISO 13485","organizations","corrective action","internal audit","preparation",{"skillNo":174,"name":175,"nameZh":6,"description":176,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":177,"categories":178,"keywords":180,"publishedAt":33},"01M6KC2FXHBHXYX2ZZ17Y3GDB4","quality-manager-qmr","Senior Quality Manager Responsible Person (QMR) for HealthTech and MedTech companies. Provides quality system governance, management review leadership, regulatory compliance oversight, and quality performance monitoring per ISO 13485 Clause 5.5.2.","https:\u002F\u002Fgithub.com\u002Fafaizalam2003\u002FMaster-claude-skill\u002Fblob\u002Fmain\u002Fra-qm-team\u002Fquality-manager-qmr\u002FSKILL.md",[179],{"categoryNo":69,"categoryName":70,"taxonomyType":71,"taxonomyTypeDesc":72},[181,157,142,182,183,184,185,186,74,187,163,188,126,189,190,191,109,168,30,192],"quality manager qmr","review","policy","performance","governance","monitoring","regulatory compliance","oversight","cost","culture","leadership","person",{"skillNo":194,"name":195,"nameZh":6,"description":196,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":197,"categories":198,"keywords":204,"publishedAt":33},"01M6KC1VRR5JTDBNZANHPS6VR6","quality-documentation-manager","Document control system management for medical device QMS. Covers document numbering, version control, change management, and 21 CFR Part 11 compliance. Use for document control procedures, change control workflow, document numbering, version management, electronic signature compliance, or regulatory documentation review.","https:\u002F\u002Fgithub.com\u002Fafaizalam2003\u002FMaster-claude-skill\u002Fblob\u002Fmain\u002Fra-qm-team\u002Fquality-documentation-manager\u002FSKILL.md",[199,202,203],{"categoryNo":200,"categoryName":201,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000002","文档处理",{"categoryNo":19,"categoryName":20,"taxonomyType":21,"taxonomyTypeDesc":22},{"categoryNo":69,"categoryName":70,"taxonomyType":71,"taxonomyTypeDesc":72},[205,206,157,142,182,207,208,78,163,209,210,211,212,213,110,214,215,216,217,30],"documentation","quality documentation manager","workflow","change","change management","list","master","system management","documentation review","cfr","21 cfr part 11","change control","retention"]