[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7F8H5K2ZFQE2MSNVR07H3YC":3,"skill-same:01M7F8H5K2ZFQE2MSNVR07H3YC":63},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":28,"commitSha":29,"skillDirectory":30,"forksCount":31,"repositoryHtmlUrl":32,"repositoryHomepageUrl":6,"ownerHtmlUrl":33,"ownerBlogUrl":6,"ownerDescription":34,"updatedAt":35,"install":36,"resources":48},"01M7F8H5K2ZFQE2MSNVR07H3YC","benchmark-evaluation",null,"Validate DeepResearch benchmark rollout files and choose official evaluation routes before spending judge API credits.","lza6\u002FArmor-piercing-system-prompts","lza6","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F128880206?v=4","01M7EB3K7WPX5T28EJ2NVHE6EG","Chinese-tingfeng","01M7EB3K97E1KQ16QWKJMFNGX8",11,"Apache-2.0","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F06-前端与设计\u002Fdeep-research\u002Fsub-skills\u002Fbenchmark-evaluation\u002FSKILL.md",[],[],"2026-11-16 10:05:34",false,"---\nname: benchmark-evaluation\ndescription: \"Validate DeepResearch benchmark rollout files and choose official\n  evaluation routes before spending judge API credits.\"\ndisable-model-invocation: true\nmetadata:\n  disco-role: operating\nlicense: Apache 2.0\n---\n\n# Benchmark Evaluation\n\nUse this sub-skill when a future agent already has DeepResearch prediction rollout\nfiles and needs to decide whether they are ready for official LLM-as-judge\nevaluation. It is a guidance and preflight skill: it does not generate\npredictions and it does not call external judge APIs.\n\n## Route to this sub-skill when\n\n- The task mentions `evaluate_deepsearch_official.py`,\n  `evaluate_hle_official.py`, pass@k, HLE, GAIA, BrowseComp, WebWalker,\n  XBench DeepSearch, scored JSONL, or judge-model costs.\n- A rollout folder contains `iter1.jsonl`, `iter2.jsonl`, `iter3.jsonl`, or\n  split-suffixed files such as `iter2_split3of8.jsonl`.\n- The user wants to inspect malformed JSONL, missing predictions\u002Fmessages,\n  invalid `\u003Canswer>...\u003C\u002Fanswer>` tags, missing round files, or termination\n  frequencies before running official judging.\n\n## Do not use this sub-skill for\n\n- Creating DeepResearch predictions or running the ReAct agent; route to the\n  sibling `react-inference` sub-skill.\n- Choosing among WebAgent family projects or understanding their project-specific\n  evaluators; route to `webagent-family`, then return here for common rollout and\n  LLM-judge concepts.\n- Replacing the official judge scripts. The bundled validator is a safe schema\n  preflight only, not an implementation of official benchmark metrics.\n\n## Fast safe preflight\n\nFrom this sub-skill directory, validate an unsplit DeepResearch rollout folder:\n\n```bash\npython scripts\u002Fvalidate_prediction_rollouts.py \u003Crollout-folder> --dataset gaia\n```\n\nValidate distributed rollouts written by `run_multi_react.py --total_splits N`:\n\n```bash\npython scripts\u002Fvalidate_prediction_rollouts.py \u003Crollout-folder> --dataset webwalker --allow-splits\n```\n\nValidate an HLE single JSONL file before the HLE judge route:\n\n```bash\npython scripts\u002Fvalidate_prediction_rollouts.py \u003Chle-predictions.jsonl> --dataset hle\n```\n\nA passing validator result means the files satisfy local shape checks. It does\nnot mean the official LLM judge has run or that pass@k metrics are available.\n\n## Read next\n\n- `references\u002Fprediction-format.md` for rollout file names, fields, split\n  behavior, and validator interpretation.\n- `references\u002Fevaluation-workflows.md` for official DeepSearch and HLE evaluator\n  routes, judge-model selection, metrics, and output files.\n- `references\u002Ftroubleshooting.md` for missing rounds, malformed JSON, absent\n  fields, invalid answer tags, unsupported datasets, missing API variables, and\n  tokenizer caveats.\n","# Benchmark Evaluation\n\nUse this sub-skill when a future agent already has DeepResearch prediction rollout\nfiles and needs to decide whether they are ready for official LLM-as-judge\nevaluation. It is a guidance and preflight skill: it does not generate\npredictions and it does not call external judge APIs.\n\n## Route to this sub-skill when\n\n- The task mentions `evaluate_deepsearch_official.py`,\n  `evaluate_hle_official.py`, pass@k, HLE, GAIA, BrowseComp, WebWalker,\n  XBench DeepSearch, scored JSONL, or judge-model costs.\n- A rollout folder contains `iter1.jsonl`, `iter2.jsonl`, `iter3.jsonl`, or\n  split-suffixed files such as `iter2_split3of8.jsonl`.\n- The user wants to inspect malformed JSONL, missing predictions\u002Fmessages,\n  invalid `\u003Canswer>...\u003C\u002Fanswer>` tags, missing round files, or termination\n  frequencies before running official judging.\n\n## Do not use this sub-skill for\n\n- Creating DeepResearch predictions or running the ReAct agent; route to the\n  sibling `react-inference` sub-skill.\n- Choosing among WebAgent family projects or understanding their project-specific\n  evaluators; route to `webagent-family`, then return here for common rollout and\n  LLM-judge concepts.\n- Replacing the official judge scripts. The bundled validator is a safe schema\n  preflight only, not an implementation of official benchmark metrics.\n\n## Fast safe preflight\n\nFrom this sub-skill directory, validate an unsplit DeepResearch rollout folder:\n\n```bash\npython scripts\u002Fvalidate_prediction_rollouts.py \u003Crollout-folder> --dataset gaia\n```\n\nValidate distributed rollouts written by `run_multi_react.py --total_splits N`:\n\n```bash\npython scripts\u002Fvalidate_prediction_rollouts.py \u003Crollout-folder> --dataset webwalker --allow-splits\n```\n\nValidate an HLE single JSONL file before the HLE judge route:\n\n```bash\npython scripts\u002Fvalidate_prediction_rollouts.py \u003Chle-predictions.jsonl> --dataset hle\n```\n\nA passing validator result means the files satisfy local shape checks. It does\nnot mean the official LLM judge has run or that pass@k metrics are available.\n\n## Read next\n\n- `references\u002Fprediction-format.md` for rollout file names, fields, split\n  behavior, and validator interpretation.\n- `references\u002Fevaluation-workflows.md` for official DeepSearch and HLE evaluator\n  routes, judge-model selection, metrics, and output files.\n- `references\u002Ftroubleshooting.md` for missing rounds, malformed JSON, absent\n  fields, invalid answer tags, unsupported datasets, missing API variables, and\n  tokenizer caveats.\n",{"name":5,"license":24,"metadata":25,"description":7,"disable-model-invocation":27},"Apache 2.0",{"disco-role":26},"operating",true,"main","d69096e239f2a89aabc2cd078c47664a9d3b1e11","06-前端与设计\u002Fdeep-research\u002Fsub-skills\u002Fbenchmark-evaluation",3,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts","https:\u002F\u002Fgithub.com\u002Flza6","个人vx：Tf00798\r\n个人✈：@TFGY999","2026-10-08 14:29:22",{"source":8,"skillName":5,"commands":37,"prompt":47,"zipAvailable":27},[38,41,44],{"tool":39,"command":40},"npx","npx skills add lza6\u002FArmor-piercing-system-prompts --skill benchmark-evaluation",{"tool":42,"command":43},"bunx","bunx skills add lza6\u002FArmor-piercing-system-prompts --skill benchmark-evaluation",{"tool":45,"command":46},"pnpm","pnpm dlx skills add lza6\u002FArmor-piercing-system-prompts --skill benchmark-evaluation","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F06-前端与设计\u002Fdeep-research\u002Fsub-skills\u002Fbenchmark-evaluation\u002FSKILL.md",[49,55,59],{"path":50,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":53,"sourceHtmlUrl":54},"references\u002Fevaluation-workflows.md","REFERENCE","参考文档",7590,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F06-前端与设计\u002Fdeep-research\u002Fsub-skills\u002Fbenchmark-evaluation\u002Freferences\u002Fevaluation-workflows.md",{"path":56,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":57,"sourceHtmlUrl":58},"references\u002Fprediction-format.md",4594,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F06-前端与设计\u002Fdeep-research\u002Fsub-skills\u002Fbenchmark-evaluation\u002Freferences\u002Fprediction-format.md",{"path":60,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":61,"sourceHtmlUrl":62},"references\u002Ftroubleshooting.md",4934,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F06-前端与设计\u002Fdeep-research\u002Fsub-skills\u002Fbenchmark-evaluation\u002Freferences\u002Ftroubleshooting.md",[64,72,77,84,91,98],{"skillNo":65,"name":66,"nameZh":6,"description":67,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":69,"categories":70,"keywords":71,"publishedAt":19},"01M7FFG485KY83TD6HSC4YPCMC","obsidian-clipper-template-creator","Guide for creating templates for the Obsidian Web Clipper. Use when you want to create a new clipping template, understand available variables, or format clipped content.","MIT","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobsidian-clipper-template-creator\u002FSKILL.md",[],[],{"skillNo":73,"name":66,"nameZh":6,"description":67,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":74,"categories":75,"keywords":76,"publishedAt":19},"01M7FFG0T6AZ0STEJPSB3CX84K","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobsidian-clipper-template-creator-antigravity-awesome-skills-main\u002FSKILL.md",[],[],{"skillNo":78,"name":79,"nameZh":6,"description":80,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":81,"categories":82,"keywords":83,"publishedAt":19},"01M7FFFY0QEM14SKWPDYGMXM2P","python-api","Programmatic Object-Detection-Metrics API guidance for BoundingBox, BoundingBoxes, Evaluator, enums, coordinate conversion, AP\u002FmAP semantics, and source-style import diagnostics.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobject-detection-metrics\u002Fsub-skills\u002Fpython-api\u002FSKILL.md",[],[],{"skillNo":85,"name":86,"nameZh":6,"description":87,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":88,"categories":89,"keywords":90,"publishedAt":19},"01M7FFFVZQZ2GJ0C0TGP7JHD20","file-evaluation","Folder-based PASCAL VOC AP\u002FmAP evaluation from ground-truth and detection text files.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobject-detection-metrics\u002Fsub-skills\u002Ffile-evaluation\u002FSKILL.md",[],[],{"skillNo":92,"name":93,"nameZh":6,"description":94,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":95,"categories":96,"keywords":97,"publishedAt":19},"01M7FFFSFNYSE77SJ6PE1CK2DA","object-detection-metrics","Guides legacy Object-Detection-Metrics PASCAL VOC AP\u002FmAP evaluation from detection text folders and direct Python API classes.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobject-detection-metrics\u002FSKILL.md",[],[],{"skillNo":99,"name":100,"nameZh":6,"description":101,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":68,"licenseFileUrl":6,"sourceHtmlUrl":102,"categories":103,"keywords":104,"publishedAt":19},"01M7FFFP0GCK1RVXBCPQ8APBMT","nx-workspace-patterns","Configure and optimize Nx monorepo workspaces. Use when setting up Nx, configuring project boundaries, optimizing build caching, or implementing affected commands.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fnx-workspace-patterns\u002FSKILL.md",[],[]]