[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7A015RASQWMTH5CD9PJBWJG":3,"skill-same:01M7A015RASQWMTH5CD9PJBWJG":61},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":24,"commitSha":25,"skillDirectory":26,"forksCount":27,"repositoryHtmlUrl":28,"repositoryHomepageUrl":29,"ownerHtmlUrl":30,"ownerBlogUrl":6,"ownerDescription":31,"updatedAt":32,"install":33,"resources":46},"01M7A015RASQWMTH5CD9PJBWJG","ageval-sdk-harness",null,"Write dataset run.py with ageval_sdk (RunContext, Agent\u002FAgentSession, ToolSet, RunTerminal, publish). Use for task run.py, sessions, tool guards, optional evaluator.py LLM-as-judge. Triggers: AgentSession, RunTerminal, ScriptError, ctx.publish_json, write run.py, evaluator.py. SDK never decides PASS or holds host credentials.","ZJU-REAL\u002Fageval","ZJU-REAL","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F203928864?v=4","01M7A005CH0Y4HRGXVRH1G511A","REAL Lab","01M7A005D4AE6Y2WT2ZJQDVKVM",81,"MIT","https:\u002F\u002Fgithub.com\u002FZJU-REAL\u002Fageval\u002Fblob\u002Fmain\u002Fskills\u002Fageval-sdk-harness\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: ageval-sdk-harness\ndescription: >\n  Write dataset run.py with ageval_sdk (RunContext, Agent\u002FAgentSession, ToolSet,\n  RunTerminal, publish). Use for task run.py, sessions, tool guards, optional\n  evaluator.py LLM-as-judge. Triggers: AgentSession, RunTerminal, ScriptError,\n  ctx.publish_json, write run.py, evaluator.py. SDK never decides PASS or holds\n  host credentials.\n---\n\n# SDK \u002F run.py\n\n```python\nfrom ageval_sdk import RunContext, RunTerminal\n\n\nasync def run(ctx: RunContext) -> RunTerminal:\n    async with ctx.agent.session(\"solver\", max_turns=1) as session:\n        reply = await session.invoke(ctx.params[\"instruction\"])\n    ctx.publish_json(\"reply\", {\"ok\": bool(reply.get(\"ok\")), \"text\": reply.get(\"text\") or \"\"})\n    if not reply.get(\"ok\"):\n        return RunTerminal.failed(str(reply.get(\"error\") or \"invoke_failed\"))\n    return RunTerminal.completed(\"ok\")\n```\n\nDefault `evaluator.py` is a script: read artifacts + gold, return `{status, score, metrics}`. Optional extra key `checks` (use `evaluation_check(...)`) — parent writes `evaluation\u002Fchecks.json`; bind ignores it. Optional LLM-as-judge: after gold is uploaded, `Agent.session(\u003Crole>).invoke` on a role declared in the same `profiles.yaml`. Parent injects `inputs[\"agent\"]` when the socket is projected (`environment: local`). Still return `{status, score, metrics}`. `invoke` kwargs must not override `profile_id` \u002F executor.\n\n| May | Must not |\n| --- | --- |\n| Open sessions, tools, publish | Decide PASS |\n| Use `ctx.params` | Re-read lock or secrets |\n| Return completed\u002Ffailed | Override Core `limits` |\n| Raise `ScriptError` when the script cannot continue | Use `ScriptError` for an Agent that fell short |\n\nThe Agent fell short: return `RunTerminal.failed` from `run.py`, or `{\"status\": \"FAIL\", ...}` from `evaluator.py`. The script, the dataset, or scoring itself cannot continue:\n\n```python\nfrom ageval_sdk import ScriptError\n\nraise ScriptError(title=\"Judge response empty\", message=\"judge returned no text\")\n```\n\n`title` is the same label on every occurrence. Variable detail goes in `message`. The same class is raised from either script. The phase is whichever worker caught it.\n| Evaluator `Agent.session` after gold | Bind PASS from judge prose \u002F observation.jsonl |\n\nAPI: [references\u002Fapi.md](references\u002Fapi.md). Antipatterns: [references\u002Fantipatterns.md](references\u002Fantipatterns.md).\n","# SDK \u002F run.py\n\n```python\nfrom ageval_sdk import RunContext, RunTerminal\n\n\nasync def run(ctx: RunContext) -> RunTerminal:\n    async with ctx.agent.session(\"solver\", max_turns=1) as session:\n        reply = await session.invoke(ctx.params[\"instruction\"])\n    ctx.publish_json(\"reply\", {\"ok\": bool(reply.get(\"ok\")), \"text\": reply.get(\"text\") or \"\"})\n    if not reply.get(\"ok\"):\n        return RunTerminal.failed(str(reply.get(\"error\") or \"invoke_failed\"))\n    return RunTerminal.completed(\"ok\")\n```\n\nDefault `evaluator.py` is a script: read artifacts + gold, return `{status, score, metrics}`. Optional extra key `checks` (use `evaluation_check(...)`) — parent writes `evaluation\u002Fchecks.json`; bind ignores it. Optional LLM-as-judge: after gold is uploaded, `Agent.session(\u003Crole>).invoke` on a role declared in the same `profiles.yaml`. Parent injects `inputs[\"agent\"]` when the socket is projected (`environment: local`). Still return `{status, score, metrics}`. `invoke` kwargs must not override `profile_id` \u002F executor.\n\n| May | Must not |\n| --- | --- |\n| Open sessions, tools, publish | Decide PASS |\n| Use `ctx.params` | Re-read lock or secrets |\n| Return completed\u002Ffailed | Override Core `limits` |\n| Raise `ScriptError` when the script cannot continue | Use `ScriptError` for an Agent that fell short |\n\nThe Agent fell short: return `RunTerminal.failed` from `run.py`, or `{\"status\": \"FAIL\", ...}` from `evaluator.py`. The script, the dataset, or scoring itself cannot continue:\n\n```python\nfrom ageval_sdk import ScriptError\n\nraise ScriptError(title=\"Judge response empty\", message=\"judge returned no text\")\n```\n\n`title` is the same label on every occurrence. Variable detail goes in `message`. The same class is raised from either script. The phase is whichever worker caught it.\n| Evaluator `Agent.session` after gold | Bind PASS from judge prose \u002F observation.jsonl |\n\nAPI: [references\u002Fapi.md](references\u002Fapi.md). Antipatterns: [references\u002Fantipatterns.md](references\u002Fantipatterns.md).\n",{"name":5,"description":7},"main","ccda2a7af15ac19fde705e20d3b267c645330d4a","skills\u002Fageval-sdk-harness",3,"https:\u002F\u002Fgithub.com\u002FZJU-REAL\u002Fageval","https:\u002F\u002Fzju-real.github.io\u002Fageval\u002F","https:\u002F\u002Fgithub.com\u002FZJU-REAL","REAL Lab is a research team at Zhejiang University focusing on Reasoning, Embodied, Agentic and Lifelong Evolving AI.","2026-11-14 01:27:17",{"source":8,"skillName":5,"commands":34,"prompt":44,"zipAvailable":45},[35,38,41],{"tool":36,"command":37},"npx","npx skills add ZJU-REAL\u002Fageval --skill ageval-sdk-harness",{"tool":39,"command":40},"bunx","bunx skills add ZJU-REAL\u002Fageval --skill ageval-sdk-harness",{"tool":42,"command":43},"pnpm","pnpm dlx skills add ZJU-REAL\u002Fageval --skill ageval-sdk-harness","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FZJU-REAL\u002Fageval\u002Fblob\u002Fmain\u002Fskills\u002Fageval-sdk-harness\u002FSKILL.md",true,[47,53,57],{"path":48,"resourceType":49,"resourceTypeDesc":50,"sizeBytes":51,"sourceHtmlUrl":52},"agents\u002Fopenai.yaml","REFERENCE","参考文档",243,"https:\u002F\u002Fgithub.com\u002FZJU-REAL\u002Fageval\u002Fblob\u002Fmain\u002Fskills\u002Fageval-sdk-harness\u002Fagents\u002Fopenai.yaml",{"path":54,"resourceType":49,"resourceTypeDesc":50,"sizeBytes":55,"sourceHtmlUrl":56},"references\u002Fantipatterns.md",937,"https:\u002F\u002Fgithub.com\u002FZJU-REAL\u002Fageval\u002Fblob\u002Fmain\u002Fskills\u002Fageval-sdk-harness\u002Freferences\u002Fantipatterns.md",{"path":58,"resourceType":49,"resourceTypeDesc":50,"sizeBytes":59,"sourceHtmlUrl":60},"references\u002Fapi.md",3202,"https:\u002F\u002Fgithub.com\u002FZJU-REAL\u002Fageval\u002Fblob\u002Fmain\u002Fskills\u002Fageval-sdk-harness\u002Freferences\u002Fapi.md",[62,68,75,82,89,96],{"skillNo":63,"name":64,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":65,"categories":66,"keywords":67,"publishedAt":19},"01M7A01JBSS6ZMX56G1MN8WQNY","echo","https:\u002F\u002Fgithub.com\u002FZJU-REAL\u002Fageval\u002Fblob\u002Fmain\u002Ftests\u002Ffixtures\u002Fplugins\u002Fsample-echo\u002Fskills\u002Fecho\u002FSKILL.md",[],[],{"skillNo":69,"name":70,"nameZh":6,"description":71,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":72,"categories":73,"keywords":74,"publishedAt":19},"01M7A01DZ4Y8Q2PAJ2RR905BWB","verify-ageval","Verify ageval by driving the public CLI: doctor, a lock that rejects a bad profile, and one minimal-demo task on local plus openai-http against the in-repo loopback gateway. Use when checking lock\u002Frun, seal invariants, or whether a credential skip was reported honestly. Triggers: verify ageval, loopback gateway, AGEVAL_SKIP_REAL_ACP, not run.","https:\u002F\u002Fgithub.com\u002FZJU-REAL\u002Fageval\u002Fblob\u002Fmain\u002Fskills\u002Fverify-ageval\u002FSKILL.md",[],[],{"skillNo":76,"name":77,"nameZh":6,"description":78,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":79,"categories":80,"keywords":81,"publishedAt":19},"01M7A019X1VBJF3VZZZW1BTWJP","eval-ops-pitfalls","Pre-run environment checks and suite troubleshooting: dead proxies, invocation timeouts, package mirrors, model routing, environment_image_unresolved, widespread failures, evaluator dependencies, permissions, and CLI\u002Fschema mismatches. Use when preparing an evaluation run or diagnosing acp_timeout, HTTP_PROXY, AGEVAL_AGENT_INVOKE_TIMEOUT, AGEVAL_APT_MIRROR, PEP668, or test collection failures.","https:\u002F\u002Fgithub.com\u002FZJU-REAL\u002Fageval\u002Fblob\u002Fmain\u002Fskills\u002Feval-ops-pitfalls\u002FSKILL.md",[],[],{"skillNo":83,"name":84,"nameZh":6,"description":85,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":86,"categories":87,"keywords":88,"publishedAt":19},"01M7A011QP8CFNTWBB1MZEH9XB","ageval-plugin","Author ageval.plugin\u002F1: exclusive and chain slots, registry resolve, environment or executor implementations, image_layers bake. Use for plugin.yaml, attach_stdio hosts, trajectory_collect, README capability and parameter tables. Not an app store. Never invent slots.","https:\u002F\u002Fgithub.com\u002FZJU-REAL\u002Fageval\u002Fblob\u002Fmain\u002Fskills\u002Fageval-plugin\u002FSKILL.md",[],[],{"skillNo":90,"name":91,"nameZh":6,"description":92,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":93,"categories":94,"keywords":95,"publishedAt":19},"01M7A00XTZPNJ16EDPNFQJCA7D","ageval-platform","ageval platform map: authority (docs\u002Fdesign vs ARCHITECTURE vs Issues), Core vs dataset ownership, red lines (no secrets, mechanism-named adapters), evidence grades, which sibling skill to load. Use when entering the repo, asking \"what is ageval\", \"who owns PASS\", \"read order\", or \"evidence grade\". Not a substitute for docs\u002Fdesign.","https:\u002F\u002Fgithub.com\u002FZJU-REAL\u002Fageval\u002Fblob\u002Fmain\u002Fskills\u002Fageval-platform\u002FSKILL.md",[],[],{"skillNo":97,"name":98,"nameZh":6,"description":99,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":100,"categories":101,"keywords":102,"publishedAt":19},"01M7A00PK0CJM0J42JNV6HHPBK","ageval-design-system","ageval web UI style rules for coding agents editing website (landing + docs), apps\u002Fhub, or apps\u002Fviewer: canonical color tokens (cool paper\u002Fink + IKB #1B54E8\u002F#5B7BFF), font stacks (Geist\u002FAnton wordmark-only), radius, role-based focus (scan chrome keeps hairline; edit fields use IKB border), reuse of shipped components, the ten invariants, and the machine check scripts\u002Fcheck_design_tokens.py. Use when adding or restyling UI in any of the three web surfaces, picking colors or fonts, adding icons, or when a change touches raw hex, focus rings, buttons, search fields, or the owl brand assets. Authority is docs\u002Fdesign\u002F09-web-ui-design-system.md; apps\u002Fshared\u002FDESIGN.md YAML is the SPA token listing (Hub\u002FViewer inherit it); SPA DESIGN.md Taste is anti-slop (product chrome, not landing) plus the reuse map. This skill only routes and summarizes — it is not a page inventory.","https:\u002F\u002Fgithub.com\u002FZJU-REAL\u002Fageval\u002Fblob\u002Fmain\u002Fskills\u002Fageval-design-system\u002FSKILL.md",[],[]]