[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7A9RESMVRC8PBXC1D54237C":3,"skill-same:01M7A9RESMVRC8PBXC1D54237C":112},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":48,"commitSha":49,"skillDirectory":50,"forksCount":51,"repositoryHtmlUrl":52,"repositoryHomepageUrl":53,"ownerHtmlUrl":54,"ownerBlogUrl":55,"ownerDescription":56,"updatedAt":57,"install":58,"resources":71},"01M7A9RESMVRC8PBXC1D54237C","rag-eval",null,"Filesystem RAG benchmarks: corpus\u002F, train.json, evaluate_rag.py (RAGAS quality). Not for prod monitoring, latency\u002Fthroughput benchmarking (use rag-perf), or evals outside this repo layout.","themusebook\u002Fskills","themusebook","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F349927247?v=4","01M7A5C1RV5S3V5FF6ZACVDNRN","musebook","01M7A5C1SFC3KRZAXNN60XJ7KM",0,"Apache-2.0","https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Frag-eval\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: rag-eval\nversion: \"2.6.0\"\ndescription: >-\n  Filesystem RAG benchmarks: corpus\u002F, train.json, evaluate_rag.py (RAGAS quality). Not for prod\n  monitoring, latency\u002Fthroughput benchmarking (use rag-perf), or evals outside this repo layout.\nlicense: Apache-2.0\ncompatibility: Repository checkout with uv; Python 3.11+; run from repo root; uv sync --project scripts\u002Feval (eval deps live in scripts\u002Feval\u002Fpyproject.toml); network to RAG, ingestor, and vdb endpoints; NVIDIA_API_KEY for RAGAS; optional RAG_EVAL_JUDGE_MODEL (default mistralai\u002Fmixtral-8x22b-instruct-v0.1).\nmetadata:\n  author: NVIDIA RAG \u003Cfoundational-rag-dev@exchange.nvidia.com>\n  github-url: \"https:\u002F\u002Fgithub.com\u002FNVIDIA-AI-Blueprints\u002Frag\"\n  endpoint-openapi-schemas:\n    - docs\u002Fapi_reference\u002Fopenapi_schema_rag_server.json\n    - docs\u002Fapi_reference\u002Fopenapi_schema_ingestor_server.json\n  argument-hint: RAGAS eval | evaluate_rag | train.json | corpus | results json | error triage | uv run --project scripts\u002Feval | enable_reranker | query_rewriting | temperature | skip_ingestion\n  tags:\n    - nvidia\n    - blueprint\n    - rag\n    - evaluation\n    - ragas\n    - benchmarking\n    - nvidia-rag-blueprint\n  languages:\n    - python\n    - shell\n  frameworks:\n    - ragas\n    - fastapi\n  domain: ai-ml\nallowed-tools: Read Grep Glob Bash(ls *) Bash(python3 *) Bash(uv *) Write Edit\n---\n\n# On-disk RAG evaluation (`corpus\u002F` + `train.json`)\n\n## Purpose\n\nGuide agents through NVIDIA RAG Blueprint **filesystem** benchmarks: preparing `corpus\u002F` and `train.json`, running `scripts\u002Feval\u002Fevaluate_rag.py`, tuning retrieval and generation flags for **quality** comparisons, interpreting RAGAS JSON outputs, and triaging failures (HTTP\u002Fstream errors, empty contexts, collection mismatch, judge API).\n\nFor **latency, throughput, and load testing**, use the **rag-perf** skill (`scripts\u002Frag-perf`, `docs\u002Fperformance-benchmarking.md`) — not this skill.\n\n## When not to use\n\nDo **not** use this skill for: deploying or repairing services (use rag-blueprint); evaluating APIs without the `corpus\u002F` + `train.json` layout; general ML experimentation unrelated to this evaluator; production monitoring\u002Falerting; or latency\u002Fthroughput benchmarking (use **rag-perf**).\n\n## Prerequisites\n\n- Repo cloned; **run commands from repo root** (imports and paths assume this).\n- Python **3.11+** and **uv**; eval deps: `uv sync --project scripts\u002Feval`.\n- Reachable **RAG server** and **ingestor** (defaults often `localhost:8081` \u002F `8082`).\n- **`NVIDIA_API_KEY`** for RAGAS (see [credential hygiene](references\u002Fbenchmark-execution.md#credential-hygiene-nvidia_api_key)); optional **`RAG_EVAL_JUDGE_MODEL`**.\n- Dataset roots passed to `--dataset-paths` each contain **`corpus\u002F`** and **`train.json`**.\n\n## Instructions\n\n1. **Prepare data** — Ensure each dataset directory matches the layout and `train.json` rules in [`references\u002Fdataset-and-conversion.md`](references\u002Fdataset-and-conversion.md). When sources arrive as public links (sites or dataset pages), materialize documents under `corpus\u002F`—prefer **PDF** for multimodal content so **images stay embedded**; convert CSV\u002FJSONL\u002Fetc. using the patterns there.\n2. **Run eval** — `uv run --project scripts\u002Feval python scripts\u002Feval\u002Fevaluate_rag.py` with `--dataset-paths`, `--host`, and `--port`. See [`references\u002Fbenchmark-execution.md`](references\u002Fbenchmark-execution.md) for command examples, outputs, and errors. Use [`references\u002Fevaluate-rag-cli.md`](references\u002Fevaluate-rag-cli.md) for flag-level detail.\n3. **Tune quality** — Adjust `--top_k` \u002F `--vdb_top_k`, reranker and query-rewriting toggles, and generation overrides (`--temperature`, `--top-p`, `--max-tokens`) as documented in [`references\u002Fbenchmark-execution.md`](references\u002Fbenchmark-execution.md) when comparing retrieval\u002Fgeneration configs for RAGAS scores.\n4. **Analyze results** — Use [`references\u002Fresult-analysis.md`](references\u002Fresult-analysis.md) for scripts; scan `rag_*_evaluation_summary.json` for headline RAGAS metrics.\n5. **Triage errors** — Use the [error signal table](references\u002Fbenchmark-execution.md#common-error-cases-and-signals) and the **Troubleshooting** section below.\n\n## Examples\n\n**Set API key without putting secrets in shell history (preferred patterns):** load from a gitignored env file or secrets manager; avoid committing `.env`; rotate keys if exposed. Details: [`references\u002Fbenchmark-execution.md#credential-hygiene-nvidia_api_key`](references\u002Fbenchmark-execution.md#credential-hygiene-nvidia_api_key).\n\n**Minimal eval (key already in environment):**\n\n```bash\nuv sync --project scripts\u002Feval\nuv run --project scripts\u002Feval python scripts\u002Feval\u002Fevaluate_rag.py \\\n  --dataset-paths \u002Fpath\u002Fto\u002Fmy_dataset \\\n  --host localhost \\\n  --port 8081\n```\n\n**Pretty-print summary JSON:**\n\n```bash\npython3 -m json.tool results\u002Fmy_dataset\u002Frag_my_dataset_evaluation_summary.json\n```\n\nMore examples (skip ingestion, quality sweeps): [`references\u002Fbenchmark-execution.md`](references\u002Fbenchmark-execution.md).\n\n## Limitations\n\n- Evaluator behavior is fixed to the **filesystem contract** and `evaluate_rag.py`; it does not substitute for custom offline judges or non-RAG benchmarks.\n- **Vector DB \u002F embedding** choices follow deployed ingestor and RAG env — not overridden by this CLI alone.\n- **Scores depend on** retrieval quality, judge model availability, and `NVIDIA_API_KEY`; empty contexts yield partial RAGAS metrics (see references).\n- Large procedural detail lives under **`references\u002F`** to keep routing concise; read those files when the user needs step-by-step conversion, full flags, or error tables.\n\n## Troubleshooting\n\n| Error \u002F signal | Likely cause | What to do |\n|----------------|--------------|------------|\n| Immediate exit mentioning `NVIDIA_API_KEY` | Missing or invalid key | Set key via secure channel; see credential hygiene in [`references\u002Fbenchmark-execution.md`](references\u002Fbenchmark-execution.md). |\n| `train.json must be a JSON array` | Wrong JSON shape | Top-level array of objects; validate per [`references\u002Fdataset-and-conversion.md`](references\u002Fdataset-and-conversion.md). |\n| Fewer rows in `evaluation_data.json` than `train.json` | Per-query failures | Check stderr: network or stream JSON errors; see error table in benchmark-execution. |\n| Empty `generated_contexts` everywhere | Retrieval gap | Verify collection, ingestion, `top_k` \u002F `vdb_top_k`, and `ingestor_server_url` **without** `\u002Fv1` suffix. |\n| Ingestor 404 on upload | Bad ingestor base URL | Pass `http:\u002F\u002Fhost:port` only — code appends `\u002Fv1\u002F`. |\n\nFull signal table: [`references\u002Fbenchmark-execution.md#common-error-cases-and-signals`](references\u002Fbenchmark-execution.md#common-error-cases-and-signals).\n\n## Gotchas\n\n- **Run from repo root**: paths and imports in `scripts\u002Feval\u002Fevaluate_rag.py` assume this; a wrong directory silently breaks imports.\n- **`--ingestor_server_url`**: pass `http:\u002F\u002Fhost:port` without `\u002Fv1`—the code appends `\u002Fv1\u002F` automatically. Including `\u002Fv1` causes 404s on ingestor calls.\n- **Vector DB \u002F embedding settings**: not set by this CLI; configure via the deployed ingestor and RAG server env vars (e.g. `APP_VECTORSTORE_URL`, embedding model).\n- **`--model` \u002F `--llm_endpoint`**: forwarded verbatim only when explicitly set; omit to keep the server's configured LLM.\n- **Stale collections**: a previous run's ingested data persists unless you use `--force_ingestion`. Use `--collection` with a unique name when comparing quality across isolated runs.\n- **Empty context metrics**: if all `generated_contexts` are empty, RAGAS scores only `nv_accuracy` and leaves the other two metrics blank—this is not a silent success.\n\n## Source of truth\n\n| Piece | Location |\n|-------|----------|\n| Driver | `scripts\u002Feval\u002Fevaluate_rag.py` (`CORPUS_DIRECTORY` = `corpus`, `EVAL_DATA` = `train.json`) |\n| Human README (always in-repo) | `scripts\u002Feval\u002FREADME.md` |\n| Full CLI (flags, defaults) | `scripts\u002Feval\u002Fevaluate_rag.py --help`; [`references\u002Fevaluate-rag-cli.md`](references\u002Fevaluate-rag-cli.md) |\n| Dataset \u002F conversion | [`references\u002Fdataset-and-conversion.md`](references\u002Fdataset-and-conversion.md) |\n| Runs, outputs, errors | [`references\u002Fbenchmark-execution.md`](references\u002Fbenchmark-execution.md) |\n| Result analysis scripts | [`references\u002Fresult-analysis.md`](references\u002Fresult-analysis.md) |\n| Latency \u002F throughput | **rag-perf** skill, `docs\u002Fperformance-benchmarking.md` |\n\n## Agent playbook\n\n1. **Run eval** — `uv sync --project scripts\u002Feval` then `uv run --project scripts\u002Feval python scripts\u002Feval\u002Fevaluate_rag.py` with required `--dataset-paths`, `--host`, and `--port` (and env `NVIDIA_API_KEY`). Argument `--ingestor_server_url` is optional (defaults to `http:\u002F\u002Flocalhost:8082`); pass it only when overriding the ingestor endpoint.\n2. **Quality tuning** — See [`references\u002Fbenchmark-execution.md`](references\u002Fbenchmark-execution.md): `--top_k`\u002F`--vdb_top_k`, reranker and query-rewriting toggles, `--temperature`, `--top-p`, `--max-tokens`.\n3. **Data conversion** — Follow [`references\u002Fdataset-and-conversion.md`](references\u002Fdataset-and-conversion.md).\n4. **Analyze results** — [`references\u002Fresult-analysis.md`](references\u002Fresult-analysis.md); quick scan: `python3 -m json.tool results\u002F\u003Cdataset>\u002Frag_\u003Cdataset>_evaluation_summary.json`.\n5. **Error triage** — [`references\u002Fbenchmark-execution.md#common-error-cases-and-signals`](references\u002Fbenchmark-execution.md#common-error-cases-and-signals).\n","# On-disk RAG evaluation (`corpus\u002F` + `train.json`)\n\n## Purpose\n\nGuide agents through NVIDIA RAG Blueprint **filesystem** benchmarks: preparing `corpus\u002F` and `train.json`, running `scripts\u002Feval\u002Fevaluate_rag.py`, tuning retrieval and generation flags for **quality** comparisons, interpreting RAGAS JSON outputs, and triaging failures (HTTP\u002Fstream errors, empty contexts, collection mismatch, judge API).\n\nFor **latency, throughput, and load testing**, use the **rag-perf** skill (`scripts\u002Frag-perf`, `docs\u002Fperformance-benchmarking.md`) — not this skill.\n\n## When not to use\n\nDo **not** use this skill for: deploying or repairing services (use rag-blueprint); evaluating APIs without the `corpus\u002F` + `train.json` layout; general ML experimentation unrelated to this evaluator; production monitoring\u002Falerting; or latency\u002Fthroughput benchmarking (use **rag-perf**).\n\n## Prerequisites\n\n- Repo cloned; **run commands from repo root** (imports and paths assume this).\n- Python **3.11+** and **uv**; eval deps: `uv sync --project scripts\u002Feval`.\n- Reachable **RAG server** and **ingestor** (defaults often `localhost:8081` \u002F `8082`).\n- **`NVIDIA_API_KEY`** for RAGAS (see [credential hygiene](references\u002Fbenchmark-execution.md#credential-hygiene-nvidia_api_key)); optional **`RAG_EVAL_JUDGE_MODEL`**.\n- Dataset roots passed to `--dataset-paths` each contain **`corpus\u002F`** and **`train.json`**.\n\n## Instructions\n\n1. **Prepare data** — Ensure each dataset directory matches the layout and `train.json` rules in [`references\u002Fdataset-and-conversion.md`](references\u002Fdataset-and-conversion.md). When sources arrive as public links (sites or dataset pages), materialize documents under `corpus\u002F`—prefer **PDF** for multimodal content so **images stay embedded**; convert CSV\u002FJSONL\u002Fetc. using the patterns there.\n2. **Run eval** — `uv run --project scripts\u002Feval python scripts\u002Feval\u002Fevaluate_rag.py` with `--dataset-paths`, `--host`, and `--port`. See [`references\u002Fbenchmark-execution.md`](references\u002Fbenchmark-execution.md) for command examples, outputs, and errors. Use [`references\u002Fevaluate-rag-cli.md`](references\u002Fevaluate-rag-cli.md) for flag-level detail.\n3. **Tune quality** — Adjust `--top_k` \u002F `--vdb_top_k`, reranker and query-rewriting toggles, and generation overrides (`--temperature`, `--top-p`, `--max-tokens`) as documented in [`references\u002Fbenchmark-execution.md`](references\u002Fbenchmark-execution.md) when comparing retrieval\u002Fgeneration configs for RAGAS scores.\n4. **Analyze results** — Use [`references\u002Fresult-analysis.md`](references\u002Fresult-analysis.md) for scripts; scan `rag_*_evaluation_summary.json` for headline RAGAS metrics.\n5. **Triage errors** — Use the [error signal table](references\u002Fbenchmark-execution.md#common-error-cases-and-signals) and the **Troubleshooting** section below.\n\n## Examples\n\n**Set API key without putting secrets in shell history (preferred patterns):** load from a gitignored env file or secrets manager; avoid committing `.env`; rotate keys if exposed. Details: [`references\u002Fbenchmark-execution.md#credential-hygiene-nvidia_api_key`](references\u002Fbenchmark-execution.md#credential-hygiene-nvidia_api_key).\n\n**Minimal eval (key already in environment):**\n\n```bash\nuv sync --project scripts\u002Feval\nuv run --project scripts\u002Feval python scripts\u002Feval\u002Fevaluate_rag.py \\\n  --dataset-paths \u002Fpath\u002Fto\u002Fmy_dataset \\\n  --host localhost \\\n  --port 8081\n```\n\n**Pretty-print summary JSON:**\n\n```bash\npython3 -m json.tool results\u002Fmy_dataset\u002Frag_my_dataset_evaluation_summary.json\n```\n\nMore examples (skip ingestion, quality sweeps): [`references\u002Fbenchmark-execution.md`](references\u002Fbenchmark-execution.md).\n\n## Limitations\n\n- Evaluator behavior is fixed to the **filesystem contract** and `evaluate_rag.py`; it does not substitute for custom offline judges or non-RAG benchmarks.\n- **Vector DB \u002F embedding** choices follow deployed ingestor and RAG env — not overridden by this CLI alone.\n- **Scores depend on** retrieval quality, judge model availability, and `NVIDIA_API_KEY`; empty contexts yield partial RAGAS metrics (see references).\n- Large procedural detail lives under **`references\u002F`** to keep routing concise; read those files when the user needs step-by-step conversion, full flags, or error tables.\n\n## Troubleshooting\n\n| Error \u002F signal | Likely cause | What to do |\n|----------------|--------------|------------|\n| Immediate exit mentioning `NVIDIA_API_KEY` | Missing or invalid key | Set key via secure channel; see credential hygiene in [`references\u002Fbenchmark-execution.md`](references\u002Fbenchmark-execution.md). |\n| `train.json must be a JSON array` | Wrong JSON shape | Top-level array of objects; validate per [`references\u002Fdataset-and-conversion.md`](references\u002Fdataset-and-conversion.md). |\n| Fewer rows in `evaluation_data.json` than `train.json` | Per-query failures | Check stderr: network or stream JSON errors; see error table in benchmark-execution. |\n| Empty `generated_contexts` everywhere | Retrieval gap | Verify collection, ingestion, `top_k` \u002F `vdb_top_k`, and `ingestor_server_url` **without** `\u002Fv1` suffix. |\n| Ingestor 404 on upload | Bad ingestor base URL | Pass `http:\u002F\u002Fhost:port` only — code appends `\u002Fv1\u002F`. |\n\nFull signal table: [`references\u002Fbenchmark-execution.md#common-error-cases-and-signals`](references\u002Fbenchmark-execution.md#common-error-cases-and-signals).\n\n## Gotchas\n\n- **Run from repo root**: paths and imports in `scripts\u002Feval\u002Fevaluate_rag.py` assume this; a wrong directory silently breaks imports.\n- **`--ingestor_server_url`**: pass `http:\u002F\u002Fhost:port` without `\u002Fv1`—the code appends `\u002Fv1\u002F` automatically. Including `\u002Fv1` causes 404s on ingestor calls.\n- **Vector DB \u002F embedding settings**: not set by this CLI; configure via the deployed ingestor and RAG server env vars (e.g. `APP_VECTORSTORE_URL`, embedding model).\n- **`--model` \u002F `--llm_endpoint`**: forwarded verbatim only when explicitly set; omit to keep the server's configured LLM.\n- **Stale collections**: a previous run's ingested data persists unless you use `--force_ingestion`. Use `--collection` with a unique name when comparing quality across isolated runs.\n- **Empty context metrics**: if all `generated_contexts` are empty, RAGAS scores only `nv_accuracy` and leaves the other two metrics blank—this is not a silent success.\n\n## Source of truth\n\n| Piece | Location |\n|-------|----------|\n| Driver | `scripts\u002Feval\u002Fevaluate_rag.py` (`CORPUS_DIRECTORY` = `corpus`, `EVAL_DATA` = `train.json`) |\n| Human README (always in-repo) | `scripts\u002Feval\u002FREADME.md` |\n| Full CLI (flags, defaults) | `scripts\u002Feval\u002Fevaluate_rag.py --help`; [`references\u002Fevaluate-rag-cli.md`](references\u002Fevaluate-rag-cli.md) |\n| Dataset \u002F conversion | [`references\u002Fdataset-and-conversion.md`](references\u002Fdataset-and-conversion.md) |\n| Runs, outputs, errors | [`references\u002Fbenchmark-execution.md`](references\u002Fbenchmark-execution.md) |\n| Result analysis scripts | [`references\u002Fresult-analysis.md`](references\u002Fresult-analysis.md) |\n| Latency \u002F throughput | **rag-perf** skill, `docs\u002Fperformance-benchmarking.md` |\n\n## Agent playbook\n\n1. **Run eval** — `uv sync --project scripts\u002Feval` then `uv run --project scripts\u002Feval python scripts\u002Feval\u002Fevaluate_rag.py` with required `--dataset-paths`, `--host`, and `--port` (and env `NVIDIA_API_KEY`). Argument `--ingestor_server_url` is optional (defaults to `http:\u002F\u002Flocalhost:8082`); pass it only when overriding the ingestor endpoint.\n2. **Quality tuning** — See [`references\u002Fbenchmark-execution.md`](references\u002Fbenchmark-execution.md): `--top_k`\u002F`--vdb_top_k`, reranker and query-rewriting toggles, `--temperature`, `--top-p`, `--max-tokens`.\n3. **Data conversion** — Follow [`references\u002Fdataset-and-conversion.md`](references\u002Fdataset-and-conversion.md).\n4. **Analyze results** — [`references\u002Fresult-analysis.md`](references\u002Fresult-analysis.md); quick scan: `python3 -m json.tool results\u002F\u003Cdataset>\u002Frag_\u003Cdataset>_evaluation_summary.json`.\n5. **Error triage** — [`references\u002Fbenchmark-execution.md#common-error-cases-and-signals`](references\u002Fbenchmark-execution.md#common-error-cases-and-signals).\n",{"name":5,"license":15,"version":24,"metadata":25,"description":7,"allowed-tools":46,"compatibility":47},"2.6.0",{"tags":26,"author":34,"domain":35,"languages":36,"frameworks":39,"github-url":41,"argument-hint":42,"endpoint-openapi-schemas":43},[27,28,29,30,31,32,33],"nvidia","blueprint","rag","evaluation","ragas","benchmarking","nvidia-rag-blueprint","NVIDIA RAG \u003Cfoundational-rag-dev@exchange.nvidia.com>","ai-ml",[37,38],"python","shell",[31,40],"fastapi","https:\u002F\u002Fgithub.com\u002FNVIDIA-AI-Blueprints\u002Frag","RAGAS eval | evaluate_rag | train.json | corpus | results json | error triage | uv run --project scripts\u002Feval | enable_reranker | query_rewriting | temperature | skip_ingestion",[44,45],"docs\u002Fapi_reference\u002Fopenapi_schema_rag_server.json","docs\u002Fapi_reference\u002Fopenapi_schema_ingestor_server.json","Read Grep Glob Bash(ls *) Bash(python3 *) Bash(uv *) Write Edit","Repository checkout with uv; Python 3.11+; run from repo root; uv sync --project scripts\u002Feval (eval deps live in scripts\u002Feval\u002Fpyproject.toml); network to RAG, ingestor, and vdb endpoints; NVIDIA_API_KEY for RAGAS; optional RAG_EVAL_JUDGE_MODEL (default mistralai\u002Fmixtral-8x22b-instruct-v0.1).","main","1c523aba5cdf867a79f078847075492d7778092a","skills\u002Fnvidia\u002Frag-eval",1,"https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills","https:\u002F\u002Fskills.x402.wtf","https:\u002F\u002Fgithub.com\u002Fthemusebook","https:\u002F\u002Fmusebook.trade","The official Github of musebook","2026-11-02 23:42:26",{"source":8,"skillName":5,"commands":59,"prompt":69,"zipAvailable":70},[60,63,66],{"tool":61,"command":62},"npx","npx skills add themusebook\u002Fskills --skill rag-eval",{"tool":64,"command":65},"bunx","bunx skills add themusebook\u002Fskills --skill rag-eval",{"tool":67,"command":68},"pnpm","pnpm dlx skills add themusebook\u002Fskills --skill rag-eval","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Frag-eval\u002FSKILL.md",true,[72,78,82,86,90,94,98,102,106],{"path":73,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":76,"sourceHtmlUrl":77},"BENCHMARK.md","REFERENCE","参考文档",2915,"https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Frag-eval\u002FBENCHMARK.md",{"path":79,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":80,"sourceHtmlUrl":81},"eval\u002Fh100.json",2893,"https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Frag-eval\u002Feval\u002Fh100.json",{"path":83,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":84,"sourceHtmlUrl":85},"eval\u002Fnvidia_hosted.json",1963,"https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Frag-eval\u002Feval\u002Fnvidia_hosted.json",{"path":87,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":88,"sourceHtmlUrl":89},"references\u002Fbenchmark-execution.md",8315,"https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Frag-eval\u002Freferences\u002Fbenchmark-execution.md",{"path":91,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":92,"sourceHtmlUrl":93},"references\u002Fdataset-and-conversion.md",8361,"https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Frag-eval\u002Freferences\u002Fdataset-and-conversion.md",{"path":95,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":96,"sourceHtmlUrl":97},"references\u002Fevaluate-rag-cli.md",4283,"https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Frag-eval\u002Freferences\u002Fevaluate-rag-cli.md",{"path":99,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":100,"sourceHtmlUrl":101},"references\u002Fresult-analysis.md",2868,"https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Frag-eval\u002Freferences\u002Fresult-analysis.md",{"path":103,"resourceType":74,"resourceTypeDesc":75,"sizeBytes":104,"sourceHtmlUrl":105},"skill-card.md",2673,"https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Frag-eval\u002Fskill-card.md",{"path":107,"resourceType":108,"resourceTypeDesc":109,"sizeBytes":110,"sourceHtmlUrl":111},"skill.oms.sig","OTHER","其他",5797,"https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Frag-eval\u002Fskill.oms.sig",[113,122,129,136,143,150],{"skillNo":114,"name":115,"nameZh":6,"description":116,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":117,"licenseFileUrl":118,"sourceHtmlUrl":119,"categories":120,"keywords":121,"publishedAt":19},"01M7AB34SPKVSDRRG009PM1CZH","youtube-clipper","YouTube 视频智能剪辑工具。下载视频和字幕，AI 分析生成精细章节（几分钟级别）， 用户选择片段后自动剪辑、翻译字幕为中英双语、烧录字幕到视频，并生成总结文案。 使用场景：当用户需要剪辑 YouTube 视频、生成短视频片段、制作双语字幕版本时。 关键词：视频剪辑、YouTube、字幕翻译、双语字幕、视频下载、clip video","MIT","https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fyoutube-clipper\u002FLICENSE","https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fyoutube-clipper\u002FSKILL.md",[],[],{"skillNo":123,"name":124,"nameZh":6,"description":125,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":117,"licenseFileUrl":6,"sourceHtmlUrl":126,"categories":127,"keywords":128,"publishedAt":19},"01M7AB18BH6N7KR7939HRNWVMQ","viem-integration","Integrate EVM blockchains using viem. Use when user says \"read blockchain data\", \"send transaction\", \"interact with smart contract\", \"connect to Ethereum\", \"use viem\", \"use wagmi\", \"wallet integration\", \"viem setup\", or mentions blockchain\u002FEVM development with TypeScript.","https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fviem-integration\u002FSKILL.md",[],[],{"skillNo":130,"name":131,"nameZh":6,"description":132,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":117,"licenseFileUrl":6,"sourceHtmlUrl":133,"categories":134,"keywords":135,"publishedAt":19},"01M7AB12GHGP48WCNXDQQ9222H","v4-security-foundations","Security-first Uniswap v4 hook development. Use when user mentions \"v4 hooks\", \"hook security\", \"PoolManager\", \"beforeSwap\", \"afterSwap\", or asks about V4 hook best practices, vulnerabilities, or audit requirements.","https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fv4-security-foundations\u002FSKILL.md",[],[],{"skillNo":137,"name":138,"nameZh":6,"description":139,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":117,"licenseFileUrl":6,"sourceHtmlUrl":140,"categories":141,"keywords":142,"publishedAt":19},"01M7AB0XM3PSR7V3Q2ZRR0Q0FB","v4-sdk-integration","App-layer SDK guide for building swap and liquidity experiences directly with the Uniswap v4 SDK. Use when user asks about \"v4 sdk\", \"uniswap v4\", \"v4 swap\", \"v4 liquidity\", \"PoolManager\", \"V4Planner\", \"StateView\", \"PositionManager\", \"pool state\", \"v4 position\", \"uniswap sdk\", or when building swap\u002Fliquidity UX directly with SDKs rather than via the Trading API.","https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fv4-sdk-integration\u002FSKILL.md",[],[],{"skillNo":144,"name":145,"nameZh":6,"description":146,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":117,"licenseFileUrl":6,"sourceHtmlUrl":147,"categories":148,"keywords":149,"publishedAt":19},"01M7AB0SGA93ASA588DJW4P9WT","v4-hook-generator","Generate Uniswap v4 hook contracts via OpenZeppelin MCP. Use when building custom swap logic, async swaps, hook-owned liquidity, custom curves, dynamic fees, MEV protection, limit orders, or oracle hooks.","https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fv4-hook-generator\u002FSKILL.md",[],[],{"skillNo":151,"name":152,"nameZh":6,"description":153,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":117,"licenseFileUrl":6,"sourceHtmlUrl":154,"categories":155,"keywords":156,"publishedAt":19},"01M7AAZYH75H4CS03WSW2EZ8DM","testing","For testing with Light Protocol programs and clients on localnet, devnet, and mainnet validation.","https:\u002F\u002Fgithub.com\u002Fthemusebook\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Ftesting\u002FSKILL.md",[],[]]