[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M78A8DV55015V8TMP71JM22G":3,"skill-same:01M78A8DV55015V8TMP71JM22G":76},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":34,"commitSha":35,"skillDirectory":36,"forksCount":14,"repositoryHtmlUrl":37,"repositoryHomepageUrl":6,"ownerHtmlUrl":38,"ownerBlogUrl":39,"ownerDescription":40,"updatedAt":41,"install":42,"resources":55},"01M78A8DV55015V8TMP71JM22G","jetson-speculative-decoding",null,"Add EAGLE-3 or draft-model speculative decoding to a Jetson vLLM server when TPOT is the bottleneck.","Solizardking\u002Ftrain2earn","Solizardking","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F108096810?v=4","01M786KDB10AYV042N0F9BD5B5","Clawd","01M786KDC5C3NPE4W44C5641EZ",0,"Apache-2.0","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Fjetson-speculative-decoding\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: jetson-speculative-decoding\ndescription: Add EAGLE-3 or draft-model speculative decoding to a Jetson vLLM server when TPOT is the bottleneck.\nversion: 0.0.1\nlicense: \"Apache-2.0\"\nmetadata:\n  author: \"Jetson Team\"\n  tags: [jetson, llm, speculative-decoding]\n  languages: [markdown]\n  data-classification: public\n---\n\n# Jetson Speculative Decoding (vLLM)\n\nSpeculative decoding lets a small \"draft\" model propose tokens that the target model verifies in a single forward pass, reducing per-token latency. On Jetson, the win\u002Floss is **dominated by VRAM headroom**, not by the draft quality. This skill encodes the parts an LLM won't already know.\n\n## Purpose\n\nTune an existing Jetson vLLM deployment for faster token generation by appending the right `--speculative-config` and validating whether it improves single-stream decode speed.\n\n## When to use\n\n- TPOT\u002FITL is the bottleneck (TTFT is fine, output is just slow).\n- Workload is single-stream or low-concurrency (≤2). Speculation usually loses at high concurrency.\n- Jetson family is **Thor or AGX Orin**. Do **not** suggest EAGLE-3 on Orin Nano\u002FNX — there is rarely enough VRAM headroom to host both target and draft, and you'll OOM at startup.\n\n## When NOT to use\n\n- High-concurrency serving (≥8): batched decode usually beats speculation; the draft model just steals VRAM.\n- Models without a published EAGLE-3 head — do not train one ad-hoc as a \"fix\".\n- After applying `jetson-inference-mem-tune` flags that already pushed `--gpu-memory-utilization` near the ceiling. Free at least ~2 GB first.\n\n## Prerequisites\n\n- A working vLLM server recipe from `jetson-llm-serve`.\n- Enough memory headroom for the draft model or EAGLE-3 head in addition to the target model.\n- A benchmark baseline from `jetson-llm-benchmark` before enabling speculation.\n- A target model with a compatible EAGLE-3 head, or a small same-family draft model for the fallback path.\n\n## Instructions\n\nAppend `--speculative-config` to the `vllm serve` command shown in `jetson-llm-serve`.\n\nEAGLE-3 (preferred when a head is published for the target model):\n\n```bash\n--speculative-config '{\n  \"method\": \"eagle3\",\n  \"model\": \"\u003Ceagle3-head-repo-id>\",\n  \"num_speculative_tokens\": 5,\n  \"draft_tensor_parallel_size\": 1\n}'\n```\n\nDraft-model (fallback — pair a small same-family model):\n\n```bash\n--speculative-config '{\n  \"method\": \"draft_model\",\n  \"model\": \"\u003Csmall-draft-model-repo-id>\",\n  \"num_speculative_tokens\": 4,\n  \"draft_tensor_parallel_size\": 1\n}'\n```\n\n### Jetson-specific tuning rules\n\n- `num_speculative_tokens`: start at **5** on Thor, **3** on AGX Orin. Higher values pay off only if the draft acceptance rate is >0.6.\n- Always pair with the same vLLM runtime path used by `jetson-llm-serve`: upstream vLLM 0.20+ (`vllm\u002Fvllm-openai:latest`) or validated native vLLM 0.20+ on Thor, upstream vLLM 0.20+ on Orin JetPack 7.2 \u002F L4T r39+, or the NVIDIA-AI-IOT vLLM image on older Orin. Do not use an Orin NVIDIA-AI-IOT vLLM image on Thor. Older runtimes may lack EAGLE-3 or the current `--speculative-config` shape.\n- Drop `--gpu-memory-utilization` by ~0.05 vs the non-speculative baseline to give the draft model headroom.\n\n## How to verify it actually helped\n\n1. Run `jetson-llm-benchmark` (vLLM path) at `--concurrency 1` **before and after** enabling speculation.\n2. Acceptance: target ≥30% improvement in `throughput_tok_s` and ≥20% drop in `tpot_ms_p50` at concurrency 1.\n3. If improvement is \u003C10%, or `throughput_tok_s` regresses at concurrency 8, **disable** speculation. The draft model is costing more than it returns.\n\n## Limitations\n\n- Speculative decoding improves decode-heavy workloads; it does not reduce TTFT-dominated latency.\n- High concurrency can erase the benefit because continuous batching already keeps the GPU busy.\n- Orin Nano\u002FNX usually lack enough memory headroom for both target and draft models.\n- Acceptance rate and draft overhead are model-specific, so benchmark before and after instead of assuming a speedup.\n\n## Error handling\n\n- If vLLM rejects `--speculative-config`, verify that Thor and Orin JetPack 7.2 \u002F L4T r39+ are using vLLM 0.20+ and that older Orin is using a JetPack-matched NVIDIA-AI-IOT vLLM image; then switch back to the non-speculative serving command if the runtime still rejects it.\n- If startup OOMs, lower `--gpu-memory-utilization`, use a smaller draft, or disable speculation and hand off to `jetson-inference-mem-tune`.\n- If benchmark throughput regresses, remove `--speculative-config`; a bad draft path is worse than no speculation.\n\n## Hand off to\n\n- `jetson-llm-benchmark` to quantify the change.\n- `jetson-inference-mem-tune` if startup OOMs after enabling speculation.\n\n## Source\n\nvLLM speculative decoding docs and the [Jetson AI Lab GenAI tutorial](https:\u002F\u002Fwww.jetson-ai-lab.com\u002Ftutorials\u002Fgenai-on-jetson-llms-vlms\u002F).\n","# Jetson Speculative Decoding (vLLM)\n\nSpeculative decoding lets a small \"draft\" model propose tokens that the target model verifies in a single forward pass, reducing per-token latency. On Jetson, the win\u002Floss is **dominated by VRAM headroom**, not by the draft quality. This skill encodes the parts an LLM won't already know.\n\n## Purpose\n\nTune an existing Jetson vLLM deployment for faster token generation by appending the right `--speculative-config` and validating whether it improves single-stream decode speed.\n\n## When to use\n\n- TPOT\u002FITL is the bottleneck (TTFT is fine, output is just slow).\n- Workload is single-stream or low-concurrency (≤2). Speculation usually loses at high concurrency.\n- Jetson family is **Thor or AGX Orin**. Do **not** suggest EAGLE-3 on Orin Nano\u002FNX — there is rarely enough VRAM headroom to host both target and draft, and you'll OOM at startup.\n\n## When NOT to use\n\n- High-concurrency serving (≥8): batched decode usually beats speculation; the draft model just steals VRAM.\n- Models without a published EAGLE-3 head — do not train one ad-hoc as a \"fix\".\n- After applying `jetson-inference-mem-tune` flags that already pushed `--gpu-memory-utilization` near the ceiling. Free at least ~2 GB first.\n\n## Prerequisites\n\n- A working vLLM server recipe from `jetson-llm-serve`.\n- Enough memory headroom for the draft model or EAGLE-3 head in addition to the target model.\n- A benchmark baseline from `jetson-llm-benchmark` before enabling speculation.\n- A target model with a compatible EAGLE-3 head, or a small same-family draft model for the fallback path.\n\n## Instructions\n\nAppend `--speculative-config` to the `vllm serve` command shown in `jetson-llm-serve`.\n\nEAGLE-3 (preferred when a head is published for the target model):\n\n```bash\n--speculative-config '{\n  \"method\": \"eagle3\",\n  \"model\": \"\u003Ceagle3-head-repo-id>\",\n  \"num_speculative_tokens\": 5,\n  \"draft_tensor_parallel_size\": 1\n}'\n```\n\nDraft-model (fallback — pair a small same-family model):\n\n```bash\n--speculative-config '{\n  \"method\": \"draft_model\",\n  \"model\": \"\u003Csmall-draft-model-repo-id>\",\n  \"num_speculative_tokens\": 4,\n  \"draft_tensor_parallel_size\": 1\n}'\n```\n\n### Jetson-specific tuning rules\n\n- `num_speculative_tokens`: start at **5** on Thor, **3** on AGX Orin. Higher values pay off only if the draft acceptance rate is >0.6.\n- Always pair with the same vLLM runtime path used by `jetson-llm-serve`: upstream vLLM 0.20+ (`vllm\u002Fvllm-openai:latest`) or validated native vLLM 0.20+ on Thor, upstream vLLM 0.20+ on Orin JetPack 7.2 \u002F L4T r39+, or the NVIDIA-AI-IOT vLLM image on older Orin. Do not use an Orin NVIDIA-AI-IOT vLLM image on Thor. Older runtimes may lack EAGLE-3 or the current `--speculative-config` shape.\n- Drop `--gpu-memory-utilization` by ~0.05 vs the non-speculative baseline to give the draft model headroom.\n\n## How to verify it actually helped\n\n1. Run `jetson-llm-benchmark` (vLLM path) at `--concurrency 1` **before and after** enabling speculation.\n2. Acceptance: target ≥30% improvement in `throughput_tok_s` and ≥20% drop in `tpot_ms_p50` at concurrency 1.\n3. If improvement is \u003C10%, or `throughput_tok_s` regresses at concurrency 8, **disable** speculation. The draft model is costing more than it returns.\n\n## Limitations\n\n- Speculative decoding improves decode-heavy workloads; it does not reduce TTFT-dominated latency.\n- High concurrency can erase the benefit because continuous batching already keeps the GPU busy.\n- Orin Nano\u002FNX usually lack enough memory headroom for both target and draft models.\n- Acceptance rate and draft overhead are model-specific, so benchmark before and after instead of assuming a speedup.\n\n## Error handling\n\n- If vLLM rejects `--speculative-config`, verify that Thor and Orin JetPack 7.2 \u002F L4T r39+ are using vLLM 0.20+ and that older Orin is using a JetPack-matched NVIDIA-AI-IOT vLLM image; then switch back to the non-speculative serving command if the runtime still rejects it.\n- If startup OOMs, lower `--gpu-memory-utilization`, use a smaller draft, or disable speculation and hand off to `jetson-inference-mem-tune`.\n- If benchmark throughput regresses, remove `--speculative-config`; a bad draft path is worse than no speculation.\n\n## Hand off to\n\n- `jetson-llm-benchmark` to quantify the change.\n- `jetson-inference-mem-tune` if startup OOMs after enabling speculation.\n\n## Source\n\nvLLM speculative decoding docs and the [Jetson AI Lab GenAI tutorial](https:\u002F\u002Fwww.jetson-ai-lab.com\u002Ftutorials\u002Fgenai-on-jetson-llms-vlms\u002F).\n",{"name":5,"license":15,"version":24,"metadata":25,"description":7},"0.0.1",{"tags":26,"author":30,"languages":31,"data-classification":33},[27,28,29],"jetson","llm","speculative-decoding","Jetson Team",[32],"markdown","public","main","86cc27ffd16af6cb85948f1155578e6f3f61cc4c","skillhub\u002Fskills\u002Fnvidia\u002Fjetson-speculative-decoding","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn","https:\u002F\u002Fgithub.com\u002FSolizardking","https:\u002F\u002Fmusebook.trade","Got a mile high and never came down","2026-10-08 11:52:53",{"source":8,"skillName":5,"commands":43,"prompt":53,"zipAvailable":54},[44,47,50],{"tool":45,"command":46},"npx","npx skills add Solizardking\u002Ftrain2earn --skill jetson-speculative-decoding",{"tool":48,"command":49},"bunx","bunx skills add Solizardking\u002Ftrain2earn --skill jetson-speculative-decoding",{"tool":51,"command":52},"pnpm","pnpm dlx skills add Solizardking\u002Ftrain2earn --skill jetson-speculative-decoding","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Fjetson-speculative-decoding\u002FSKILL.md",true,[56,62,66,70],{"path":57,"resourceType":58,"resourceTypeDesc":59,"sizeBytes":60,"sourceHtmlUrl":61},"BENCHMARK.md","REFERENCE","参考文档",3357,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Fjetson-speculative-decoding\u002FBENCHMARK.md",{"path":63,"resourceType":58,"resourceTypeDesc":59,"sizeBytes":64,"sourceHtmlUrl":65},"evals\u002Fevals.json",6522,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Fjetson-speculative-decoding\u002Fevals\u002Fevals.json",{"path":67,"resourceType":58,"resourceTypeDesc":59,"sizeBytes":68,"sourceHtmlUrl":69},"skill-card.md",3675,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Fjetson-speculative-decoding\u002Fskill-card.md",{"path":71,"resourceType":72,"resourceTypeDesc":73,"sizeBytes":74,"sourceHtmlUrl":75},"skill.oms.sig","OTHER","其他",4605,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Fjetson-speculative-decoding\u002Fskill.oms.sig",[77,85,93,101,108,116],{"skillNo":78,"name":79,"nameZh":6,"description":80,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":81,"licenseFileUrl":6,"sourceHtmlUrl":82,"categories":83,"keywords":84,"publishedAt":19},"01M78B94RSCAKMH1QS79VE6DG9","testing","For testing with Light Protocol programs and clients on localnet, devnet, and mainnet validation.","MIT","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Ftesting\u002FSKILL.md",[],[],{"skillNo":86,"name":87,"nameZh":6,"description":88,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":81,"licenseFileUrl":89,"sourceHtmlUrl":90,"categories":91,"keywords":92,"publishedAt":19},"01M78B81BKY8RX12HETPG8YKWK","qedgen","Formally verify programs by writing Lean 4 proofs. Trigger this skill whenever the user wants to formally verify code, generate Lean 4 proofs, prove properties about algorithms or smart contracts, verify invariants, convert program logic into formal specifications, or anything involving Lean 4 and formal verification. Also trigger when the user mentions \"qedgen\", \"lean proof\", \"formal proof\", \"verify my code\", \"prove correctness\", \"formal verification\", or wants mathematical guarantees about their implementation.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-formal-verification\u002FLICENSE","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-formal-verification\u002FSKILL.md",[],[],{"skillNo":94,"name":95,"nameZh":6,"description":96,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":81,"licenseFileUrl":97,"sourceHtmlUrl":98,"categories":99,"keywords":100,"publishedAt":19},"01M78B7Q7C5K54E01DN83A60KG","solana-dev","Use when user asks to \"build a Solana dapp\", \"write an Anchor program\", \"create a token\", \"debug Solana errors\", \"set up wallet connection\", \"test my Solana program\", \"deploy to devnet\", or \"explain Solana concepts\" (rent, accounts, PDAs, CPIs, etc.). Also use for quick on-chain lookups via public RPC + curl — \"what's the balance of \u003Cwallet>\", \"look up transaction \u003Csig>\", \"token balance for \u003Caccount>\", \"check this address on mainnet\u002Fdevnet\". End-to-end Solana development playbook covering wallet connection, Anchor\u002FPinocchio programs, Codama client generation, LiteSVM\u002FMollusk\u002FSurfpool testing, security checklists, and JSON-RPC curl lookups against public clusters. Integrates with the Solana MCP server for live documentation search. Prefers framework-kit (@solana\u002Fclient + @solana\u002Freact-hooks) for UI, wallet-standard-first connection (incl. ConnectorKit), @solana\u002Fkit for client\u002FRPC code, and @solana\u002Fweb3-compat for legacy boundaries.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-dev\u002FLICENSE","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-dev\u002FSKILL.md",[],[],{"skillNo":102,"name":103,"nameZh":6,"description":104,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":81,"licenseFileUrl":6,"sourceHtmlUrl":105,"categories":106,"keywords":107,"publishedAt":19},"01M78B7HXD6N6GWKSVRQ8F6Q31","solana-common-errors","Diagnose and fix common Solana development errors — GLIBC mismatches, Anchor version conflicts, cargo build-sbf \u002F platform-tools failures, LiteSVM issues, edition2024 crate pins, RPC airdrops, and Anchor 0.29→0.32 migrations. Use when builds fail, Anchor CLI won't install, or CI breaks on Debian\u002FUbuntu.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-common-errors\u002FSKILL.md",[],[],{"skillNo":109,"name":110,"nameZh":6,"description":111,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":112,"sourceHtmlUrl":113,"categories":114,"keywords":115,"publishedAt":19},"01M78B6T7YSYWQ0N4DP40QDXEZ","skill-creator","Create or update AgentSkills. Use when designing, structuring, or packaging skills with scripts, references, and assets.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fskill-creator\u002Flicense.txt","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fskill-creator\u002FSKILL.md",[],[],{"skillNo":117,"name":118,"nameZh":6,"description":119,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":81,"licenseFileUrl":6,"sourceHtmlUrl":120,"categories":121,"keywords":122,"publishedAt":19},"01M78B1VFT9X5AND7AE1HZPZGF","phantom-wallet-mcp","Execute wallet operations through the Phantom MCP server. Use when the user wants to interact with their Phantom wallet directly — get addresses, transfer SOL or SPL tokens, buy\u002Fswap tokens, sign transactions, and sign messages across Solana, Ethereum, Bitcoin, and Sui. Requires the @phantom\u002Fmcp-server to be configured as an MCP server.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fphantom-wallet-mcp\u002FSKILL.md",[],[]]