[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6DFGP4DKD23FF8529WVQV1B":3,"skill-same:01M6DFGP4DKD23FF8529WVQV1B":104},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":32,"linkOnly":33,"markdownContent":34,"markdownBody":35,"frontMatter":36,"refName":52,"commitSha":53,"skillDirectory":54,"forksCount":55,"repositoryHtmlUrl":56,"repositoryHomepageUrl":6,"ownerHtmlUrl":57,"ownerBlogUrl":6,"ownerDescription":58,"updatedAt":59,"install":60,"resources":73},"01M6DFGP4DKD23FF8529WVQV1B","tensorrt-llm",null,"High-throughput LLM inference on NVIDIA GPUs.","zapabob\u002FSkills","zapabob","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F130830376?v=4","01M6DBMYZAGRTFQDSQYW3W764P","峯岸 亮","01M6DBMZ3GKDSJ01NZ9XTZD7JD",2,"MIT","https:\u002F\u002Fgithub.com\u002Fzapabob\u002FSkills\u002Fblob\u002Fmain\u002Farchive\u002Fskill-md-reviewed\u002Fsha256\u002F4c\u002F4cb52bc22ac1eafb8f5f3d8056920689720b4f8084168f1798cbb3a573686840\u002FSKILL.md",[],[19,20,21,22,23,24,25,26,27,28,29,30,31],"tensorrt llm","macos","linux","inference","research","gpu","Optimization","FP8","NVIDIA","Inference Serving","Production","llm inference","latency","2026-11-10 10:12:30",false,"---\nname: tensorrt-llm\ndescription: High-throughput LLM inference on NVIDIA GPUs.\nversion: 1.0.1\nauthor: Orchestra Research\nlicense: MIT\ndependencies: [tensorrt-llm, torch]\nplatforms: [linux, macos]\nmetadata:\n  hermes:\n    tags: [Inference Serving, TensorRT-LLM, NVIDIA, Inference Optimization, High Throughput, Low Latency, Production, FP8, INT4, In-Flight Batching, Multi-GPU]\n\n---\n\n# TensorRT-LLM\n\nNVIDIA's open-source library for optimizing LLM inference with high performance on NVIDIA GPUs.\n\n## When to use TensorRT-LLM\n\n**Use TensorRT-LLM when:**\n- Deploying on NVIDIA GPUs (A100, H100, GB200)\n- Need maximum throughput (24,000+ tokens\u002Fsec on Llama 3)\n- Require low latency for real-time applications\n- Working with quantized models (FP8, INT4, FP4)\n- Scaling across multiple GPUs or nodes\n\n**Use vLLM instead when:**\n- Need simpler setup and Python-first API\n- Want PagedAttention without TensorRT compilation\n- Working with AMD GPUs or non-NVIDIA hardware\n\n**Use llama.cpp instead when:**\n- Deploying on CPU or Apple Silicon\n- Need edge deployment without NVIDIA GPUs\n- Want simpler GGUF quantization format\n\n## Quick start\n\n### Installation\n\n```bash\n# Docker (recommended) — images are on NGC (nvcr.io), not Docker Hub.\n# Replace x.y.z with the desired version (e.g. 1.2.1). Browse tags on NGC:\n# https:\u002F\u002Fcatalog.ngc.nvidia.com\u002Forgs\u002Fnvidia\u002Fteams\u002Ftensorrt-llm\u002Fcontainers\u002Frelease\u002Ftags\ndocker pull nvcr.io\u002Fnvidia\u002Ftensorrt-llm\u002Frelease:x.y.z\n\n# pip install (current stable GA)\npip install tensorrt_llm\n\n# Requires CUDA 13.2.1, TensorRT 10.x, Python 3.10-3.12\n```\n\n### Basic inference\n\n```python\nfrom tensorrt_llm import LLM, SamplingParams\n\n# Initialize model\nllm = LLM(model=\"meta-llama\u002FMeta-Llama-3-8B\")\n\n# Configure sampling\nsampling_params = SamplingParams(\n    max_tokens=100,\n    temperature=0.7,\n    top_p=0.9\n)\n\n# Generate\nprompts = [\"Explain quantum computing\"]\noutputs = llm.generate(prompts, sampling_params)\n\nfor output in outputs:\n    print(output.text)\n```\n\n### Serving with trtllm-serve\n\n```bash\n# Start server (automatic model download and compilation)\ntrtllm-serve meta-llama\u002FMeta-Llama-3-8B \\\n    --tp_size 4 \\              # Tensor parallelism (4 GPUs)\n    --max_batch_size 256 \\\n    --max_num_tokens 4096\n\n# Client request\ncurl -X POST http:\u002F\u002Flocalhost:8000\u002Fv1\u002Fchat\u002Fcompletions \\\n  -H \"Content-Type: application\u002Fjson\" \\\n  -d '{\n    \"model\": \"meta-llama\u002FMeta-Llama-3-8B\",\n    \"messages\": [{\"role\": \"user\", \"content\": \"Hello!\"}],\n    \"temperature\": 0.7,\n    \"max_tokens\": 100\n  }'\n```\n\n## Key features\n\n### Performance optimizations\n- **In-flight batching**: Dynamic batching during generation\n- **Paged KV cache**: Efficient memory management\n- **Flash Attention**: Optimized attention kernels\n- **Quantization**: FP8, INT4, FP4 for 2-4× faster inference\n- **CUDA graphs**: Reduced kernel launch overhead\n\n### Parallelism\n- **Tensor parallelism (TP)**: Split model across GPUs\n- **Pipeline parallelism (PP)**: Layer-wise distribution\n- **Expert parallelism**: For Mixture-of-Experts models\n- **Multi-node**: Scale beyond single machine\n\n### Advanced features\n- **Speculative decoding**: Faster generation with draft models\n- **LoRA serving**: Efficient multi-adapter deployment\n- **Disaggregated serving**: Separate prefill and generation\n\n## Common patterns\n\n### Quantized model (FP8)\n\n```python\nfrom tensorrt_llm import LLM\n\n# Load FP8 quantized model (2× faster, 50% memory)\nllm = LLM(\n    model=\"meta-llama\u002FMeta-Llama-3-70B\",\n    dtype=\"fp8\",\n    max_num_tokens=8192\n)\n\n# Inference same as before\noutputs = llm.generate([\"Summarize this article...\"])\n```\n\n### Multi-GPU deployment\n\n```python\n# Tensor parallelism across 8 GPUs\nllm = LLM(\n    model=\"meta-llama\u002FMeta-Llama-3-405B\",\n    tensor_parallel_size=8,\n    dtype=\"fp8\"\n)\n```\n\n### Batch inference\n\n```python\n# Process 100 prompts efficiently\nprompts = [f\"Question {i}: ...\" for i in range(100)]\n\noutputs = llm.generate(\n    prompts,\n    sampling_params=SamplingParams(max_tokens=200)\n)\n\n# Automatic in-flight batching for maximum throughput\n```\n\n## Performance benchmarks\n\n**Meta Llama 3-8B** (H100 GPU):\n- Throughput: 24,000 tokens\u002Fsec\n- Latency: ~10ms per token\n- vs PyTorch: **100× faster**\n\n**Llama 3-70B** (8× A100 80GB):\n- FP8 quantization: 2× faster than FP16\n- Memory: 50% reduction with FP8\n\n## Supported models\n\n- **LLaMA family**: Llama 2, Llama 3, CodeLlama\n- **GPT family**: GPT-2, GPT-J, GPT-NeoX\n- **Qwen**: Qwen, Qwen2, QwQ\n- **DeepSeek**: DeepSeek-V2, DeepSeek-V3\n- **Mixtral**: Mixtral-8x7B, Mixtral-8x22B\n- **Vision**: LLaVA, Phi-3-vision\n- **100+ models** on HuggingFace\n\n## References\n\n- **[Optimization Guide](references\u002Foptimization.md)** - Quantization, batching, KV cache tuning\n- **[Multi-GPU Setup](references\u002Fmulti-gpu.md)** - Tensor\u002Fpipeline parallelism, multi-node\n- **[Serving Guide](references\u002Fserving.md)** - Production deployment, monitoring, autoscaling\n\n## Resources\n\n- **Docs**: https:\u002F\u002Fnvidia.github.io\u002FTensorRT-LLM\u002F\n- **GitHub**: https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FTensorRT-LLM\n- **Models**: https:\u002F\u002Fhuggingface.co\u002Fmodels?library=tensorrt_llm\n","# TensorRT-LLM\n\nNVIDIA's open-source library for optimizing LLM inference with high performance on NVIDIA GPUs.\n\n## When to use TensorRT-LLM\n\n**Use TensorRT-LLM when:**\n- Deploying on NVIDIA GPUs (A100, H100, GB200)\n- Need maximum throughput (24,000+ tokens\u002Fsec on Llama 3)\n- Require low latency for real-time applications\n- Working with quantized models (FP8, INT4, FP4)\n- Scaling across multiple GPUs or nodes\n\n**Use vLLM instead when:**\n- Need simpler setup and Python-first API\n- Want PagedAttention without TensorRT compilation\n- Working with AMD GPUs or non-NVIDIA hardware\n\n**Use llama.cpp instead when:**\n- Deploying on CPU or Apple Silicon\n- Need edge deployment without NVIDIA GPUs\n- Want simpler GGUF quantization format\n\n## Quick start\n\n### Installation\n\n```bash\n# Docker (recommended) — images are on NGC (nvcr.io), not Docker Hub.\n# Replace x.y.z with the desired version (e.g. 1.2.1). Browse tags on NGC:\n# https:\u002F\u002Fcatalog.ngc.nvidia.com\u002Forgs\u002Fnvidia\u002Fteams\u002Ftensorrt-llm\u002Fcontainers\u002Frelease\u002Ftags\ndocker pull nvcr.io\u002Fnvidia\u002Ftensorrt-llm\u002Frelease:x.y.z\n\n# pip install (current stable GA)\npip install tensorrt_llm\n\n# Requires CUDA 13.2.1, TensorRT 10.x, Python 3.10-3.12\n```\n\n### Basic inference\n\n```python\nfrom tensorrt_llm import LLM, SamplingParams\n\n# Initialize model\nllm = LLM(model=\"meta-llama\u002FMeta-Llama-3-8B\")\n\n# Configure sampling\nsampling_params = SamplingParams(\n    max_tokens=100,\n    temperature=0.7,\n    top_p=0.9\n)\n\n# Generate\nprompts = [\"Explain quantum computing\"]\noutputs = llm.generate(prompts, sampling_params)\n\nfor output in outputs:\n    print(output.text)\n```\n\n### Serving with trtllm-serve\n\n```bash\n# Start server (automatic model download and compilation)\ntrtllm-serve meta-llama\u002FMeta-Llama-3-8B \\\n    --tp_size 4 \\              # Tensor parallelism (4 GPUs)\n    --max_batch_size 256 \\\n    --max_num_tokens 4096\n\n# Client request\ncurl -X POST http:\u002F\u002Flocalhost:8000\u002Fv1\u002Fchat\u002Fcompletions \\\n  -H \"Content-Type: application\u002Fjson\" \\\n  -d '{\n    \"model\": \"meta-llama\u002FMeta-Llama-3-8B\",\n    \"messages\": [{\"role\": \"user\", \"content\": \"Hello!\"}],\n    \"temperature\": 0.7,\n    \"max_tokens\": 100\n  }'\n```\n\n## Key features\n\n### Performance optimizations\n- **In-flight batching**: Dynamic batching during generation\n- **Paged KV cache**: Efficient memory management\n- **Flash Attention**: Optimized attention kernels\n- **Quantization**: FP8, INT4, FP4 for 2-4× faster inference\n- **CUDA graphs**: Reduced kernel launch overhead\n\n### Parallelism\n- **Tensor parallelism (TP)**: Split model across GPUs\n- **Pipeline parallelism (PP)**: Layer-wise distribution\n- **Expert parallelism**: For Mixture-of-Experts models\n- **Multi-node**: Scale beyond single machine\n\n### Advanced features\n- **Speculative decoding**: Faster generation with draft models\n- **LoRA serving**: Efficient multi-adapter deployment\n- **Disaggregated serving**: Separate prefill and generation\n\n## Common patterns\n\n### Quantized model (FP8)\n\n```python\nfrom tensorrt_llm import LLM\n\n# Load FP8 quantized model (2× faster, 50% memory)\nllm = LLM(\n    model=\"meta-llama\u002FMeta-Llama-3-70B\",\n    dtype=\"fp8\",\n    max_num_tokens=8192\n)\n\n# Inference same as before\noutputs = llm.generate([\"Summarize this article...\"])\n```\n\n### Multi-GPU deployment\n\n```python\n# Tensor parallelism across 8 GPUs\nllm = LLM(\n    model=\"meta-llama\u002FMeta-Llama-3-405B\",\n    tensor_parallel_size=8,\n    dtype=\"fp8\"\n)\n```\n\n### Batch inference\n\n```python\n# Process 100 prompts efficiently\nprompts = [f\"Question {i}: ...\" for i in range(100)]\n\noutputs = llm.generate(\n    prompts,\n    sampling_params=SamplingParams(max_tokens=200)\n)\n\n# Automatic in-flight batching for maximum throughput\n```\n\n## Performance benchmarks\n\n**Meta Llama 3-8B** (H100 GPU):\n- Throughput: 24,000 tokens\u002Fsec\n- Latency: ~10ms per token\n- vs PyTorch: **100× faster**\n\n**Llama 3-70B** (8× A100 80GB):\n- FP8 quantization: 2× faster than FP16\n- Memory: 50% reduction with FP8\n\n## Supported models\n\n- **LLaMA family**: Llama 2, Llama 3, CodeLlama\n- **GPT family**: GPT-2, GPT-J, GPT-NeoX\n- **Qwen**: Qwen, Qwen2, QwQ\n- **DeepSeek**: DeepSeek-V2, DeepSeek-V3\n- **Mixtral**: Mixtral-8x7B, Mixtral-8x22B\n- **Vision**: LLaVA, Phi-3-vision\n- **100+ models** on HuggingFace\n\n## References\n\n- **[Optimization Guide](references\u002Foptimization.md)** - Quantization, batching, KV cache tuning\n- **[Multi-GPU Setup](references\u002Fmulti-gpu.md)** - Tensor\u002Fpipeline parallelism, multi-node\n- **[Serving Guide](references\u002Fserving.md)** - Production deployment, monitoring, autoscaling\n\n## Resources\n\n- **Docs**: https:\u002F\u002Fnvidia.github.io\u002FTensorRT-LLM\u002F\n- **GitHub**: https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FTensorRT-LLM\n- **Models**: https:\u002F\u002Fhuggingface.co\u002Fmodels?library=tensorrt_llm\n",{"name":5,"author":37,"license":15,"version":38,"metadata":39,"platforms":49,"description":7,"dependencies":50},"Orchestra Research","1.0.1",{"hermes":40},{"tags":41},[28,42,27,43,44,45,29,26,46,47,48],"TensorRT-LLM","Inference Optimization","High Throughput","Low Latency","INT4","In-Flight Batching","Multi-GPU",[21,20],[5,51],"torch","main","0d1434f89f4bc6b07e9d272accd8c1013768820f","archive\u002Fskill-md-reviewed\u002Fsha256\u002F4c\u002F4cb52bc22ac1eafb8f5f3d8056920689720b4f8084168f1798cbb3a573686840",0,"https:\u002F\u002Fgithub.com\u002Fzapabob\u002FSkills","https:\u002F\u002Fgithub.com\u002Fzapabob","The Open University of JAPAN　2019-now\r\n\r\nTokyo University of Science　2007-2010","2026-10-26 16:29:01",{"source":8,"skillName":5,"commands":61,"prompt":71,"zipAvailable":72},[62,65,68],{"tool":63,"command":64},"npx","npx skills add zapabob\u002FSkills --skill tensorrt-llm",{"tool":66,"command":67},"bunx","bunx skills add zapabob\u002FSkills --skill tensorrt-llm",{"tool":69,"command":70},"pnpm","pnpm dlx skills add zapabob\u002FSkills --skill tensorrt-llm","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fzapabob\u002FSkills\u002Fblob\u002Fmain\u002Farchive\u002Fskill-md-reviewed\u002Fsha256\u002F4c\u002F4cb52bc22ac1eafb8f5f3d8056920689720b4f8084168f1798cbb3a573686840\u002FSKILL.md",true,[74,80,84,88,92,98],{"path":75,"resourceType":76,"resourceTypeDesc":77,"sizeBytes":78,"sourceHtmlUrl":79},"core\u002Feasing.py","SCRIPT","脚本",6265,"https:\u002F\u002Fgithub.com\u002Fzpy-yyh\u002Fqfusion-check\u002Fblob\u002Fmain\u002Fskills-main\u002Fskills\u002Fslack-gif-creator\u002Fcore\u002Feasing.py",{"path":81,"resourceType":76,"resourceTypeDesc":77,"sizeBytes":82,"sourceHtmlUrl":83},"core\u002Fframe_composer.py",4548,"https:\u002F\u002Fgithub.com\u002Fzpy-yyh\u002Fqfusion-check\u002Fblob\u002Fmain\u002Fskills-main\u002Fskills\u002Fslack-gif-creator\u002Fcore\u002Fframe_composer.py",{"path":85,"resourceType":76,"resourceTypeDesc":77,"sizeBytes":86,"sourceHtmlUrl":87},"core\u002Fgif_builder.py",9847,"https:\u002F\u002Fgithub.com\u002Fzpy-yyh\u002Fqfusion-check\u002Fblob\u002Fmain\u002Fskills-main\u002Fskills\u002Fslack-gif-creator\u002Fcore\u002Fgif_builder.py",{"path":89,"resourceType":76,"resourceTypeDesc":77,"sizeBytes":90,"sourceHtmlUrl":91},"core\u002Fvalidators.py",3785,"https:\u002F\u002Fgithub.com\u002Fzpy-yyh\u002Fqfusion-check\u002Fblob\u002Fmain\u002Fskills-main\u002Fskills\u002Fslack-gif-creator\u002Fcore\u002Fvalidators.py",{"path":93,"resourceType":94,"resourceTypeDesc":95,"sizeBytes":96,"sourceHtmlUrl":97},"LICENSE.txt","LICENSE","许可证",11357,"https:\u002F\u002Fgithub.com\u002Fzpy-yyh\u002Fqfusion-check\u002Fblob\u002Fmain\u002Fskills-main\u002Fskills\u002Fslack-gif-creator\u002FLICENSE.txt",{"path":99,"resourceType":100,"resourceTypeDesc":101,"sizeBytes":102,"sourceHtmlUrl":103},"requirements.txt","REFERENCE","参考文档",66,"https:\u002F\u002Fgithub.com\u002Fzpy-yyh\u002Fqfusion-check\u002Fblob\u002Fmain\u002Fskills-main\u002Fskills\u002Fslack-gif-creator\u002Frequirements.txt",[105,141,176,203,230,247],{"skillNo":106,"name":107,"nameZh":6,"description":108,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":109,"categories":110,"keywords":124,"publishedAt":32},"01M6GJTE1GESGGF9K028Y7753E","xurl","X\u002FTwitter via xurl CLI: post, search, DM, media, v2 API.","https:\u002F\u002Fgithub.com\u002Fzapabob\u002FSkills\u002Fblob\u002Fmain\u002Fregistry\u002Fskills\u002Fxurl\u002Fvariants\u002Fhermes-agent\u002FSKILL.md",[111,116,119],{"categoryNo":112,"categoryName":113,"taxonomyType":114,"taxonomyTypeDesc":115},"01JBSEEDCAT000000000000010","后端与接口","SCENARIO","使用场景",{"categoryNo":117,"categoryName":118,"taxonomyType":114,"taxonomyTypeDesc":115},"01JBSEEDCAT000000000000023","Skill与智能体开发",{"categoryNo":120,"categoryName":121,"taxonomyType":122,"taxonomyTypeDesc":123},"01JBSEEDCAT000000000000030","开发工程师","PROFESSION","适用职业",[107,125,20,126,127,21,128,129,130,131,132,133,134,135,136,137,52,138,139,140],"openclaw","cli","github","windows","official","search","https","social-media","api","Media","hermes","hermes agent","twitter","social","via","post",{"skillNo":142,"name":143,"nameZh":6,"description":144,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":145,"categories":146,"keywords":158,"publishedAt":32},"01M6GJT8S1PXQ8WPXT1HSNBWH2","writing-plans","Write implementation plans: bite-sized tasks, paths, code.","https:\u002F\u002Fgithub.com\u002Fzapabob\u002FSkills\u002Fblob\u002Fmain\u002Fregistry\u002Fskills\u002Fwriting-plans\u002Fvariants\u002Fhermes-agent\u002FSKILL.md",[147,150,153,154,155],{"categoryNo":148,"categoryName":149,"taxonomyType":114,"taxonomyTypeDesc":115},"01JBSEEDCAT000000000000015","视觉设计",{"categoryNo":151,"categoryName":152,"taxonomyType":114,"taxonomyTypeDesc":115},"01JBSEEDCAT000000000000018","写作与文案",{"categoryNo":117,"categoryName":118,"taxonomyType":114,"taxonomyTypeDesc":115},{"categoryNo":120,"categoryName":121,"taxonomyType":122,"taxonomyTypeDesc":123},{"categoryNo":156,"categoryName":157,"taxonomyType":122,"taxonomyTypeDesc":123},"01JBSEEDCAT000000000000036","内容创作者",[159,160,161,162,20,163,21,164,128,165,166,167,168,169,170,171,172,173,174,175],"writing","writing plans","plans","design","review","workflow","documentation","tasks","development","code","planning","code-review","subagent","write","superpowers","paths","test-driven-development",{"skillNo":177,"name":178,"nameZh":6,"description":179,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":180,"categories":181,"keywords":185,"publishedAt":32},"01M6GJST0H5X7WHBJ3BZK0DVKH","whisper","OpenAI's general-purpose speech recognition model. Supports 99 languages, transcription, translation to English, and language identification. Six model sizes from tiny (39M params) to large (1550M params). Use for speech-to-text, podcast transcription, or multilingual audio processing. Best for robust, multilingual ASR.","https:\u002F\u002Fgithub.com\u002Fzapabob\u002FSkills\u002Fblob\u002Fmain\u002Fregistry\u002Fskills\u002Fwhisper\u002Fvariants\u002Fhermes-agent-optional\u002FSKILL.md",[182],{"categoryNo":183,"categoryName":184,"taxonomyType":114,"taxonomyTypeDesc":115},"01JBSEEDCAT000000000000016","图像与多媒体",[178,20,21,186,187,188,189,190,191,192,193,194,195,196,197,198,199,200,201,202],"openai","speech","multimodal","Transformers","ASR","Audio","text","model","speech recognition","use","general","multilingual","translation","english","identification","processing","Audio Processing",{"skillNo":204,"name":205,"nameZh":6,"description":206,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":207,"categories":208,"keywords":212,"publishedAt":32},"01M6GJSMRQ8EETZTYMG72P70EA","weights-and-biases","W&B: log ML experiments, sweeps, model registry, dashboards.","https:\u002F\u002Fgithub.com\u002Fzapabob\u002FSkills\u002Fblob\u002Fmain\u002Fregistry\u002Fskills\u002Fweights-and-biases\u002Fvariants\u002Fhermes-agent\u002FSKILL.md",[209],{"categoryNo":210,"categoryName":211,"taxonomyType":114,"taxonomyTypeDesc":115},"01JBSEEDCAT000000000000013","分析与可视化",[213,20,214,215,128,216,217,218,219,220,221,193,222,223,224,225,226,227,228,229],"weights and biases","tensorflow","experiments","pytorch","visualization","registry","real-time","tuning","dashboards","experiment","log","time","Experiment Tracking","Model Registry","Hyperparameter Tuning","WandB","Real-Time Visualization",{"skillNo":231,"name":232,"nameZh":6,"description":233,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":234,"categories":235,"keywords":237,"publishedAt":32},"01M6GJS19KDPRY112JTR326S06","watchers","Poll RSS, JSON APIs, and GitHub with watermark dedup.","https:\u002F\u002Fgithub.com\u002Fzapabob\u002FSkills\u002Fblob\u002Fmain\u002Fregistry\u002Fskills\u002Fwatchers\u002Fvariants\u002Fhermes-agent-optional\u002FSKILL.md",[236],{"categoryNo":117,"categoryName":118,"taxonomyType":114,"taxonomyTypeDesc":115},[232,20,238,127,21,239,240,241,242,243,244,135,136,245,246],"terminal","automation","http","monitoring","cron","json","rss","devops","with",{"skillNo":248,"name":249,"nameZh":6,"description":250,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":251,"categories":252,"keywords":255,"publishedAt":32},"01M6GJRHJD2A6Q830SWF9W48BC","serving-llms-vllm","vLLM: high-throughput LLM serving, OpenAI API, quantization.","https:\u002F\u002Fgithub.com\u002Fzapabob\u002FSkills\u002Fblob\u002Fmain\u002Fregistry\u002Fskills\u002Fvllm\u002Fvariants\u002Fhermes-agent\u002FSKILL.md",[253,254],{"categoryNo":112,"categoryName":113,"taxonomyType":114,"taxonomyTypeDesc":115},{"categoryNo":120,"categoryName":121,"taxonomyType":122,"taxonomyTypeDesc":123},[256,257,258,21,23,186,259,260,28,189,29,133,261,44,262,263,264,265,266,267],"llms","vLLM","serving llms vllm","openai api","tensor","llm serving","PagedAttention","Continuous Batching","Quantization","Tensor Parallelism","high-throughput","throughput"]