[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M79FD7J1Y9FP28ZYN83MDPP9":3,"skill-same:01M79FD7J1Y9FP28ZYN83MDPP9":69},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":25,"commitSha":26,"skillDirectory":27,"forksCount":14,"repositoryHtmlUrl":28,"repositoryHomepageUrl":6,"ownerHtmlUrl":29,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":30,"install":31,"resources":44},"01M79FD7J1Y9FP28ZYN83MDPP9","nemo-mbridge-perf-cpu-offloading",null,"Validate and use CPU offloading in Megatron Bridge, including layer-level activation offloading and fractional optimizer state offloading with HybridDeviceOptimizer.","Elogic360\u002Fsoftware-factory","Elogic360","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F156535519?v=4","01M74NH3F0RB13PWB7JZDE2V80","elogic360","01M74NH3FPC65082MDZVMFHDM3",0,"Apache-2.0","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fnemo-mbridge-perf-cpu-offloading\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: nemo-mbridge-perf-cpu-offloading\ndescription: Validate and use CPU offloading in Megatron Bridge, including layer-level activation offloading and fractional optimizer state offloading with HybridDeviceOptimizer.\nlicense: Apache-2.0\nwhen_to_use: Enabling CPU offload to reduce GPU memory, or investigating a commit that changed CPU offloading config and caused OOM or a crash; 'cpu_offloading', 'optimizer_cpu_offload', 'optimizer_offload_fraction', 'HybridDeviceOptimizer', 'move optimizer to CPU'.\n---\n\n# CPU Offloading\n\n## References\n\n- Stable docs: @docs\u002Ftraining\u002Fcpu-offloading.md\n- Structured metadata: @skills\u002Fnemo-mbridge-perf-cpu-offloading\u002Fcard.yaml\n\n## What It Is\n\nTwo independent mechanisms to move data from GPU to CPU memory:\n\n| Mechanism | Config namespace | What gets offloaded | PP restriction |\n|---|---|---|---|\n| Activation offloading | `model.cpu_offloading*` | Activations (and optionally weights) per transformer layer | PP must be 1 |\n| Optimizer offloading | `optimizer.optimizer_cpu_offload` | Adam optimizer states (momentum + variance) via `HybridDeviceOptimizer` | None |\n\n## Quick Decision\n\n| Situation | Recommendation |\n|---|---|\n| Large MoE model (30B+), needs PP > 1 | Optimizer offloading — activation offloading is blocked by PP=1 |\n| Small\u002Fmedium model, PP=1 fits, activation memory dominates | Activation offloading |\n| Want tunable memory-speed tradeoff | Optimizer offloading with fractional `optimizer_offload_fraction` |\n| Throughput is top priority | Don't enable — offloading always adds overhead |\n| CUDA graphs are needed | Only optimizer offloading — activation offloading is incompatible |\n| Memory pressure is moderate | Optimizer offload at 25–50% fraction for best efficiency |\n\n## Enablement\n\n### Optimizer CPU offloading (recommended for large models)\n\n```python\ncfg.optimizer.optimizer_cpu_offload = True\ncfg.optimizer.optimizer_offload_fraction = 1.0\ncfg.optimizer.overlap_cpu_optimizer_d2h_h2d = True\n```\n\nCLI overrides:\n\n```bash\noptimizer.optimizer_cpu_offload=True \\\noptimizer.optimizer_offload_fraction=0.5 \\\noptimizer.overlap_cpu_optimizer_d2h_h2d=True\n```\n\n### Activation CPU offloading (small\u002Fmedium models only)\n\n```python\ncfg.model.cpu_offloading = True\ncfg.model.cpu_offloading_num_layers = 16\ncfg.model.cpu_offloading_activations = True\ncfg.model.cpu_offloading_weights = False\n\ncfg.model.pipeline_model_parallel_size = 1\ncfg.model.recompute_granularity = None\ncfg.model.cuda_graph_impl = \"none\"\n```\n\n## Config Parameter Reference\n\n### Optimizer offloading\n\n| Parameter | Default | Description |\n|-----------|---------|-------------|\n| `optimizer_cpu_offload` | `False` | Master switch |\n| `optimizer_offload_fraction` | `0.0` | Fraction of optimizer states on CPU (0.0–1.0) |\n| `overlap_cpu_optimizer_d2h_h2d` | `False` | Overlap GPU↔CPU transfers with compute |\n| `use_torch_optimizer_for_cpu_offload` | `False` | Use `torch.optim` instead of fused optimizer for CPU portion |\n\n### Activation offloading\n\n| Parameter | Default | Description |\n|-----------|---------|-------------|\n| `cpu_offloading` | `False` | Master switch |\n| `cpu_offloading_num_layers` | `0` | Number of transformer layers to offload (0 to num_layers-1) |\n| `cpu_offloading_activations` | `True` | Offload activations |\n| `cpu_offloading_weights` | `False` | Offload weights |\n| `cpu_offloading_double_buffering` | `False` | Double-buffer across layers while reloading |\n\n## Compatibility And Constraints\n\n### Activation offloading\n\n- `pipeline_model_parallel_size` must be 1\n- `recompute_granularity` must be `None`\n- Cannot combine with `fine_grained_activation_offloading`\n- Cannot combine with CUDA graphs\n- `cpu_offloading_num_layers` must be in `[0, num_layers-1)`\n\n### Optimizer offloading\n\n- Requires `use_distributed_optimizer = True` (default in most recipes)\n- No PP, recompute, or CUDA graph restrictions\n- `optimizer_offload_fraction` must be in `[0.0, 1.0]`\n\n### Practical: large MoE models\n\nActivation offloading is blocked for Qwen3-30B-A3B and similar large MoE\nmodels. The PP=1 constraint means each GPU holds all 48 layers; model\nweights + optimizer states alone (~70 GB) exceed H100 80 GB capacity.\n\n## Minimal Runnable Command\n\n```bash\nuv run python scripts\u002Ftraining\u002Frun_recipe.py \\\n  --recipe qwen3_30b_a3b_pretrain_config \\\n  optimizer.optimizer_cpu_offload=True \\\n  optimizer.optimizer_offload_fraction=0.5 \\\n  train.train_iters=20 \\\n  train.global_batch_size=8 \\\n  train.micro_batch_size=1\n```\n\n## Verification\n\n### Unit tests\n\n```bash\nuv run python -m pytest \\\n  tests\u002Funit_tests\u002Fmodels\u002Ftest_gpt_full_te_layer_autocast_spec.py -k \"cpu_offload\" \\\n  tests\u002Funit_tests\u002Fpeft\u002Ftest_utils.py -k \"cpu_offload\" -q\n```\n\n### Success criteria\n\n- Config validation passes for the selected offloading mode\n- Training completes without OOM or NCCL errors\n- Loss matches the non-offloaded baseline (max delta \u003C 0.001)\n- Memory usage drops proportionally to offload fraction\n\n## Code Anchors\n\n### MCore activation offload constraints\n\n```1296:1310:3rdparty\u002FMegatron-LM\u002Fmegatron\u002Fcore\u002Ftransformer\u002Ftransformer_config.py\n        if self.cpu_offloading and (\n            self.cpu_offloading_num_layers \u003C 0 or self.cpu_offloading_num_layers >= self.num_layers\n        ):\n            raise ValueError(...)\n\n        if self.cpu_offloading and self.pipeline_model_parallel_size > 1:\n            raise ValueError(\n                \"Currently there is no support for Pipeline parallelism with CPU offloading\"\n            )\n\n        if self.cpu_offloading and self.recompute_granularity is not None:\n            raise ValueError(\n                \"CPU offloading does not work when activation recomputation is enabled\"\n            )\n```\n\n### MCore CUDA graph incompatibility\n\n```1943:1944:3rdparty\u002FMegatron-LM\u002Fmegatron\u002Fcore\u002Ftransformer\u002Ftransformer_config.py\n            if self.cpu_offloading:\n                raise ValueError(\"CUDA graphs not supported with CPU offloading.\")\n```\n\n### MCore fine-grained offloading mutual exclusion\n\n```1427:1430:3rdparty\u002FMegatron-LM\u002Fmegatron\u002Fcore\u002Ftransformer\u002Ftransformer_config.py\n        if self.fine_grained_activation_offloading:\n            assert (\n                not self.cpu_offloading\n            ), \"fine_grained_activation_offloading cannot be enabled with cpu_offloading.\"\n```\n\n### MCore HybridDeviceOptimizer instantiation\n\n```480:518:3rdparty\u002FMegatron-LM\u002Fmegatron\u002Fcore\u002Foptimizer\u002F__init__.py\n        if config.optimizer_cpu_offload:\n            # ... setup cpu\u002Fgpu optimizer classes ...\n            optimizer = HybridDeviceOptimizer(\n                param_groups,\n                offload_fraction=config.optimizer_offload_fraction,\n                cpu_optimizer_cls=cpu_optimizer_cls,\n                gpu_optimizer_cls=gpu_optimizer_cls,\n                overlap_cpu_optimizer_d2h_h2d=config.overlap_cpu_optimizer_d2h_h2d,\n                pin_cpu_grads=config.pin_cpu_grads,\n                pin_cpu_params=config.pin_cpu_params,\n            )\n```\n\n### Bridge CUDA graph guard\n\n```232:234:src\u002Fmegatron\u002Fbridge\u002Fmodels\u002Fgpt_full_te_layer_autocast_spec.py\n        assert not config.cpu_offloading and config.recompute_granularity is None, \"Cudagraphs not supported\"\n```\n\n### Bridge activation offloading in PEFT\n\n```621:631:src\u002Fmegatron\u002Fbridge\u002Fpeft\u002Futils.py\n        if self.config.cpu_offloading and self.config.cpu_offloading_activations:\n            x.activation_offloading = True\n        x, _ = self.linear_in(x)\n        x = self.activation(x)\n        if self.config.cpu_offloading and self.config.cpu_offloading_activations:\n            x.activation_offloading = True\n        x, _ = self.linear_out(x)\n```\n\n## Failure Diagnosis\n\n| Symptom | Likely Cause | How To Confirm | Fix |\n|---|---|---|---|\n| `Currently there is no support for Pipeline parallelism with CPU offloading` | Activation offload + PP > 1 | Check `pipeline_model_parallel_size` | Set PP=1 or use optimizer offloading |\n| `CPU offloading does not work when activation recomputation is enabled` | Activation offload + recompute | Check `recompute_granularity` | Set `recompute_granularity=null` |\n| `fine_grained_activation_offloading cannot be enabled with cpu_offloading` | Both offloading modes enabled | Check both flags | Use one or the other |\n| `CUDA graphs not supported with CPU offloading` | CUDA graphs + activation offload | Check `cuda_graph_impl` | Set `cuda_graph_impl=\"none\"` |\n| OOM with activation offloading | Model too large for PP=1 | Check allocated memory vs 80 GB | Use optimizer offloading with PP > 1 |\n| Extreme slowdown (>4x) | 100% optimizer offload, CPU Adam bottleneck | Compare iter time at different fractions | Reduce fraction or enable `overlap_cpu_optimizer_d2h_h2d` |\n| OOM at partial optimizer offload | Insufficient offload for this config | Check memory at different fractions | Increase fraction or add PP |\n\n## Known Limitations\n\n- Activation offloading requires PP=1, making it impractical for large models\n  (30B+ MoE) that need pipeline parallelism.\n- Optimizer offloading throughput penalty scales linearly (~1.9x at 25%,\n  ~4.2x at 100% for Qwen3-30B-A3B).\n- D2H\u002FH2D overlap provides only ~7% speedup because CPU Adam compute is\n  the dominant bottleneck.\n- `fine_grained_activation_offloading` is a separate module-level approach\n  that works with PP > 1 but cannot be combined with layer-level\n  `cpu_offloading`.\n","# CPU Offloading\n\n## References\n\n- Stable docs: @docs\u002Ftraining\u002Fcpu-offloading.md\n- Structured metadata: @skills\u002Fnemo-mbridge-perf-cpu-offloading\u002Fcard.yaml\n\n## What It Is\n\nTwo independent mechanisms to move data from GPU to CPU memory:\n\n| Mechanism | Config namespace | What gets offloaded | PP restriction |\n|---|---|---|---|\n| Activation offloading | `model.cpu_offloading*` | Activations (and optionally weights) per transformer layer | PP must be 1 |\n| Optimizer offloading | `optimizer.optimizer_cpu_offload` | Adam optimizer states (momentum + variance) via `HybridDeviceOptimizer` | None |\n\n## Quick Decision\n\n| Situation | Recommendation |\n|---|---|\n| Large MoE model (30B+), needs PP > 1 | Optimizer offloading — activation offloading is blocked by PP=1 |\n| Small\u002Fmedium model, PP=1 fits, activation memory dominates | Activation offloading |\n| Want tunable memory-speed tradeoff | Optimizer offloading with fractional `optimizer_offload_fraction` |\n| Throughput is top priority | Don't enable — offloading always adds overhead |\n| CUDA graphs are needed | Only optimizer offloading — activation offloading is incompatible |\n| Memory pressure is moderate | Optimizer offload at 25–50% fraction for best efficiency |\n\n## Enablement\n\n### Optimizer CPU offloading (recommended for large models)\n\n```python\ncfg.optimizer.optimizer_cpu_offload = True\ncfg.optimizer.optimizer_offload_fraction = 1.0\ncfg.optimizer.overlap_cpu_optimizer_d2h_h2d = True\n```\n\nCLI overrides:\n\n```bash\noptimizer.optimizer_cpu_offload=True \\\noptimizer.optimizer_offload_fraction=0.5 \\\noptimizer.overlap_cpu_optimizer_d2h_h2d=True\n```\n\n### Activation CPU offloading (small\u002Fmedium models only)\n\n```python\ncfg.model.cpu_offloading = True\ncfg.model.cpu_offloading_num_layers = 16\ncfg.model.cpu_offloading_activations = True\ncfg.model.cpu_offloading_weights = False\n\ncfg.model.pipeline_model_parallel_size = 1\ncfg.model.recompute_granularity = None\ncfg.model.cuda_graph_impl = \"none\"\n```\n\n## Config Parameter Reference\n\n### Optimizer offloading\n\n| Parameter | Default | Description |\n|-----------|---------|-------------|\n| `optimizer_cpu_offload` | `False` | Master switch |\n| `optimizer_offload_fraction` | `0.0` | Fraction of optimizer states on CPU (0.0–1.0) |\n| `overlap_cpu_optimizer_d2h_h2d` | `False` | Overlap GPU↔CPU transfers with compute |\n| `use_torch_optimizer_for_cpu_offload` | `False` | Use `torch.optim` instead of fused optimizer for CPU portion |\n\n### Activation offloading\n\n| Parameter | Default | Description |\n|-----------|---------|-------------|\n| `cpu_offloading` | `False` | Master switch |\n| `cpu_offloading_num_layers` | `0` | Number of transformer layers to offload (0 to num_layers-1) |\n| `cpu_offloading_activations` | `True` | Offload activations |\n| `cpu_offloading_weights` | `False` | Offload weights |\n| `cpu_offloading_double_buffering` | `False` | Double-buffer across layers while reloading |\n\n## Compatibility And Constraints\n\n### Activation offloading\n\n- `pipeline_model_parallel_size` must be 1\n- `recompute_granularity` must be `None`\n- Cannot combine with `fine_grained_activation_offloading`\n- Cannot combine with CUDA graphs\n- `cpu_offloading_num_layers` must be in `[0, num_layers-1)`\n\n### Optimizer offloading\n\n- Requires `use_distributed_optimizer = True` (default in most recipes)\n- No PP, recompute, or CUDA graph restrictions\n- `optimizer_offload_fraction` must be in `[0.0, 1.0]`\n\n### Practical: large MoE models\n\nActivation offloading is blocked for Qwen3-30B-A3B and similar large MoE\nmodels. The PP=1 constraint means each GPU holds all 48 layers; model\nweights + optimizer states alone (~70 GB) exceed H100 80 GB capacity.\n\n## Minimal Runnable Command\n\n```bash\nuv run python scripts\u002Ftraining\u002Frun_recipe.py \\\n  --recipe qwen3_30b_a3b_pretrain_config \\\n  optimizer.optimizer_cpu_offload=True \\\n  optimizer.optimizer_offload_fraction=0.5 \\\n  train.train_iters=20 \\\n  train.global_batch_size=8 \\\n  train.micro_batch_size=1\n```\n\n## Verification\n\n### Unit tests\n\n```bash\nuv run python -m pytest \\\n  tests\u002Funit_tests\u002Fmodels\u002Ftest_gpt_full_te_layer_autocast_spec.py -k \"cpu_offload\" \\\n  tests\u002Funit_tests\u002Fpeft\u002Ftest_utils.py -k \"cpu_offload\" -q\n```\n\n### Success criteria\n\n- Config validation passes for the selected offloading mode\n- Training completes without OOM or NCCL errors\n- Loss matches the non-offloaded baseline (max delta \u003C 0.001)\n- Memory usage drops proportionally to offload fraction\n\n## Code Anchors\n\n### MCore activation offload constraints\n\n```1296:1310:3rdparty\u002FMegatron-LM\u002Fmegatron\u002Fcore\u002Ftransformer\u002Ftransformer_config.py\n        if self.cpu_offloading and (\n            self.cpu_offloading_num_layers \u003C 0 or self.cpu_offloading_num_layers >= self.num_layers\n        ):\n            raise ValueError(...)\n\n        if self.cpu_offloading and self.pipeline_model_parallel_size > 1:\n            raise ValueError(\n                \"Currently there is no support for Pipeline parallelism with CPU offloading\"\n            )\n\n        if self.cpu_offloading and self.recompute_granularity is not None:\n            raise ValueError(\n                \"CPU offloading does not work when activation recomputation is enabled\"\n            )\n```\n\n### MCore CUDA graph incompatibility\n\n```1943:1944:3rdparty\u002FMegatron-LM\u002Fmegatron\u002Fcore\u002Ftransformer\u002Ftransformer_config.py\n            if self.cpu_offloading:\n                raise ValueError(\"CUDA graphs not supported with CPU offloading.\")\n```\n\n### MCore fine-grained offloading mutual exclusion\n\n```1427:1430:3rdparty\u002FMegatron-LM\u002Fmegatron\u002Fcore\u002Ftransformer\u002Ftransformer_config.py\n        if self.fine_grained_activation_offloading:\n            assert (\n                not self.cpu_offloading\n            ), \"fine_grained_activation_offloading cannot be enabled with cpu_offloading.\"\n```\n\n### MCore HybridDeviceOptimizer instantiation\n\n```480:518:3rdparty\u002FMegatron-LM\u002Fmegatron\u002Fcore\u002Foptimizer\u002F__init__.py\n        if config.optimizer_cpu_offload:\n            # ... setup cpu\u002Fgpu optimizer classes ...\n            optimizer = HybridDeviceOptimizer(\n                param_groups,\n                offload_fraction=config.optimizer_offload_fraction,\n                cpu_optimizer_cls=cpu_optimizer_cls,\n                gpu_optimizer_cls=gpu_optimizer_cls,\n                overlap_cpu_optimizer_d2h_h2d=config.overlap_cpu_optimizer_d2h_h2d,\n                pin_cpu_grads=config.pin_cpu_grads,\n                pin_cpu_params=config.pin_cpu_params,\n            )\n```\n\n### Bridge CUDA graph guard\n\n```232:234:src\u002Fmegatron\u002Fbridge\u002Fmodels\u002Fgpt_full_te_layer_autocast_spec.py\n        assert not config.cpu_offloading and config.recompute_granularity is None, \"Cudagraphs not supported\"\n```\n\n### Bridge activation offloading in PEFT\n\n```621:631:src\u002Fmegatron\u002Fbridge\u002Fpeft\u002Futils.py\n        if self.config.cpu_offloading and self.config.cpu_offloading_activations:\n            x.activation_offloading = True\n        x, _ = self.linear_in(x)\n        x = self.activation(x)\n        if self.config.cpu_offloading and self.config.cpu_offloading_activations:\n            x.activation_offloading = True\n        x, _ = self.linear_out(x)\n```\n\n## Failure Diagnosis\n\n| Symptom | Likely Cause | How To Confirm | Fix |\n|---|---|---|---|\n| `Currently there is no support for Pipeline parallelism with CPU offloading` | Activation offload + PP > 1 | Check `pipeline_model_parallel_size` | Set PP=1 or use optimizer offloading |\n| `CPU offloading does not work when activation recomputation is enabled` | Activation offload + recompute | Check `recompute_granularity` | Set `recompute_granularity=null` |\n| `fine_grained_activation_offloading cannot be enabled with cpu_offloading` | Both offloading modes enabled | Check both flags | Use one or the other |\n| `CUDA graphs not supported with CPU offloading` | CUDA graphs + activation offload | Check `cuda_graph_impl` | Set `cuda_graph_impl=\"none\"` |\n| OOM with activation offloading | Model too large for PP=1 | Check allocated memory vs 80 GB | Use optimizer offloading with PP > 1 |\n| Extreme slowdown (>4x) | 100% optimizer offload, CPU Adam bottleneck | Compare iter time at different fractions | Reduce fraction or enable `overlap_cpu_optimizer_d2h_h2d` |\n| OOM at partial optimizer offload | Insufficient offload for this config | Check memory at different fractions | Increase fraction or add PP |\n\n## Known Limitations\n\n- Activation offloading requires PP=1, making it impractical for large models\n  (30B+ MoE) that need pipeline parallelism.\n- Optimizer offloading throughput penalty scales linearly (~1.9x at 25%,\n  ~4.2x at 100% for Qwen3-30B-A3B).\n- D2H\u002FH2D overlap provides only ~7% speedup because CPU Adam compute is\n  the dominant bottleneck.\n- `fine_grained_activation_offloading` is a separate module-level approach\n  that works with PP > 1 but cannot be combined with layer-level\n  `cpu_offloading`.\n",{"name":5,"license":15,"description":7,"when_to_use":24},"Enabling CPU offload to reduce GPU memory, or investigating a commit that changed CPU offloading config and caused OOM or a crash; 'cpu_offloading', 'optimizer_cpu_offload', 'optimizer_offload_fraction', 'HybridDeviceOptimizer', 'move optimizer to CPU'.","main","c475fc64e94e803b50d14a791dfee8853fbb2c5c","skills\u002Fnvidia\u002Fnemo-mbridge-perf-cpu-offloading","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory","https:\u002F\u002Fgithub.com\u002FElogic360","2026-11-08 22:21:22",{"source":8,"skillName":5,"commands":32,"prompt":42,"zipAvailable":43},[33,36,39],{"tool":34,"command":35},"npx","npx skills add Elogic360\u002Fsoftware-factory --skill nemo-mbridge-perf-cpu-offloading",{"tool":37,"command":38},"bunx","bunx skills add Elogic360\u002Fsoftware-factory --skill nemo-mbridge-perf-cpu-offloading",{"tool":40,"command":41},"pnpm","pnpm dlx skills add Elogic360\u002Fsoftware-factory --skill nemo-mbridge-perf-cpu-offloading","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fnemo-mbridge-perf-cpu-offloading\u002FSKILL.md",true,[45,51,55,59,63],{"path":46,"resourceType":47,"resourceTypeDesc":48,"sizeBytes":49,"sourceHtmlUrl":50},"BENCHMARK.md","REFERENCE","参考文档",4307,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fnemo-mbridge-perf-cpu-offloading\u002FBENCHMARK.md",{"path":52,"resourceType":47,"resourceTypeDesc":48,"sizeBytes":53,"sourceHtmlUrl":54},"card.yaml",8241,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fnemo-mbridge-perf-cpu-offloading\u002Fcard.yaml",{"path":56,"resourceType":47,"resourceTypeDesc":48,"sizeBytes":57,"sourceHtmlUrl":58},"evals\u002Fevals.json",1475,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fnemo-mbridge-perf-cpu-offloading\u002Fevals\u002Fevals.json",{"path":60,"resourceType":47,"resourceTypeDesc":48,"sizeBytes":61,"sourceHtmlUrl":62},"skill-card.md",3916,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fnemo-mbridge-perf-cpu-offloading\u002Fskill-card.md",{"path":64,"resourceType":65,"resourceTypeDesc":66,"sizeBytes":67,"sourceHtmlUrl":68},"skill.oms.sig","OTHER","其他",4821,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fnemo-mbridge-perf-cpu-offloading\u002Fskill.oms.sig",[70,77,84,91,98,105],{"skillNo":71,"name":72,"nameZh":6,"description":73,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":74,"categories":75,"keywords":76,"publishedAt":19},"01M79G206MT3J6S0GY3C45P2KV","vss-summarize-video","Use to summarize a recorded video via the LVS summarization microservice (HITL-gated) with a VLM fallback. Not for report generation or live RTSP captioning.","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fvss-summarize-video\u002FSKILL.md",[],[],{"skillNo":78,"name":79,"nameZh":6,"description":80,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":81,"categories":82,"keywords":83,"publishedAt":19},"01M79G1WN63PGRE8CKD47WEBQ5","vss-setup-video-analytics-api","Use to deploy the vss-video-analytics-api REST service standalone (config-source, data-log bind, Elasticsearch, optional Kafka). Not for full warehouse deploy.","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fvss-setup-video-analytics-api\u002FSKILL.md",[],[],{"skillNo":85,"name":86,"nameZh":6,"description":87,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":88,"categories":89,"keywords":90,"publishedAt":19},"01M79G1S9F7VY3EF6H53PRP5AN","vss-setup-behavior-analytics","Use to deploy the vss-behavior-analytics service standalone (entrypoint, config-source, optional calibration). Not for the full warehouse deploy.","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fvss-setup-behavior-analytics\u002FSKILL.md",[],[],{"skillNo":92,"name":93,"nameZh":6,"description":94,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":95,"categories":96,"keywords":97,"publishedAt":19},"01M79G1N1S1Y27PFZPYMNK1MTQ","vss-search-archive","Use this skill to run top-level VSS fusion search on archived video, or to ingest video files \u002F RTSP streams for search. Do NOT use for ad-hoc visual Q&A (use vss-ask-video), live captioning (use vss-deploy-dense-captioning), or video summarization and reports (use vss-summarize-video).","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fvss-search-archive\u002FSKILL.md",[],[],{"skillNo":99,"name":100,"nameZh":6,"description":101,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":102,"categories":103,"keywords":104,"publishedAt":19},"01M79G1H6WN0Q6C0VCAXCZX6B7","vss-query-analytics","Use this skill when reading video-analytics metrics, incidents, alerts, and sensor data via the VA-MCP server (port 9901). Not for live VLM or incident-range narrative reports.","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fvss-query-analytics\u002FSKILL.md",[],[],{"skillNo":106,"name":107,"nameZh":6,"description":108,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":109,"categories":110,"keywords":111,"publishedAt":19},"01M79G1DYPNXQS7QHZ0AAF5FX5","vss-manage-video-io-storage","Use to call the VIOS REST API (sensor list, timelines, clip extraction, snapshots, add\u002Fdelete sensors and streams). Not for VLM inference or search.","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fvss-manage-video-io-storage\u002FSKILL.md",[],[]]