[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M79FWCTZPNDKH7255VDKJ5XF":3,"skill-same:01M79FWCTZPNDKH7255VDKJ5XF":145},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":31,"commitSha":32,"skillDirectory":33,"forksCount":14,"repositoryHtmlUrl":34,"repositoryHomepageUrl":6,"ownerHtmlUrl":35,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":36,"install":37,"resources":50},"01M79FWCTZPNDKH7255VDKJ5XF","tao-train-mask2former",null,"Mask2Former for universal image segmentation (panoptic, instance, and semantic). Transformer-based with masked attention for high-quality segmentation results. Use when training, evaluating, exporting, quantizing, or running inference for a TAO Mask2Former model. Trigger phrases include \"train Mask2Former\", \"universal segmentation\", \"panoptic \u002F instance \u002F semantic segmentation\", \"masked-attention transformer segmenter\".","Elogic360\u002Fsoftware-factory","Elogic360","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F156535519?v=4","01M74NH3F0RB13PWB7JZDE2V80","elogic360","01M74NH3FPC65082MDZVMFHDM3",0,"Apache-2.0","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: tao-train-mask2former\ndescription: Mask2Former for universal image segmentation (panoptic, instance, and semantic). Transformer-based with\n  masked attention for high-quality segmentation results. Use when training, evaluating, exporting, quantizing, or running\n  inference for a TAO Mask2Former model. Trigger phrases include \"train Mask2Former\", \"universal segmentation\",\n  \"panoptic \u002F instance \u002F semantic segmentation\", \"masked-attention transformer segmenter\".\nlicense: Apache-2.0\ncompatibility: Requires docker + nvidia-container-toolkit.\nmetadata:\n  version: \"0.1.0\"\n  author: NVIDIA Corporation\nallowed-tools: Read Bash\ntags:\n- segmentation\n---\n\n# Mask2Former\n\nMask2Former for universal image segmentation (panoptic, instance, and semantic). Transformer-based with masked attention for high-quality segmentation results.\n\nSet model.backbone.pretrained_weights for Swin backbone weights.\n\nFor TAO Deploy TensorRT actions (`gen_trt_engine`, TensorRT `evaluate`, and TensorRT `inference`), read `references\u002Ftao-deploy-mask2former.md` first. Deploy spec templates live in this skill's `references\u002F` folder with the `spec_template_deploy_*.yaml` prefix.\n\n## Dataclass Schemas\n\nGenerated TAO Core schemas are packaged in `schemas\u002F\u003Caction>.schema.json`, with `schemas\u002Fmanifest.json` listing available actions. Each generated schema also emits `references\u002Fspec_template_\u003Caction>.yaml` from the schema top-level `default` field. AutoML enablement is declared at the model layer in `references\u002Fskill_info.yaml` via `automl_enabled`. Runnable AutoML still requires `schemas\u002Ftrain.schema.json` and `references\u002Fspec_template_train.yaml` to exist and parse. Use the packaged train schema for `automl_default_parameters`, `automl_disabled_parameters`, defaults, min\u002Fmax bounds, enums, option weights, math conditions, dependencies, and popular parameters. Do not expect `~\u002Ftao-core` at runtime; maintainers regenerate schemas\u002Ftemplates before packaging the skill bank.\n\n## Train Action Policy\n\nThis model is AutoML-enabled at the model layer. Before handling any train-stage request, read `references\u002Fskill_info.yaml` and resolve the run override from either an explicit `automl_policy` value or the user's workflow request. Treat phrases like \"turn off AutoML\", \"disable AutoML\", \"no HPO\", or \"plain training\" as `automl_policy: off` for this run only; otherwise default to `auto`. When `automl_policy: auto`, `automl_enabled: true`, and both `schemas\u002Ftrain.schema.json` and `references\u002Fspec_template_train.yaml` are packaged, route the train action through `tao-skill-bank:tao-run-automl` by default with this model's `skill_dir`. Preserve workflow\u002Fapplication overrides for datasets, specs, output directories, GPU\u002Fplatform settings, parent checkpoints, and `automl_policy`. Use direct model training only when `automl_policy: off` or the packaged train schema\u002Ftemplate is missing; in the missing-schema case, report that AutoML is enabled but not runnable for this model until schemas are generated.\n\nNon-train actions such as `evaluate`, `inference`, `export`, and deploy flows stay in this model skill. The per-run `automl_policy` override does not change model metadata.\n\n## Training Requirements\n\n- **Dataset type:** segmentation\n- **Formats:** coco_panoptic, coco\n- **Monitoring metric:** mIoU\n\n### Per-Action Dataset Requirements\n\n| Action | Spec Key | Source | Files | List? |\n|---|---|---|---|---|\n| evaluate | dataset.train.img_dir | train_datasets | images.tar.gz | No |\n| evaluate | dataset.label_map | train_datasets | coco_panoptic: label_map_panoptic.json; *: label_map.json | No |\n| evaluate | dataset.train.instance_json | train_datasets | annotations.json | No |\n| evaluate | dataset.train.panoptic_json | train_datasets | annotations_panoptic.json | No |\n| evaluate | dataset.train.panoptic_dir | train_datasets | images_panoptic.tar.gz | No |\n| evaluate | dataset.val.img_dir | eval_dataset | images.tar.gz | No |\n| evaluate | dataset.val.instance_json | eval_dataset | annotations.json | No |\n| evaluate | dataset.val.panoptic_json | eval_dataset | annotations_panoptic.json | No |\n| evaluate | dataset.val.panoptic_dir | eval_dataset | images_panoptic.tar.gz | No |\n| evaluate | dataset.test.img_dir | eval_dataset | images.tar.gz | No |\n| inference | dataset.train.img_dir | train_datasets | images.tar.gz | No |\n| inference | dataset.label_map | train_datasets | coco_panoptic: label_map_panoptic.json; *: label_map.json | No |\n| inference | dataset.train.instance_json | train_datasets | annotations.json | No |\n| inference | dataset.train.panoptic_json | train_datasets | annotations_panoptic.json | No |\n| inference | dataset.train.panoptic_dir | train_datasets | images_panoptic.tar.gz | No |\n| inference | dataset.val.img_dir | eval_dataset | images.tar.gz | No |\n| inference | dataset.val.instance_json | eval_dataset | annotations.json | No |\n| inference | dataset.val.panoptic_json | eval_dataset | annotations_panoptic.json | No |\n| inference | dataset.val.panoptic_dir | eval_dataset | images_panoptic.tar.gz | No |\n| inference | dataset.test.img_dir | eval_dataset | images.tar.gz | No |\n| quantize | dataset.train.img_dir | train_datasets | images.tar.gz | No |\n| quantize | dataset.label_map | train_datasets | coco_panoptic: label_map_panoptic.json; *: label_map.json | No |\n| quantize | dataset.train.instance_json | train_datasets | annotations.json | No |\n| quantize | dataset.train.panoptic_json | train_datasets | annotations_panoptic.json | No |\n| quantize | dataset.train.panoptic_dir | train_datasets | images_panoptic.tar.gz | No |\n| quantize | dataset.val.img_dir | eval_dataset | images.tar.gz | No |\n| quantize | dataset.val.instance_json | eval_dataset | annotations.json | No |\n| quantize | dataset.val.panoptic_json | eval_dataset | annotations_panoptic.json | No |\n| quantize | dataset.val.panoptic_dir | eval_dataset | images_panoptic.tar.gz | No |\n| quantize | dataset.test.img_dir | eval_dataset | images.tar.gz | No |\n| quantize | dataset.quant_calibration_dataset.images_dir | train_datasets | images.tar.gz | No |\n| train | dataset.train.img_dir | train_datasets | images.tar.gz | No |\n| train | dataset.label_map | train_datasets | coco_panoptic: label_map_panoptic.json; *: label_map.json | No |\n| train | dataset.train.instance_json | train_datasets | annotations.json | No |\n| train | dataset.train.panoptic_json | train_datasets | annotations_panoptic.json | No |\n| train | dataset.train.panoptic_dir | train_datasets | images_panoptic.tar.gz | No |\n| train | dataset.val.img_dir | eval_dataset | images.tar.gz | No |\n| train | dataset.val.instance_json | eval_dataset | annotations.json | No |\n| train | dataset.val.panoptic_json | eval_dataset | annotations_panoptic.json | No |\n| train | dataset.val.panoptic_dir | eval_dataset | images_panoptic.tar.gz | No |\n| train | dataset.test.img_dir | eval_dataset | images.tar.gz | No |\n\n### Typical Spec Overrides\n\nData source overrides are **mandatory for every action** — the agent MUST construct data source paths from the Per-Action Dataset Requirements table above and include them in `spec_overrides`.\n\n```python\nS3_TRAIN = \"s3:\u002F\u002Fbucket\u002Fdata\u002Ftrain\"\nS3_EVAL = \"s3:\u002F\u002Fbucket\u002Fdata\u002Feval\"\n```\n\n**train (mandatory data sources):**\n```python\n{\n    \"train.num_gpus\": 1,\n    \"train.num_epochs\": 10,\n    \"train.checkpoint_interval\": 10,\n    \"train.validation_interval\": 10,\n    \"model.sem_seg_head.num_classes\": 90,\n    \"dataset.contiguous_id\": True,\n    \"dataset.train.img_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.label_map\": {\"coco_panoptic\": f\"{S3_TRAIN}\u002Flabel_map_panoptic.json; *: label_map.json\"},\n    \"dataset.train.instance_json\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.train.panoptic_json\": f\"{S3_TRAIN}\u002Fannotations_panoptic.json\",\n    \"dataset.train.panoptic_dir\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.instance_json\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic_json\": f\"{S3_EVAL}\u002Fannotations_panoptic.json\",\n    \"dataset.val.panoptic_dir\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n}\n```\n\n**evaluate (mandatory data sources):**\n```python\n{\n    \"model.sem_seg_head.num_classes\": 90,\n    \"dataset.contiguous_id\": True,\n    \"dataset.train.img_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.label_map\": {\"coco_panoptic\": f\"{S3_TRAIN}\u002Flabel_map_panoptic.json; *: label_map.json\"},\n    \"dataset.train.instance_json\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.train.panoptic_json\": f\"{S3_TRAIN}\u002Fannotations_panoptic.json\",\n    \"dataset.train.panoptic_dir\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.instance_json\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic_json\": f\"{S3_EVAL}\u002Fannotations_panoptic.json\",\n    \"dataset.val.panoptic_dir\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n}\n```\n\n**export:**\n```python\n{\n    \"model.sem_seg_head.num_classes\": 90,\n}\n```\n\n**inference (mandatory data sources):**\n```python\n{\n    \"model.sem_seg_head.num_classes\": 90,\n    \"dataset.contiguous_id\": True,\n    \"dataset.train.img_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.label_map\": {\"coco_panoptic\": f\"{S3_TRAIN}\u002Flabel_map_panoptic.json; *: label_map.json\"},\n    \"dataset.train.instance_json\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.train.panoptic_json\": f\"{S3_TRAIN}\u002Fannotations_panoptic.json\",\n    \"dataset.train.panoptic_dir\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.instance_json\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic_json\": f\"{S3_EVAL}\u002Fannotations_panoptic.json\",\n    \"dataset.val.panoptic_dir\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n}\n```\n\n**quantize (mandatory data sources):**\n```python\n{\n    \"dataset.train.img_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.label_map\": {\"coco_panoptic\": f\"{S3_TRAIN}\u002Flabel_map_panoptic.json; *: label_map.json\"},\n    \"dataset.train.instance_json\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.train.panoptic_json\": f\"{S3_TRAIN}\u002Fannotations_panoptic.json\",\n    \"dataset.train.panoptic_dir\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.instance_json\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic_json\": f\"{S3_EVAL}\u002Fannotations_panoptic.json\",\n    \"dataset.val.panoptic_dir\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.quant_calibration_dataset.images_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n}\n```\n## Eval Dataset\n\nOptional. Val data sources are part of the dataset config alongside train.\n\n## Important Parameters\n\n- **model.sem_seg_head.num_classes**: Number of segmentation classes. Default 200. Must match your annotation categories.\n- **model.backbone.swin.type**: Swin Transformer variant. Default tiny. Options include tiny, small, base, large.\n- **model.mode**: Segmentation mode. Default panoptic. Options: panoptic, instance, semantic.\n- **train.optim.lr**: Learning rate. Default 2e-4 (AdamW).\n- **dataset.train.batch_size**: Per-GPU batch size. Default 1. Mask2Former is memory-intensive due to per-pixel predictions.\n\n## Multi-GPU \u002F Multi-Node\n\n**Launch method:** Lightning-managed (single `python` process, Lightning spawns workers).\n\n| Spec Key | Description | Default |\n|----------|-------------|---------|\n| `train.num_gpus` | Number of GPUs | 1 |\n| `train.gpu_ids` | GPU device indices | [0] |\n| `train.num_nodes` | Number of nodes | 1 |\n| `train.distributed_strategy` | `ddp` or `fsdp` | `ddp` |\n\n- Same DDP\u002FFSDP behavior as DINO (activation checkpoint aware)\n- FAN backbones auto-enable `sync_batchnorm`\n- `fsdp` forces FP16\n\n**Multi-node env vars** (set by orchestrator): `WORLD_SIZE`, `NODE_RANK`, `MASTER_ADDR`, `MASTER_PORT`, `NUM_GPU_PER_NODE`.\n\n## Export \u002F TRT Defaults\n\n- TRT data types: FP32, FP16 only — **INT8 is NOT supported**\n\nFull TAO Deploy reference: [tao-deploy-mask2former](references\u002Ftao-deploy-mask2former.md).\n\n## Hardware\n\nMinimum 1 GPU(s), recommended 4 GPU(s). 24GB+ (A100 recommended) VRAM per GPU. Mask2Former is memory-heavy. batch_size=1 is the default for good reason. Multi-GPU recommended for reasonable training speed.\n\n## Error Patterns\n\n**CUDA out of memory**: batch_size is already 1 by default. Reduce image resolution in augmentation config or use a smaller Swin variant.\n\n**Panoptic vs instance format mismatch**: Ensure you provide the correct annotation format matching model.mode setting.\n\n## Spec Param \u002F Parent Model Inference\n\nModel-specific inference mappings belong in this MD file, not in `config.json`. Generated runners should read this section and apply the mappings with SDK helpers before `create_job()`. This mirrors the old microservices `infer_params.py` flow.\n\nInference mappings from TAO Core `mask2former.config.json`:\n\n| Action | Spec Field | Inference Function | Meaning |\n|---|---|---|---|\n| evaluate | `encryption_key` | `key` | encryption key |\n| evaluate | `evaluate.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| evaluate | `evaluate.trt_engine` | `parent_model` | model file inferred from the parent job results folder |\n| evaluate | `results_dir` | `output_dir` | current job results directory |\n| export | `encryption_key` | `key` | encryption key |\n| export | `export.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| export | `export.onnx_file` | `create_onnx_file` | output ONNX path |\n| export | `results_dir` | `output_dir` | current job results directory |\n| gen_trt_engine | `encryption_key` | `key` | encryption key |\n| gen_trt_engine | `gen_trt_engine.onnx_file` | `parent_model` | model file inferred from the parent job results folder |\n| gen_trt_engine | `gen_trt_engine.trt_engine` | `create_engine_file` | output TensorRT engine path |\n| gen_trt_engine | `results_dir` | `output_dir` | current job results directory |\n| inference | `encryption_key` | `key` | encryption key |\n| inference | `inference.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| inference | `inference.trt_engine` | `parent_model` | model file inferred from the parent job results folder |\n| inference | `results_dir` | `output_dir` | current job results directory |\n| quantize | `encryption_key` | `key` | encryption key |\n| quantize | `quantize.model_path` | `parent_model` | model file inferred from the parent job results folder |\n| quantize | `results_dir` | `output_dir` | current job results directory |\n| train | `encryption_key` | `key` | encryption key |\n| train | `model.backbone.pretrained_weights` | `{'link': 'https:\u002F\u002Fgithub.com\u002FSwinTransformer\u002Fstorage\u002Freleases\u002Fdownload\u002Fv1.0.8\u002Fswin_tiny_patch4_window7_224_22k.pth', 'destination_path': '\u002Fptm\u002Fmask2former\u002Fswin_tiny_patch4_window7_224_22k\u002Fswin_tiny_patch4_window7_224_22k.pth'}` | {'link': 'https:\u002F\u002Fgithub.com\u002FSwinTransformer\u002Fstorage\u002Freleases\u002Fdownload\u002Fv1.0.8\u002Fswin_tiny_patch4_window7_224_22k.pth', 'destination_path': '\u002Fptm\u002Fmask2former\u002Fswin_tiny_patch4_window7_224_22k\u002Fswin_tiny_patch4_window7_224_22k.pth'} |\n| train | `results_dir` | `output_dir` | current job results directory |\n| train | `train.resume_training_checkpoint_path` | `resume_model` | model file inferred from the current job results folder |\n\nFor `parent_model` or `parent_model_folder`, pass the upstream train\u002Fexport\u002FAutoML child job id as `parent_job_id`. The SDK lists the parent result folder, filters checkpoint artifacts, and returns the selected model file or folder. Do not add these mappings back to `config.json` and do not patch generated runner scripts to guess checkpoint paths.\n","# Mask2Former\n\nMask2Former for universal image segmentation (panoptic, instance, and semantic). Transformer-based with masked attention for high-quality segmentation results.\n\nSet model.backbone.pretrained_weights for Swin backbone weights.\n\nFor TAO Deploy TensorRT actions (`gen_trt_engine`, TensorRT `evaluate`, and TensorRT `inference`), read `references\u002Ftao-deploy-mask2former.md` first. Deploy spec templates live in this skill's `references\u002F` folder with the `spec_template_deploy_*.yaml` prefix.\n\n## Dataclass Schemas\n\nGenerated TAO Core schemas are packaged in `schemas\u002F\u003Caction>.schema.json`, with `schemas\u002Fmanifest.json` listing available actions. Each generated schema also emits `references\u002Fspec_template_\u003Caction>.yaml` from the schema top-level `default` field. AutoML enablement is declared at the model layer in `references\u002Fskill_info.yaml` via `automl_enabled`. Runnable AutoML still requires `schemas\u002Ftrain.schema.json` and `references\u002Fspec_template_train.yaml` to exist and parse. Use the packaged train schema for `automl_default_parameters`, `automl_disabled_parameters`, defaults, min\u002Fmax bounds, enums, option weights, math conditions, dependencies, and popular parameters. Do not expect `~\u002Ftao-core` at runtime; maintainers regenerate schemas\u002Ftemplates before packaging the skill bank.\n\n## Train Action Policy\n\nThis model is AutoML-enabled at the model layer. Before handling any train-stage request, read `references\u002Fskill_info.yaml` and resolve the run override from either an explicit `automl_policy` value or the user's workflow request. Treat phrases like \"turn off AutoML\", \"disable AutoML\", \"no HPO\", or \"plain training\" as `automl_policy: off` for this run only; otherwise default to `auto`. When `automl_policy: auto`, `automl_enabled: true`, and both `schemas\u002Ftrain.schema.json` and `references\u002Fspec_template_train.yaml` are packaged, route the train action through `tao-skill-bank:tao-run-automl` by default with this model's `skill_dir`. Preserve workflow\u002Fapplication overrides for datasets, specs, output directories, GPU\u002Fplatform settings, parent checkpoints, and `automl_policy`. Use direct model training only when `automl_policy: off` or the packaged train schema\u002Ftemplate is missing; in the missing-schema case, report that AutoML is enabled but not runnable for this model until schemas are generated.\n\nNon-train actions such as `evaluate`, `inference`, `export`, and deploy flows stay in this model skill. The per-run `automl_policy` override does not change model metadata.\n\n## Training Requirements\n\n- **Dataset type:** segmentation\n- **Formats:** coco_panoptic, coco\n- **Monitoring metric:** mIoU\n\n### Per-Action Dataset Requirements\n\n| Action | Spec Key | Source | Files | List? |\n|---|---|---|---|---|\n| evaluate | dataset.train.img_dir | train_datasets | images.tar.gz | No |\n| evaluate | dataset.label_map | train_datasets | coco_panoptic: label_map_panoptic.json; *: label_map.json | No |\n| evaluate | dataset.train.instance_json | train_datasets | annotations.json | No |\n| evaluate | dataset.train.panoptic_json | train_datasets | annotations_panoptic.json | No |\n| evaluate | dataset.train.panoptic_dir | train_datasets | images_panoptic.tar.gz | No |\n| evaluate | dataset.val.img_dir | eval_dataset | images.tar.gz | No |\n| evaluate | dataset.val.instance_json | eval_dataset | annotations.json | No |\n| evaluate | dataset.val.panoptic_json | eval_dataset | annotations_panoptic.json | No |\n| evaluate | dataset.val.panoptic_dir | eval_dataset | images_panoptic.tar.gz | No |\n| evaluate | dataset.test.img_dir | eval_dataset | images.tar.gz | No |\n| inference | dataset.train.img_dir | train_datasets | images.tar.gz | No |\n| inference | dataset.label_map | train_datasets | coco_panoptic: label_map_panoptic.json; *: label_map.json | No |\n| inference | dataset.train.instance_json | train_datasets | annotations.json | No |\n| inference | dataset.train.panoptic_json | train_datasets | annotations_panoptic.json | No |\n| inference | dataset.train.panoptic_dir | train_datasets | images_panoptic.tar.gz | No |\n| inference | dataset.val.img_dir | eval_dataset | images.tar.gz | No |\n| inference | dataset.val.instance_json | eval_dataset | annotations.json | No |\n| inference | dataset.val.panoptic_json | eval_dataset | annotations_panoptic.json | No |\n| inference | dataset.val.panoptic_dir | eval_dataset | images_panoptic.tar.gz | No |\n| inference | dataset.test.img_dir | eval_dataset | images.tar.gz | No |\n| quantize | dataset.train.img_dir | train_datasets | images.tar.gz | No |\n| quantize | dataset.label_map | train_datasets | coco_panoptic: label_map_panoptic.json; *: label_map.json | No |\n| quantize | dataset.train.instance_json | train_datasets | annotations.json | No |\n| quantize | dataset.train.panoptic_json | train_datasets | annotations_panoptic.json | No |\n| quantize | dataset.train.panoptic_dir | train_datasets | images_panoptic.tar.gz | No |\n| quantize | dataset.val.img_dir | eval_dataset | images.tar.gz | No |\n| quantize | dataset.val.instance_json | eval_dataset | annotations.json | No |\n| quantize | dataset.val.panoptic_json | eval_dataset | annotations_panoptic.json | No |\n| quantize | dataset.val.panoptic_dir | eval_dataset | images_panoptic.tar.gz | No |\n| quantize | dataset.test.img_dir | eval_dataset | images.tar.gz | No |\n| quantize | dataset.quant_calibration_dataset.images_dir | train_datasets | images.tar.gz | No |\n| train | dataset.train.img_dir | train_datasets | images.tar.gz | No |\n| train | dataset.label_map | train_datasets | coco_panoptic: label_map_panoptic.json; *: label_map.json | No |\n| train | dataset.train.instance_json | train_datasets | annotations.json | No |\n| train | dataset.train.panoptic_json | train_datasets | annotations_panoptic.json | No |\n| train | dataset.train.panoptic_dir | train_datasets | images_panoptic.tar.gz | No |\n| train | dataset.val.img_dir | eval_dataset | images.tar.gz | No |\n| train | dataset.val.instance_json | eval_dataset | annotations.json | No |\n| train | dataset.val.panoptic_json | eval_dataset | annotations_panoptic.json | No |\n| train | dataset.val.panoptic_dir | eval_dataset | images_panoptic.tar.gz | No |\n| train | dataset.test.img_dir | eval_dataset | images.tar.gz | No |\n\n### Typical Spec Overrides\n\nData source overrides are **mandatory for every action** — the agent MUST construct data source paths from the Per-Action Dataset Requirements table above and include them in `spec_overrides`.\n\n```python\nS3_TRAIN = \"s3:\u002F\u002Fbucket\u002Fdata\u002Ftrain\"\nS3_EVAL = \"s3:\u002F\u002Fbucket\u002Fdata\u002Feval\"\n```\n\n**train (mandatory data sources):**\n```python\n{\n    \"train.num_gpus\": 1,\n    \"train.num_epochs\": 10,\n    \"train.checkpoint_interval\": 10,\n    \"train.validation_interval\": 10,\n    \"model.sem_seg_head.num_classes\": 90,\n    \"dataset.contiguous_id\": True,\n    \"dataset.train.img_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.label_map\": {\"coco_panoptic\": f\"{S3_TRAIN}\u002Flabel_map_panoptic.json; *: label_map.json\"},\n    \"dataset.train.instance_json\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.train.panoptic_json\": f\"{S3_TRAIN}\u002Fannotations_panoptic.json\",\n    \"dataset.train.panoptic_dir\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.instance_json\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic_json\": f\"{S3_EVAL}\u002Fannotations_panoptic.json\",\n    \"dataset.val.panoptic_dir\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n}\n```\n\n**evaluate (mandatory data sources):**\n```python\n{\n    \"model.sem_seg_head.num_classes\": 90,\n    \"dataset.contiguous_id\": True,\n    \"dataset.train.img_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.label_map\": {\"coco_panoptic\": f\"{S3_TRAIN}\u002Flabel_map_panoptic.json; *: label_map.json\"},\n    \"dataset.train.instance_json\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.train.panoptic_json\": f\"{S3_TRAIN}\u002Fannotations_panoptic.json\",\n    \"dataset.train.panoptic_dir\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.instance_json\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic_json\": f\"{S3_EVAL}\u002Fannotations_panoptic.json\",\n    \"dataset.val.panoptic_dir\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n}\n```\n\n**export:**\n```python\n{\n    \"model.sem_seg_head.num_classes\": 90,\n}\n```\n\n**inference (mandatory data sources):**\n```python\n{\n    \"model.sem_seg_head.num_classes\": 90,\n    \"dataset.contiguous_id\": True,\n    \"dataset.train.img_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.label_map\": {\"coco_panoptic\": f\"{S3_TRAIN}\u002Flabel_map_panoptic.json; *: label_map.json\"},\n    \"dataset.train.instance_json\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.train.panoptic_json\": f\"{S3_TRAIN}\u002Fannotations_panoptic.json\",\n    \"dataset.train.panoptic_dir\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.instance_json\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic_json\": f\"{S3_EVAL}\u002Fannotations_panoptic.json\",\n    \"dataset.val.panoptic_dir\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n}\n```\n\n**quantize (mandatory data sources):**\n```python\n{\n    \"dataset.train.img_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.label_map\": {\"coco_panoptic\": f\"{S3_TRAIN}\u002Flabel_map_panoptic.json; *: label_map.json\"},\n    \"dataset.train.instance_json\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.train.panoptic_json\": f\"{S3_TRAIN}\u002Fannotations_panoptic.json\",\n    \"dataset.train.panoptic_dir\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.instance_json\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic_json\": f\"{S3_EVAL}\u002Fannotations_panoptic.json\",\n    \"dataset.val.panoptic_dir\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.img_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.quant_calibration_dataset.images_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n}\n```\n## Eval Dataset\n\nOptional. Val data sources are part of the dataset config alongside train.\n\n## Important Parameters\n\n- **model.sem_seg_head.num_classes**: Number of segmentation classes. Default 200. Must match your annotation categories.\n- **model.backbone.swin.type**: Swin Transformer variant. Default tiny. Options include tiny, small, base, large.\n- **model.mode**: Segmentation mode. Default panoptic. Options: panoptic, instance, semantic.\n- **train.optim.lr**: Learning rate. Default 2e-4 (AdamW).\n- **dataset.train.batch_size**: Per-GPU batch size. Default 1. Mask2Former is memory-intensive due to per-pixel predictions.\n\n## Multi-GPU \u002F Multi-Node\n\n**Launch method:** Lightning-managed (single `python` process, Lightning spawns workers).\n\n| Spec Key | Description | Default |\n|----------|-------------|---------|\n| `train.num_gpus` | Number of GPUs | 1 |\n| `train.gpu_ids` | GPU device indices | [0] |\n| `train.num_nodes` | Number of nodes | 1 |\n| `train.distributed_strategy` | `ddp` or `fsdp` | `ddp` |\n\n- Same DDP\u002FFSDP behavior as DINO (activation checkpoint aware)\n- FAN backbones auto-enable `sync_batchnorm`\n- `fsdp` forces FP16\n\n**Multi-node env vars** (set by orchestrator): `WORLD_SIZE`, `NODE_RANK`, `MASTER_ADDR`, `MASTER_PORT`, `NUM_GPU_PER_NODE`.\n\n## Export \u002F TRT Defaults\n\n- TRT data types: FP32, FP16 only — **INT8 is NOT supported**\n\nFull TAO Deploy reference: [tao-deploy-mask2former](references\u002Ftao-deploy-mask2former.md).\n\n## Hardware\n\nMinimum 1 GPU(s), recommended 4 GPU(s). 24GB+ (A100 recommended) VRAM per GPU. Mask2Former is memory-heavy. batch_size=1 is the default for good reason. Multi-GPU recommended for reasonable training speed.\n\n## Error Patterns\n\n**CUDA out of memory**: batch_size is already 1 by default. Reduce image resolution in augmentation config or use a smaller Swin variant.\n\n**Panoptic vs instance format mismatch**: Ensure you provide the correct annotation format matching model.mode setting.\n\n## Spec Param \u002F Parent Model Inference\n\nModel-specific inference mappings belong in this MD file, not in `config.json`. Generated runners should read this section and apply the mappings with SDK helpers before `create_job()`. This mirrors the old microservices `infer_params.py` flow.\n\nInference mappings from TAO Core `mask2former.config.json`:\n\n| Action | Spec Field | Inference Function | Meaning |\n|---|---|---|---|\n| evaluate | `encryption_key` | `key` | encryption key |\n| evaluate | `evaluate.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| evaluate | `evaluate.trt_engine` | `parent_model` | model file inferred from the parent job results folder |\n| evaluate | `results_dir` | `output_dir` | current job results directory |\n| export | `encryption_key` | `key` | encryption key |\n| export | `export.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| export | `export.onnx_file` | `create_onnx_file` | output ONNX path |\n| export | `results_dir` | `output_dir` | current job results directory |\n| gen_trt_engine | `encryption_key` | `key` | encryption key |\n| gen_trt_engine | `gen_trt_engine.onnx_file` | `parent_model` | model file inferred from the parent job results folder |\n| gen_trt_engine | `gen_trt_engine.trt_engine` | `create_engine_file` | output TensorRT engine path |\n| gen_trt_engine | `results_dir` | `output_dir` | current job results directory |\n| inference | `encryption_key` | `key` | encryption key |\n| inference | `inference.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| inference | `inference.trt_engine` | `parent_model` | model file inferred from the parent job results folder |\n| inference | `results_dir` | `output_dir` | current job results directory |\n| quantize | `encryption_key` | `key` | encryption key |\n| quantize | `quantize.model_path` | `parent_model` | model file inferred from the parent job results folder |\n| quantize | `results_dir` | `output_dir` | current job results directory |\n| train | `encryption_key` | `key` | encryption key |\n| train | `model.backbone.pretrained_weights` | `{'link': 'https:\u002F\u002Fgithub.com\u002FSwinTransformer\u002Fstorage\u002Freleases\u002Fdownload\u002Fv1.0.8\u002Fswin_tiny_patch4_window7_224_22k.pth', 'destination_path': '\u002Fptm\u002Fmask2former\u002Fswin_tiny_patch4_window7_224_22k\u002Fswin_tiny_patch4_window7_224_22k.pth'}` | {'link': 'https:\u002F\u002Fgithub.com\u002FSwinTransformer\u002Fstorage\u002Freleases\u002Fdownload\u002Fv1.0.8\u002Fswin_tiny_patch4_window7_224_22k.pth', 'destination_path': '\u002Fptm\u002Fmask2former\u002Fswin_tiny_patch4_window7_224_22k\u002Fswin_tiny_patch4_window7_224_22k.pth'} |\n| train | `results_dir` | `output_dir` | current job results directory |\n| train | `train.resume_training_checkpoint_path` | `resume_model` | model file inferred from the current job results folder |\n\nFor `parent_model` or `parent_model_folder`, pass the upstream train\u002Fexport\u002FAutoML child job id as `parent_job_id`. The SDK lists the parent result folder, filters checkpoint artifacts, and returns the selected model file or folder. Do not add these mappings back to `config.json` and do not patch generated runner scripts to guess checkpoint paths.\n",{"name":5,"tags":24,"license":15,"metadata":26,"description":7,"allowed-tools":29,"compatibility":30},[25],"segmentation",{"author":27,"version":28},"NVIDIA Corporation","0.1.0","Read Bash","Requires docker + nvidia-container-toolkit.","main","c475fc64e94e803b50d14a791dfee8853fbb2c5c","skills\u002Fnvidia\u002Ftao-train-mask2former","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory","https:\u002F\u002Fgithub.com\u002FElogic360","2026-11-08 22:21:22",{"source":8,"skillName":5,"commands":38,"prompt":48,"zipAvailable":49},[39,42,45],{"tool":40,"command":41},"npx","npx skills add Elogic360\u002Fsoftware-factory --skill tao-train-mask2former",{"tool":43,"command":44},"bunx","bunx skills add Elogic360\u002Fsoftware-factory --skill tao-train-mask2former",{"tool":46,"command":47},"pnpm","pnpm dlx skills add Elogic360\u002Fsoftware-factory --skill tao-train-mask2former","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002FSKILL.md",true,[51,57,61,65,69,73,76,80,84,88,92,96,99,103,107,111,115,119,123,127,131,135,139],{"path":52,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":55,"sourceHtmlUrl":56},"BENCHMARK.md","REFERENCE","参考文档",4377,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002FBENCHMARK.md",{"path":58,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":59,"sourceHtmlUrl":60},"evals\u002Fevals.json",765,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Fevals\u002Fevals.json",{"path":62,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":63,"sourceHtmlUrl":64},"references\u002Fskill_info.yaml",2167,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Freferences\u002Fskill_info.yaml",{"path":66,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":67,"sourceHtmlUrl":68},"references\u002Fspec_template_deploy_evaluate.yaml",489,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Freferences\u002Fspec_template_deploy_evaluate.yaml",{"path":70,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":71,"sourceHtmlUrl":72},"references\u002Fspec_template_deploy_gen_trt_engine.yaml",247,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Freferences\u002Fspec_template_deploy_gen_trt_engine.yaml",{"path":74,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":67,"sourceHtmlUrl":75},"references\u002Fspec_template_deploy_inference.yaml","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Freferences\u002Fspec_template_deploy_inference.yaml",{"path":77,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":78,"sourceHtmlUrl":79},"references\u002Fspec_template_evaluate.yaml",3756,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Freferences\u002Fspec_template_evaluate.yaml",{"path":81,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":82,"sourceHtmlUrl":83},"references\u002Fspec_template_export.yaml",3831,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Freferences\u002Fspec_template_export.yaml",{"path":85,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":86,"sourceHtmlUrl":87},"references\u002Fspec_template_gen_trt_engine.yaml",3912,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Freferences\u002Fspec_template_gen_trt_engine.yaml",{"path":89,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":90,"sourceHtmlUrl":91},"references\u002Fspec_template_inference.yaml",3757,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Freferences\u002Fspec_template_inference.yaml",{"path":93,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":94,"sourceHtmlUrl":95},"references\u002Fspec_template_quantize.yaml",3630,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Freferences\u002Fspec_template_quantize.yaml",{"path":97,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":94,"sourceHtmlUrl":98},"references\u002Fspec_template_train.yaml","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Freferences\u002Fspec_template_train.yaml",{"path":100,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":101,"sourceHtmlUrl":102},"references\u002Ftao-deploy-mask2former.md",5176,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Freferences\u002Ftao-deploy-mask2former.md",{"path":104,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":105,"sourceHtmlUrl":106},"references\u002Ftao-deploy-mask2former.skill_info.yaml",2312,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Freferences\u002Ftao-deploy-mask2former.skill_info.yaml",{"path":108,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":109,"sourceHtmlUrl":110},"schemas\u002Fevaluate.schema.json",67894,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Fschemas\u002Fevaluate.schema.json",{"path":112,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":113,"sourceHtmlUrl":114},"schemas\u002Fexport.schema.json",68432,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Fschemas\u002Fexport.schema.json",{"path":116,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":117,"sourceHtmlUrl":118},"schemas\u002Fgen_trt_engine.schema.json",70982,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Fschemas\u002Fgen_trt_engine.schema.json",{"path":120,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":121,"sourceHtmlUrl":122},"schemas\u002Finference.schema.json",67896,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Fschemas\u002Finference.schema.json",{"path":124,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":125,"sourceHtmlUrl":126},"schemas\u002Fmanifest.json",21162,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Fschemas\u002Fmanifest.json",{"path":128,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":129,"sourceHtmlUrl":130},"schemas\u002Fquantize.schema.json",65224,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Fschemas\u002Fquantize.schema.json",{"path":132,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":133,"sourceHtmlUrl":134},"schemas\u002Ftrain.schema.json",65218,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Fschemas\u002Ftrain.schema.json",{"path":136,"resourceType":53,"resourceTypeDesc":54,"sizeBytes":137,"sourceHtmlUrl":138},"skill-card.md",4129,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Fskill-card.md",{"path":140,"resourceType":141,"resourceTypeDesc":142,"sizeBytes":143,"sourceHtmlUrl":144},"skill.oms.sig","OTHER","其他",9369,"https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Ftao-train-mask2former\u002Fskill.oms.sig",[146,153,160,167,174,181],{"skillNo":147,"name":148,"nameZh":6,"description":149,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":150,"categories":151,"keywords":152,"publishedAt":19},"01M79G206MT3J6S0GY3C45P2KV","vss-summarize-video","Use to summarize a recorded video via the LVS summarization microservice (HITL-gated) with a VLM fallback. Not for report generation or live RTSP captioning.","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fvss-summarize-video\u002FSKILL.md",[],[],{"skillNo":154,"name":155,"nameZh":6,"description":156,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":157,"categories":158,"keywords":159,"publishedAt":19},"01M79G1WN63PGRE8CKD47WEBQ5","vss-setup-video-analytics-api","Use to deploy the vss-video-analytics-api REST service standalone (config-source, data-log bind, Elasticsearch, optional Kafka). Not for full warehouse deploy.","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fvss-setup-video-analytics-api\u002FSKILL.md",[],[],{"skillNo":161,"name":162,"nameZh":6,"description":163,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":164,"categories":165,"keywords":166,"publishedAt":19},"01M79G1S9F7VY3EF6H53PRP5AN","vss-setup-behavior-analytics","Use to deploy the vss-behavior-analytics service standalone (entrypoint, config-source, optional calibration). Not for the full warehouse deploy.","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fvss-setup-behavior-analytics\u002FSKILL.md",[],[],{"skillNo":168,"name":169,"nameZh":6,"description":170,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":171,"categories":172,"keywords":173,"publishedAt":19},"01M79G1N1S1Y27PFZPYMNK1MTQ","vss-search-archive","Use this skill to run top-level VSS fusion search on archived video, or to ingest video files \u002F RTSP streams for search. Do NOT use for ad-hoc visual Q&A (use vss-ask-video), live captioning (use vss-deploy-dense-captioning), or video summarization and reports (use vss-summarize-video).","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fvss-search-archive\u002FSKILL.md",[],[],{"skillNo":175,"name":176,"nameZh":6,"description":177,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":178,"categories":179,"keywords":180,"publishedAt":19},"01M79G1H6WN0Q6C0VCAXCZX6B7","vss-query-analytics","Use this skill when reading video-analytics metrics, incidents, alerts, and sensor data via the VA-MCP server (port 9901). Not for live VLM or incident-range narrative reports.","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fvss-query-analytics\u002FSKILL.md",[],[],{"skillNo":182,"name":183,"nameZh":6,"description":184,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":185,"categories":186,"keywords":187,"publishedAt":19},"01M79G1DYPNXQS7QHZ0AAF5FX5","vss-manage-video-io-storage","Use to call the VIOS REST API (sensor list, timelines, clip extraction, snapshots, add\u002Fdelete sensors and streams). Not for VLM inference or search.","https:\u002F\u002Fgithub.com\u002FElogic360\u002Fsoftware-factory\u002Fblob\u002Fmain\u002Fskills\u002Fnvidia\u002Fvss-manage-video-io-storage\u002FSKILL.md",[],[]]