[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M788EEZPJVJ4ZWMFXY1Z5GSH":3,"skill-same:01M788EEZPJVJ4ZWMFXY1Z5GSH":119},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":31,"commitSha":32,"skillDirectory":33,"forksCount":14,"repositoryHtmlUrl":34,"repositoryHomepageUrl":6,"ownerHtmlUrl":35,"ownerBlogUrl":36,"ownerDescription":37,"updatedAt":38,"install":39,"resources":52},"01M788EEZPJVJ4ZWMFXY1Z5GSH","tao-train-mask-grounding-dino",null,"Mask Grounding DINO for grounded instance segmentation. Extends Grounding DINO with a mask-prediction head for open-set segmentation guided by text prompts. Use when training, evaluating, exporting, quantizing, or running inference for a TAO Mask-Grounding-DINO model. Trigger phrases include \"train Mask Grounding DINO\", \"open-vocabulary segmentation\", \"text-prompted instance segmentation\", \"grounded mask DETR\".","Solizardking\u002Ftrain2earn","Solizardking","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F108096810?v=4","01M786KDB10AYV042N0F9BD5B5","Clawd","01M786KDC5C3NPE4W44C5641EZ",0,"Apache-2.0","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: tao-train-mask-grounding-dino\ndescription: Mask Grounding DINO for grounded instance segmentation. Extends Grounding DINO with a mask-prediction head for\n  open-set segmentation guided by text prompts. Use when training, evaluating, exporting, quantizing, or running inference for\n  a TAO Mask-Grounding-DINO model. Trigger phrases include \"train Mask Grounding DINO\", \"open-vocabulary segmentation\",\n  \"text-prompted instance segmentation\", \"grounded mask DETR\".\nlicense: Apache-2.0\ncompatibility: Requires docker + nvidia-container-toolkit.\nmetadata:\n  version: \"0.1.0\"\n  author: NVIDIA Corporation\nallowed-tools: Read Bash\ntags:\n- segmentation\n---\n\n# Mask Grounding DINO\n\nMask Grounding DINO for grounded instance segmentation. Extends Grounding DINO with mask prediction head for open-set segmentation guided by text prompts.\n\nSet train.pretrained_model_path for full model weights.\n\nFor TAO Deploy TensorRT actions (`gen_trt_engine`, TensorRT `evaluate`, and TensorRT `inference`), read `references\u002Ftao-deploy-mask-grounding-dino.md` first. Deploy spec templates live in this skill's `references\u002F` folder with the `spec_template_deploy_*.yaml` prefix.\n\n## Dataclass Schemas\n\nGenerated TAO Core schemas are packaged in `schemas\u002F\u003Caction>.schema.json`, with `schemas\u002Fmanifest.json` listing available actions. Each generated schema also emits `references\u002Fspec_template_\u003Caction>.yaml` from the schema top-level `default` field. AutoML enablement is declared at the model layer in `references\u002Fskill_info.yaml` via `automl_enabled`. Runnable AutoML still requires `schemas\u002Ftrain.schema.json` and `references\u002Fspec_template_train.yaml` to exist and parse. Use the packaged train schema for `automl_default_parameters`, `automl_disabled_parameters`, defaults, min\u002Fmax bounds, enums, option weights, math conditions, dependencies, and popular parameters. Do not expect `~\u002Ftao-core` at runtime; maintainers regenerate schemas\u002Ftemplates before packaging the skill bank.\n\n## Train Action Policy\n\nThis model is AutoML-enabled at the model layer. Before handling any train-stage request, read `references\u002Fskill_info.yaml` and resolve the run override from either an explicit `automl_policy` value or the user's workflow request. Use `automl_policy: on` by default and only expose `on` \u002F `off` in new launch prompts. Treat phrases like \"turn off AutoML\", \"disable AutoML\", \"no HPO\", or \"plain training\" as `automl_policy: off` for this run only. When `automl_policy: on`, `automl_enabled: true`, and both `schemas\u002Ftrain.schema.json` and `references\u002Fspec_template_train.yaml` are packaged, route the train action through `tao-skill-bank:tao-run-automl` by default with this model's `skill_dir`. Preserve workflow\u002Fapplication overrides for datasets, specs, output directories, GPU\u002Fplatform settings, parent checkpoints, and `automl_policy`. Use direct model training only when `automl_policy: off` or the packaged train schema\u002Ftemplate is missing; in the missing-schema case, report that AutoML is enabled but not runnable for this model until schemas are generated.\n\nNon-train actions such as `evaluate`, `inference`, `export`, and deploy flows stay in this model skill. The per-run `automl_policy` override does not change model metadata.\n\n## Training Requirements\n\n- **Dataset type:** segmentation\n- **Formats:** odvg, coco, coco_raw\n- **Monitoring metric:** val_loss\n\n### Per-Action Dataset Requirements\n\n| Action | Spec Key | Source | Files | List? |\n|---|---|---|---|---|\n| evaluate | dataset.test_data_sources | eval_dataset | image_dir: images.tar.gz, json_file: annotations.json | No |\n| evaluate | dataset.test_data_sources.data_type | eval_dataset | OD | No |\n| inference | dataset.infer_data_sources | inference_dataset | image_dir: images.tar.gz, captions: text prompts | No |\n| inference | dataset.infer_data_sources.data_type | inference_dataset | OD | No |\n| quantize | dataset.train_data_sources | train_datasets | image_dir: images.tar.gz, json_file: annotations_odvg.jsonl, label_map: annotations_odvg_labelmap.json | Yes |\n| quantize | dataset.val_data_sources | eval_dataset | image_dir: images.tar.gz, json_file: annotations.json | No |\n| quantize | dataset.val_data_sources.data_type | eval_dataset | OD | No |\n| quantize | dataset.quant_calibration_data_sources | train_datasets | image_dir: images.tar.gz, json_file: annotations_odvg.jsonl, label_map: annotations_odvg_labelmap.json | No |\n| train | dataset.train_data_sources | train_datasets | image_dir: images.tar.gz, json_file: annotations_odvg.jsonl, label_map: annotations_odvg_labelmap.json | Yes |\n| train | dataset.val_data_sources | eval_dataset | image_dir: images.tar.gz, json_file: annotations.json | No |\n| train | dataset.val_data_sources.data_type | eval_dataset | OD | No |\n\n### Typical Spec Overrides\n\nData source overrides are **mandatory for every action** — the agent MUST construct data source paths from the Per-Action Dataset Requirements table above and include them in `spec_overrides`.\n\n```python\nS3_TRAIN = \"s3:\u002F\u002Fbucket\u002Fdata\u002Ftrain\"\nS3_EVAL = \"s3:\u002F\u002Fbucket\u002Fdata\u002Feval\"\n```\n\n**train (mandatory data sources):**\n```python\n{\n    \"train.num_gpus\": 1,\n    \"train.num_epochs\": 10,\n    \"train.checkpoint_interval\": 10,\n    \"train.validation_interval\": 10,\n    \"dataset.val_data_sources.data_type\": \"OD\",\n    \"model.num_region_queries\": 100,\n    \"dataset.train_data_sources\": [{\"image_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\", \"json_file\": f\"{S3_TRAIN}\u002Fannotations_odvg.jsonl\", \"label_map\": f\"{S3_TRAIN}\u002Fannotations_odvg_labelmap.json\"}],\n    \"dataset.val_data_sources\": {\"image_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\", \"json_file\": f\"{S3_EVAL}\u002Fannotations.json\"},\n}\n```\n\n**evaluate (mandatory data sources):**\n```python\n{\n    \"evaluate.checkpoint\": \"\u003Cselected train\u002FAutoML checkpoint>\",\n    \"dataset.test_data_sources.data_type\": \"OD\",\n    \"dataset.test_data_sources\": {\"image_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\", \"json_file\": f\"{S3_EVAL}\u002Fannotations.json\"},\n}\n```\n\n**inference (mandatory data sources):**\n```python\n{\n    \"inference.checkpoint\": \"\u003Cselected train\u002FAutoML checkpoint>\",\n    \"dataset.infer_data_sources.data_type\": \"OD\",\n    \"dataset.infer_data_sources\": {\"image_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\", \"captions\": [\"person\", \"bicycle\", \"car\"]},\n}\n```\n\n**quantize (mandatory data sources):**\n```python\n{\n    \"dataset.train_data_sources\": [{\"image_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\", \"json_file\": f\"{S3_TRAIN}\u002Fannotations_odvg.jsonl\", \"label_map\": f\"{S3_TRAIN}\u002Fannotations_odvg_labelmap.json\"}],\n    \"dataset.val_data_sources\": {\"image_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\", \"json_file\": f\"{S3_EVAL}\u002Fannotations.json\"},\n    \"dataset.quant_calibration_data_sources\": {\"image_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\", \"json_file\": f\"{S3_TRAIN}\u002Fannotations_odvg.jsonl\", \"label_map\": f\"{S3_TRAIN}\u002Fannotations_odvg_labelmap.json\"},\n}\n```\n## Eval Dataset\n\nOptional. Validation uses COCO-format annotations even when training uses ODVG.\n\n## Important Parameters\n\n- **model.backbone**: Default swin_tiny_224_1k. Same backbone options as Grounding DINO.\n- **train.optim.lr**: Learning rate. Default 2e-4. lr_backbone 2e-5. Reuses GDINOTrainExpConfig — same training setup as Grounding DINO.\n- **model.num_queries**: Object queries. Default 900.\n- **model.enc_layers \u002F model.dec_layers**: Keep both at 6 for train\u002FAutoML\n  runs. The mask head asserts six decoder outputs during validation, so\n  copying Grounding DINO smoke overrides that reduce transformer layers causes\n  an immediate failure.\n- **AutoML metric note**: Use `metric=\"val_loss\"` with\n  `direction=\"minimize\"` for train-stage AutoML. The packaged train loop logs\n  validation loss scalars; it does not emit `[bbox] val_mAP@50` during the\n  train job.\n- **model.has_mask**: Enables mask prediction head. Default True. Adds mask\u002Fdice\u002Frela loss coefficients.\n- **model.num_region_queries**: Number of region queries for mask prediction. Default 100.\n- **model.loss_types**: Loss components. Default [labels, boxes, masks]. Includes mask_loss_coef, dice_loss_coef, rela_loss_coef.\n- **evaluate.ioi_threshold**: IoI threshold for mask evaluation. Default 0.5.\n- **evaluate.nms_threshold**: NMS threshold. Default 0.2.\n- **evaluate.text_threshold**: Text matching threshold. Default 0.3.\n- **dataset.has_mask**: Dataset includes mask annotations. Default True. val_data_sources default data_type is \"VG\".\n\n## Multi-GPU \u002F Multi-Node\n\n**Launch method:** Lightning-managed. Same DDP\u002FFSDP behavior as Grounding DINO.\n\n| Spec Key | Description | Default |\n|----------|-------------|---------|\n| `train.num_gpus` | Number of GPUs | 1 |\n| `train.gpu_ids` | GPU device indices | [0] |\n| `train.num_nodes` | Number of nodes | 1 |\n| `train.distributed_strategy` | `ddp` or `fsdp` | `ddp` |\n\n## Hardware\n\nMinimum 1 GPU(s), recommended 4 GPU(s). 24GB+ (A100 recommended) VRAM per GPU. Heavier than Grounding DINO due to mask prediction head. 24GB+ GPU memory recommended.\n\n## Error Patterns\n\n**CUDA out of memory**: Reduce batch_size. Mask prediction adds overhead on top of Grounding DINO.\n\n**Deploy schema error for `test_threshold`**: TAO Deploy uses\n`evaluate.text_threshold` and `inference.text_threshold`. Do not use\n`test_threshold` in deploy specs.\n\n**Deploy model shape mismatch**: Carry transformer and mask structure fields\nfrom export into deploy evaluate\u002Finference specs, including `model.num_queries`,\n`model.num_select`, `model.max_text_len`, `model.num_region_queries`, and\n`model.has_mask`. These values must match the ONNX model used to build the\nTensorRT engine.\n\n## Spec Param \u002F Parent Model Inference\n\nModel-specific inference mappings belong in this MD file, not in `config.json`. Generated runners should read this section and apply the mappings with SDK helpers before `create_job()`. This mirrors the old microservices `infer_params.py` flow.\n\nInference mappings from TAO Core `mask_grounding_dino.config.json`:\n\n| Action | Spec Field | Inference Function | Meaning |\n|---|---|---|---|\n| evaluate | `encryption_key` | `key` | encryption key |\n| evaluate | `evaluate.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| evaluate | `evaluate.trt_engine` | `parent_model` | model file inferred from the parent job results folder |\n| evaluate | `results_dir` | `output_dir` | current job results directory |\n| export | `encryption_key` | `key` | encryption key |\n| export | `export.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| export | `export.onnx_file` | `create_onnx_file` | output ONNX path |\n| export | `results_dir` | `output_dir` | current job results directory |\n| gen_trt_engine | `encryption_key` | `key` | encryption key |\n| gen_trt_engine | `gen_trt_engine.onnx_file` | `parent_model` | model file inferred from the parent job results folder |\n| gen_trt_engine | `gen_trt_engine.trt_engine` | `create_engine_file` | output TensorRT engine path |\n| gen_trt_engine | `results_dir` | `output_dir` | current job results directory |\n| inference | `encryption_key` | `key` | encryption key |\n| inference | `inference.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| inference | `inference.trt_engine` | `parent_model` | model file inferred from the parent job results folder |\n| inference | `results_dir` | `output_dir` | current job results directory |\n| quantize | `encryption_key` | `key` | encryption key |\n| quantize | `quantize.model_path` | `parent_model` | model file inferred from the parent job results folder |\n| quantize | `results_dir` | `output_dir` | current job results directory |\n| train | `encryption_key` | `key` | encryption key |\n| train | `model.pretrained_backbone_path` | `ptm_if_no_resume_model` | PTM when no resume checkpoint exists |\n| train | `results_dir` | `output_dir` | current job results directory |\n| train | `train.pretrained_model_path` | `ptm_if_no_resume_model` | PTM when no resume checkpoint exists |\n| train | `train.resume_training_checkpoint_path` | `resume_model` | model file inferred from the current job results folder |\n\nFor `parent_model` or `parent_model_folder`, pass the upstream train\u002Fexport\u002FAutoML child job id as `parent_job_id`. The SDK lists the parent result folder, filters checkpoint artifacts, and returns the selected model file or folder. Do not add these mappings back to `config.json` and do not patch generated runner scripts to guess checkpoint paths.\n\nWhen selecting a Mask Grounding DINO checkpoint outside the SDK resolver, match\nthe intended epoch\u002Fstep artifact exactly, for example\n`model_epoch_000_step_00049.pth`. The `mask_gdino_model_latest.pth` symlink is\nvalid only when latest is explicitly requested. The parent PyTorch\n`mask_grounding_dino` CLI supports `train`, `evaluate`, `inference`, `export`,\nand `quantize`; run TensorRT engine generation, TensorRT inference, and\nTensorRT evaluation through `references\u002Ftao-deploy-mask-grounding-dino.md`.\n\n## Deployment\n\n- [tao-deploy-mask-grounding-dino](references\u002Ftao-deploy-mask-grounding-dino.md)\n","# Mask Grounding DINO\n\nMask Grounding DINO for grounded instance segmentation. Extends Grounding DINO with mask prediction head for open-set segmentation guided by text prompts.\n\nSet train.pretrained_model_path for full model weights.\n\nFor TAO Deploy TensorRT actions (`gen_trt_engine`, TensorRT `evaluate`, and TensorRT `inference`), read `references\u002Ftao-deploy-mask-grounding-dino.md` first. Deploy spec templates live in this skill's `references\u002F` folder with the `spec_template_deploy_*.yaml` prefix.\n\n## Dataclass Schemas\n\nGenerated TAO Core schemas are packaged in `schemas\u002F\u003Caction>.schema.json`, with `schemas\u002Fmanifest.json` listing available actions. Each generated schema also emits `references\u002Fspec_template_\u003Caction>.yaml` from the schema top-level `default` field. AutoML enablement is declared at the model layer in `references\u002Fskill_info.yaml` via `automl_enabled`. Runnable AutoML still requires `schemas\u002Ftrain.schema.json` and `references\u002Fspec_template_train.yaml` to exist and parse. Use the packaged train schema for `automl_default_parameters`, `automl_disabled_parameters`, defaults, min\u002Fmax bounds, enums, option weights, math conditions, dependencies, and popular parameters. Do not expect `~\u002Ftao-core` at runtime; maintainers regenerate schemas\u002Ftemplates before packaging the skill bank.\n\n## Train Action Policy\n\nThis model is AutoML-enabled at the model layer. Before handling any train-stage request, read `references\u002Fskill_info.yaml` and resolve the run override from either an explicit `automl_policy` value or the user's workflow request. Use `automl_policy: on` by default and only expose `on` \u002F `off` in new launch prompts. Treat phrases like \"turn off AutoML\", \"disable AutoML\", \"no HPO\", or \"plain training\" as `automl_policy: off` for this run only. When `automl_policy: on`, `automl_enabled: true`, and both `schemas\u002Ftrain.schema.json` and `references\u002Fspec_template_train.yaml` are packaged, route the train action through `tao-skill-bank:tao-run-automl` by default with this model's `skill_dir`. Preserve workflow\u002Fapplication overrides for datasets, specs, output directories, GPU\u002Fplatform settings, parent checkpoints, and `automl_policy`. Use direct model training only when `automl_policy: off` or the packaged train schema\u002Ftemplate is missing; in the missing-schema case, report that AutoML is enabled but not runnable for this model until schemas are generated.\n\nNon-train actions such as `evaluate`, `inference`, `export`, and deploy flows stay in this model skill. The per-run `automl_policy` override does not change model metadata.\n\n## Training Requirements\n\n- **Dataset type:** segmentation\n- **Formats:** odvg, coco, coco_raw\n- **Monitoring metric:** val_loss\n\n### Per-Action Dataset Requirements\n\n| Action | Spec Key | Source | Files | List? |\n|---|---|---|---|---|\n| evaluate | dataset.test_data_sources | eval_dataset | image_dir: images.tar.gz, json_file: annotations.json | No |\n| evaluate | dataset.test_data_sources.data_type | eval_dataset | OD | No |\n| inference | dataset.infer_data_sources | inference_dataset | image_dir: images.tar.gz, captions: text prompts | No |\n| inference | dataset.infer_data_sources.data_type | inference_dataset | OD | No |\n| quantize | dataset.train_data_sources | train_datasets | image_dir: images.tar.gz, json_file: annotations_odvg.jsonl, label_map: annotations_odvg_labelmap.json | Yes |\n| quantize | dataset.val_data_sources | eval_dataset | image_dir: images.tar.gz, json_file: annotations.json | No |\n| quantize | dataset.val_data_sources.data_type | eval_dataset | OD | No |\n| quantize | dataset.quant_calibration_data_sources | train_datasets | image_dir: images.tar.gz, json_file: annotations_odvg.jsonl, label_map: annotations_odvg_labelmap.json | No |\n| train | dataset.train_data_sources | train_datasets | image_dir: images.tar.gz, json_file: annotations_odvg.jsonl, label_map: annotations_odvg_labelmap.json | Yes |\n| train | dataset.val_data_sources | eval_dataset | image_dir: images.tar.gz, json_file: annotations.json | No |\n| train | dataset.val_data_sources.data_type | eval_dataset | OD | No |\n\n### Typical Spec Overrides\n\nData source overrides are **mandatory for every action** — the agent MUST construct data source paths from the Per-Action Dataset Requirements table above and include them in `spec_overrides`.\n\n```python\nS3_TRAIN = \"s3:\u002F\u002Fbucket\u002Fdata\u002Ftrain\"\nS3_EVAL = \"s3:\u002F\u002Fbucket\u002Fdata\u002Feval\"\n```\n\n**train (mandatory data sources):**\n```python\n{\n    \"train.num_gpus\": 1,\n    \"train.num_epochs\": 10,\n    \"train.checkpoint_interval\": 10,\n    \"train.validation_interval\": 10,\n    \"dataset.val_data_sources.data_type\": \"OD\",\n    \"model.num_region_queries\": 100,\n    \"dataset.train_data_sources\": [{\"image_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\", \"json_file\": f\"{S3_TRAIN}\u002Fannotations_odvg.jsonl\", \"label_map\": f\"{S3_TRAIN}\u002Fannotations_odvg_labelmap.json\"}],\n    \"dataset.val_data_sources\": {\"image_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\", \"json_file\": f\"{S3_EVAL}\u002Fannotations.json\"},\n}\n```\n\n**evaluate (mandatory data sources):**\n```python\n{\n    \"evaluate.checkpoint\": \"\u003Cselected train\u002FAutoML checkpoint>\",\n    \"dataset.test_data_sources.data_type\": \"OD\",\n    \"dataset.test_data_sources\": {\"image_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\", \"json_file\": f\"{S3_EVAL}\u002Fannotations.json\"},\n}\n```\n\n**inference (mandatory data sources):**\n```python\n{\n    \"inference.checkpoint\": \"\u003Cselected train\u002FAutoML checkpoint>\",\n    \"dataset.infer_data_sources.data_type\": \"OD\",\n    \"dataset.infer_data_sources\": {\"image_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\", \"captions\": [\"person\", \"bicycle\", \"car\"]},\n}\n```\n\n**quantize (mandatory data sources):**\n```python\n{\n    \"dataset.train_data_sources\": [{\"image_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\", \"json_file\": f\"{S3_TRAIN}\u002Fannotations_odvg.jsonl\", \"label_map\": f\"{S3_TRAIN}\u002Fannotations_odvg_labelmap.json\"}],\n    \"dataset.val_data_sources\": {\"image_dir\": f\"{S3_EVAL}\u002Fimages.tar.gz\", \"json_file\": f\"{S3_EVAL}\u002Fannotations.json\"},\n    \"dataset.quant_calibration_data_sources\": {\"image_dir\": f\"{S3_TRAIN}\u002Fimages.tar.gz\", \"json_file\": f\"{S3_TRAIN}\u002Fannotations_odvg.jsonl\", \"label_map\": f\"{S3_TRAIN}\u002Fannotations_odvg_labelmap.json\"},\n}\n```\n## Eval Dataset\n\nOptional. Validation uses COCO-format annotations even when training uses ODVG.\n\n## Important Parameters\n\n- **model.backbone**: Default swin_tiny_224_1k. Same backbone options as Grounding DINO.\n- **train.optim.lr**: Learning rate. Default 2e-4. lr_backbone 2e-5. Reuses GDINOTrainExpConfig — same training setup as Grounding DINO.\n- **model.num_queries**: Object queries. Default 900.\n- **model.enc_layers \u002F model.dec_layers**: Keep both at 6 for train\u002FAutoML\n  runs. The mask head asserts six decoder outputs during validation, so\n  copying Grounding DINO smoke overrides that reduce transformer layers causes\n  an immediate failure.\n- **AutoML metric note**: Use `metric=\"val_loss\"` with\n  `direction=\"minimize\"` for train-stage AutoML. The packaged train loop logs\n  validation loss scalars; it does not emit `[bbox] val_mAP@50` during the\n  train job.\n- **model.has_mask**: Enables mask prediction head. Default True. Adds mask\u002Fdice\u002Frela loss coefficients.\n- **model.num_region_queries**: Number of region queries for mask prediction. Default 100.\n- **model.loss_types**: Loss components. Default [labels, boxes, masks]. Includes mask_loss_coef, dice_loss_coef, rela_loss_coef.\n- **evaluate.ioi_threshold**: IoI threshold for mask evaluation. Default 0.5.\n- **evaluate.nms_threshold**: NMS threshold. Default 0.2.\n- **evaluate.text_threshold**: Text matching threshold. Default 0.3.\n- **dataset.has_mask**: Dataset includes mask annotations. Default True. val_data_sources default data_type is \"VG\".\n\n## Multi-GPU \u002F Multi-Node\n\n**Launch method:** Lightning-managed. Same DDP\u002FFSDP behavior as Grounding DINO.\n\n| Spec Key | Description | Default |\n|----------|-------------|---------|\n| `train.num_gpus` | Number of GPUs | 1 |\n| `train.gpu_ids` | GPU device indices | [0] |\n| `train.num_nodes` | Number of nodes | 1 |\n| `train.distributed_strategy` | `ddp` or `fsdp` | `ddp` |\n\n## Hardware\n\nMinimum 1 GPU(s), recommended 4 GPU(s). 24GB+ (A100 recommended) VRAM per GPU. Heavier than Grounding DINO due to mask prediction head. 24GB+ GPU memory recommended.\n\n## Error Patterns\n\n**CUDA out of memory**: Reduce batch_size. Mask prediction adds overhead on top of Grounding DINO.\n\n**Deploy schema error for `test_threshold`**: TAO Deploy uses\n`evaluate.text_threshold` and `inference.text_threshold`. Do not use\n`test_threshold` in deploy specs.\n\n**Deploy model shape mismatch**: Carry transformer and mask structure fields\nfrom export into deploy evaluate\u002Finference specs, including `model.num_queries`,\n`model.num_select`, `model.max_text_len`, `model.num_region_queries`, and\n`model.has_mask`. These values must match the ONNX model used to build the\nTensorRT engine.\n\n## Spec Param \u002F Parent Model Inference\n\nModel-specific inference mappings belong in this MD file, not in `config.json`. Generated runners should read this section and apply the mappings with SDK helpers before `create_job()`. This mirrors the old microservices `infer_params.py` flow.\n\nInference mappings from TAO Core `mask_grounding_dino.config.json`:\n\n| Action | Spec Field | Inference Function | Meaning |\n|---|---|---|---|\n| evaluate | `encryption_key` | `key` | encryption key |\n| evaluate | `evaluate.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| evaluate | `evaluate.trt_engine` | `parent_model` | model file inferred from the parent job results folder |\n| evaluate | `results_dir` | `output_dir` | current job results directory |\n| export | `encryption_key` | `key` | encryption key |\n| export | `export.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| export | `export.onnx_file` | `create_onnx_file` | output ONNX path |\n| export | `results_dir` | `output_dir` | current job results directory |\n| gen_trt_engine | `encryption_key` | `key` | encryption key |\n| gen_trt_engine | `gen_trt_engine.onnx_file` | `parent_model` | model file inferred from the parent job results folder |\n| gen_trt_engine | `gen_trt_engine.trt_engine` | `create_engine_file` | output TensorRT engine path |\n| gen_trt_engine | `results_dir` | `output_dir` | current job results directory |\n| inference | `encryption_key` | `key` | encryption key |\n| inference | `inference.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| inference | `inference.trt_engine` | `parent_model` | model file inferred from the parent job results folder |\n| inference | `results_dir` | `output_dir` | current job results directory |\n| quantize | `encryption_key` | `key` | encryption key |\n| quantize | `quantize.model_path` | `parent_model` | model file inferred from the parent job results folder |\n| quantize | `results_dir` | `output_dir` | current job results directory |\n| train | `encryption_key` | `key` | encryption key |\n| train | `model.pretrained_backbone_path` | `ptm_if_no_resume_model` | PTM when no resume checkpoint exists |\n| train | `results_dir` | `output_dir` | current job results directory |\n| train | `train.pretrained_model_path` | `ptm_if_no_resume_model` | PTM when no resume checkpoint exists |\n| train | `train.resume_training_checkpoint_path` | `resume_model` | model file inferred from the current job results folder |\n\nFor `parent_model` or `parent_model_folder`, pass the upstream train\u002Fexport\u002FAutoML child job id as `parent_job_id`. The SDK lists the parent result folder, filters checkpoint artifacts, and returns the selected model file or folder. Do not add these mappings back to `config.json` and do not patch generated runner scripts to guess checkpoint paths.\n\nWhen selecting a Mask Grounding DINO checkpoint outside the SDK resolver, match\nthe intended epoch\u002Fstep artifact exactly, for example\n`model_epoch_000_step_00049.pth`. The `mask_gdino_model_latest.pth` symlink is\nvalid only when latest is explicitly requested. The parent PyTorch\n`mask_grounding_dino` CLI supports `train`, `evaluate`, `inference`, `export`,\nand `quantize`; run TensorRT engine generation, TensorRT inference, and\nTensorRT evaluation through `references\u002Ftao-deploy-mask-grounding-dino.md`.\n\n## Deployment\n\n- [tao-deploy-mask-grounding-dino](references\u002Ftao-deploy-mask-grounding-dino.md)\n",{"name":5,"tags":24,"license":15,"metadata":26,"description":7,"allowed-tools":29,"compatibility":30},[25],"segmentation",{"author":27,"version":28},"NVIDIA Corporation","0.1.0","Read Bash","Requires docker + nvidia-container-toolkit.","main","86cc27ffd16af6cb85948f1155578e6f3f61cc4c","skillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn","https:\u002F\u002Fgithub.com\u002FSolizardking","https:\u002F\u002Fmusebook.trade","Got a mile high and never came down","2026-10-08 11:52:53",{"source":8,"skillName":5,"commands":40,"prompt":50,"zipAvailable":51},[41,44,47],{"tool":42,"command":43},"npx","npx skills add Solizardking\u002Ftrain2earn --skill tao-train-mask-grounding-dino",{"tool":45,"command":46},"bunx","bunx skills add Solizardking\u002Ftrain2earn --skill tao-train-mask-grounding-dino",{"tool":48,"command":49},"pnpm","pnpm dlx skills add Solizardking\u002Ftrain2earn --skill tao-train-mask-grounding-dino","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002FSKILL.md",true,[53,59,63,67,71,75,79,83,87,91,95,99,103,107,111,115],{"path":54,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":57,"sourceHtmlUrl":58},"BENCHMARK.md","REFERENCE","参考文档",4136,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002FBENCHMARK.md",{"path":60,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":61,"sourceHtmlUrl":62},"metadata.json",659,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Fmetadata.json",{"path":64,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":65,"sourceHtmlUrl":66},"references\u002Fskill_info.yaml",6309,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Freferences\u002Fskill_info.yaml",{"path":68,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":69,"sourceHtmlUrl":70},"references\u002Fspec_template_deploy_evaluate.yaml",567,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Freferences\u002Fspec_template_deploy_evaluate.yaml",{"path":72,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":73,"sourceHtmlUrl":74},"references\u002Fspec_template_deploy_gen_trt_engine.yaml",365,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Freferences\u002Fspec_template_deploy_gen_trt_engine.yaml",{"path":76,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":77,"sourceHtmlUrl":78},"references\u002Fspec_template_deploy_inference.yaml",1651,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Freferences\u002Fspec_template_deploy_inference.yaml",{"path":80,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":81,"sourceHtmlUrl":82},"references\u002Fspec_template_evaluate.yaml",3612,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Freferences\u002Fspec_template_evaluate.yaml",{"path":84,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":85,"sourceHtmlUrl":86},"references\u002Fspec_template_export.yaml",3645,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Freferences\u002Fspec_template_export.yaml",{"path":88,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":89,"sourceHtmlUrl":90},"references\u002Fspec_template_gen_trt_engine.yaml",3682,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Freferences\u002Fspec_template_gen_trt_engine.yaml",{"path":92,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":93,"sourceHtmlUrl":94},"references\u002Fspec_template_inference.yaml",3692,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Freferences\u002Fspec_template_inference.yaml",{"path":96,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":97,"sourceHtmlUrl":98},"references\u002Fspec_template_quantize.yaml",3418,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Freferences\u002Fspec_template_quantize.yaml",{"path":100,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":101,"sourceHtmlUrl":102},"references\u002Fspec_template_train.yaml",3400,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Freferences\u002Fspec_template_train.yaml",{"path":104,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":105,"sourceHtmlUrl":106},"references\u002Ftao-deploy-mask-grounding-dino.md",5683,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Freferences\u002Ftao-deploy-mask-grounding-dino.md",{"path":108,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":109,"sourceHtmlUrl":110},"references\u002Ftao-deploy-mask-grounding-dino.skill_info.yaml",3395,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Freferences\u002Ftao-deploy-mask-grounding-dino.skill_info.yaml",{"path":112,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":113,"sourceHtmlUrl":114},"skill-card.md",3794,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Fskill-card.md",{"path":116,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":117,"sourceHtmlUrl":118},"verification.json",3858,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fpublic\u002Fapi\u002Fskills\u002Fnvidia\u002Ftao-train-mask-grounding-dino\u002Fverification.json",[120,128,136,144,151,159],{"skillNo":121,"name":122,"nameZh":6,"description":123,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":124,"licenseFileUrl":6,"sourceHtmlUrl":125,"categories":126,"keywords":127,"publishedAt":19},"01M78B94RSCAKMH1QS79VE6DG9","testing","For testing with Light Protocol programs and clients on localnet, devnet, and mainnet validation.","MIT","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Ftesting\u002FSKILL.md",[],[],{"skillNo":129,"name":130,"nameZh":6,"description":131,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":124,"licenseFileUrl":132,"sourceHtmlUrl":133,"categories":134,"keywords":135,"publishedAt":19},"01M78B81BKY8RX12HETPG8YKWK","qedgen","Formally verify programs by writing Lean 4 proofs. Trigger this skill whenever the user wants to formally verify code, generate Lean 4 proofs, prove properties about algorithms or smart contracts, verify invariants, convert program logic into formal specifications, or anything involving Lean 4 and formal verification. Also trigger when the user mentions \"qedgen\", \"lean proof\", \"formal proof\", \"verify my code\", \"prove correctness\", \"formal verification\", or wants mathematical guarantees about their implementation.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-formal-verification\u002FLICENSE","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-formal-verification\u002FSKILL.md",[],[],{"skillNo":137,"name":138,"nameZh":6,"description":139,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":124,"licenseFileUrl":140,"sourceHtmlUrl":141,"categories":142,"keywords":143,"publishedAt":19},"01M78B7Q7C5K54E01DN83A60KG","solana-dev","Use when user asks to \"build a Solana dapp\", \"write an Anchor program\", \"create a token\", \"debug Solana errors\", \"set up wallet connection\", \"test my Solana program\", \"deploy to devnet\", or \"explain Solana concepts\" (rent, accounts, PDAs, CPIs, etc.). Also use for quick on-chain lookups via public RPC + curl — \"what's the balance of \u003Cwallet>\", \"look up transaction \u003Csig>\", \"token balance for \u003Caccount>\", \"check this address on mainnet\u002Fdevnet\". End-to-end Solana development playbook covering wallet connection, Anchor\u002FPinocchio programs, Codama client generation, LiteSVM\u002FMollusk\u002FSurfpool testing, security checklists, and JSON-RPC curl lookups against public clusters. Integrates with the Solana MCP server for live documentation search. Prefers framework-kit (@solana\u002Fclient + @solana\u002Freact-hooks) for UI, wallet-standard-first connection (incl. ConnectorKit), @solana\u002Fkit for client\u002FRPC code, and @solana\u002Fweb3-compat for legacy boundaries.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-dev\u002FLICENSE","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-dev\u002FSKILL.md",[],[],{"skillNo":145,"name":146,"nameZh":6,"description":147,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":124,"licenseFileUrl":6,"sourceHtmlUrl":148,"categories":149,"keywords":150,"publishedAt":19},"01M78B7HXD6N6GWKSVRQ8F6Q31","solana-common-errors","Diagnose and fix common Solana development errors — GLIBC mismatches, Anchor version conflicts, cargo build-sbf \u002F platform-tools failures, LiteSVM issues, edition2024 crate pins, RPC airdrops, and Anchor 0.29→0.32 migrations. Use when builds fail, Anchor CLI won't install, or CI breaks on Debian\u002FUbuntu.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-common-errors\u002FSKILL.md",[],[],{"skillNo":152,"name":153,"nameZh":6,"description":154,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":155,"sourceHtmlUrl":156,"categories":157,"keywords":158,"publishedAt":19},"01M78B6T7YSYWQ0N4DP40QDXEZ","skill-creator","Create or update AgentSkills. Use when designing, structuring, or packaging skills with scripts, references, and assets.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fskill-creator\u002Flicense.txt","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fskill-creator\u002FSKILL.md",[],[],{"skillNo":160,"name":161,"nameZh":6,"description":162,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":124,"licenseFileUrl":6,"sourceHtmlUrl":163,"categories":164,"keywords":165,"publishedAt":19},"01M78B1VFT9X5AND7AE1HZPZGF","phantom-wallet-mcp","Execute wallet operations through the Phantom MCP server. Use when the user wants to interact with their Phantom wallet directly — get addresses, transfer SOL or SPL tokens, buy\u002Fswap tokens, sign transactions, and sign messages across Solana, Ethereum, Bitcoin, and Sui. Requires the @phantom\u002Fmcp-server to be configured as an MCP server.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fphantom-wallet-mcp\u002FSKILL.md",[],[]]