[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M78AT4526965DT87DFGDC5RV":3,"skill-same:01M78AT4526965DT87DFGDC5RV":146},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":31,"commitSha":32,"skillDirectory":33,"forksCount":14,"repositoryHtmlUrl":34,"repositoryHomepageUrl":6,"ownerHtmlUrl":35,"ownerBlogUrl":36,"ownerDescription":37,"updatedAt":38,"install":39,"resources":52},"01M78AT4526965DT87DFGDC5RV","tao-train-oneformer",null,"OneFormer for universal image segmentation. Unifies panoptic, instance, and semantic segmentation with a single architecture using task-conditioned queries. Use when training, evaluating, exporting, quantizing, or running inference for a TAO OneFormer model. Trigger phrases include \"train OneFormer\", \"universal segmentation\", \"task-conditioned segmentation\", \"panoptic \u002F instance \u002F semantic in one model\".","Solizardking\u002Ftrain2earn","Solizardking","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F108096810?v=4","01M786KDB10AYV042N0F9BD5B5","Clawd","01M786KDC5C3NPE4W44C5641EZ",0,"Apache-2.0","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: tao-train-oneformer\ndescription: OneFormer for universal image segmentation. Unifies panoptic, instance, and semantic segmentation with a\n  single architecture using task-conditioned queries. Use when training, evaluating, exporting, quantizing, or running\n  inference for a TAO OneFormer model. Trigger phrases include \"train OneFormer\", \"universal segmentation\",\n  \"task-conditioned segmentation\", \"panoptic \u002F instance \u002F semantic in one model\".\nlicense: Apache-2.0\ncompatibility: Requires docker + nvidia-container-toolkit.\nmetadata:\n  version: \"0.1.0\"\n  author: NVIDIA Corporation\nallowed-tools: Read Bash\ntags:\n- segmentation\n---\n\n# OneFormer\n\nOneFormer for universal image segmentation. Unifies panoptic, instance, and semantic segmentation with a single architecture using task-conditioned queries.\n\nSet train.pretrained_backbone and\u002For train.pretrained_model.\n\nFor TAO Deploy TensorRT actions (`gen_trt_engine`, TensorRT `evaluate`, and TensorRT `inference`), read `references\u002Ftao-deploy-oneformer.md` first. Deploy spec templates live in this skill's `references\u002F` folder with the `spec_template_deploy_*.yaml` prefix.\n\n## Dataclass Schemas\n\nGenerated TAO Core schemas are packaged in `schemas\u002F\u003Caction>.schema.json`, with `schemas\u002Fmanifest.json` listing available actions. Each generated schema also emits `references\u002Fspec_template_\u003Caction>.yaml` from the schema top-level `default` field. AutoML enablement is declared at the model layer in `references\u002Fskill_info.yaml` via `automl_enabled`. Runnable AutoML still requires `schemas\u002Ftrain.schema.json` and `references\u002Fspec_template_train.yaml` to exist and parse. Use the packaged train schema for `automl_default_parameters`, `automl_disabled_parameters`, defaults, min\u002Fmax bounds, enums, option weights, math conditions, dependencies, and popular parameters. Do not expect `~\u002Ftao-core` at runtime; maintainers regenerate schemas\u002Ftemplates before packaging the skill bank.\n\n## Train Action Policy\n\nThis model is AutoML-enabled at the model layer. Before handling any train-stage request, read `references\u002Fskill_info.yaml` and resolve the run override from either an explicit `automl_policy` value or the user's workflow request. Use `automl_policy: on` by default and only expose `on` \u002F `off` in new launch prompts. Treat phrases like \"turn off AutoML\", \"disable AutoML\", \"no HPO\", or \"plain training\" as `automl_policy: off` for this run only. When `automl_policy: on`, `automl_enabled: true`, and both `schemas\u002Ftrain.schema.json` and `references\u002Fspec_template_train.yaml` are packaged, route the train action through `tao-skill-bank:tao-run-automl` by default with this model's `skill_dir`. Preserve workflow\u002Fapplication overrides for datasets, specs, output directories, GPU\u002Fplatform settings, parent checkpoints, and `automl_policy`. Use direct model training only when `automl_policy: off` or the packaged train schema\u002Ftemplate is missing; in the missing-schema case, report that AutoML is enabled but not runnable for this model until schemas are generated.\n\nNon-train actions such as `evaluate`, `inference`, `export`, and deploy flows stay in this model skill. The per-run `automl_policy` override does not change model metadata.\n\n## Training Requirements\n\n- **Dataset type:** segmentation\n- **Formats:** coco_panoptic, coco\n- **Monitoring metric:** mIoU\n\n### Per-Action Dataset Requirements\n\n| Action | Spec Key | Source | Files | List? |\n|---|---|---|---|---|\n| evaluate | dataset.train.images | train_datasets | images.tar.gz | No |\n| evaluate | dataset.label_map | train_datasets | label_map.json | No |\n| evaluate | dataset.train.annotations | train_datasets | annotations.json | No |\n| evaluate | dataset.train.panoptic | train_datasets | images_panoptic.tar.gz | No |\n| evaluate | dataset.val.images | eval_dataset | images.tar.gz | No |\n| evaluate | dataset.val.annotations | eval_dataset | annotations.json | No |\n| evaluate | dataset.val.panoptic | eval_dataset | images_panoptic.tar.gz | No |\n| evaluate | dataset.test.images | eval_dataset | images.tar.gz | No |\n| evaluate | dataset.test.annotations | eval_dataset | annotations.json | No |\n| evaluate | dataset.test.panoptic | eval_dataset | images_panoptic.tar.gz | No |\n| inference | dataset.train.images | train_datasets | images.tar.gz | No |\n| inference | dataset.label_map | train_datasets | label_map.json | No |\n| inference | dataset.train.annotations | train_datasets | annotations.json | No |\n| inference | dataset.train.panoptic | train_datasets | images_panoptic.tar.gz | No |\n| inference | dataset.val.images | eval_dataset | images.tar.gz | No |\n| inference | dataset.val.annotations | eval_dataset | annotations.json | No |\n| inference | dataset.val.panoptic | eval_dataset | images_panoptic.tar.gz | No |\n| inference | dataset.test.images | inference_dataset | images.tar.gz | No |\n| quantize | dataset.train.images | train_datasets | images.tar.gz | No |\n| quantize | dataset.train.annotations | train_datasets | annotations.json | No |\n| quantize | dataset.label_map | train_datasets | label_map.json | No |\n| quantize | dataset.train.panoptic | train_datasets | images_panoptic.tar.gz | No |\n| quantize | dataset.val.images | eval_dataset | images.tar.gz | No |\n| quantize | dataset.val.annotations | eval_dataset | annotations.json | No |\n| quantize | dataset.val.panoptic | eval_dataset | images_panoptic.tar.gz | No |\n| quantize | dataset.test.images | eval_dataset | images.tar.gz | No |\n| quantize | dataset.quant_calibration_dataset.images_dir | calibration_dataset | images.tar.gz | No |\n| train | dataset.train.images | train_datasets | images.tar.gz | No |\n| train | dataset.train.annotations | train_datasets | annotations.json | No |\n| train | dataset.label_map | train_datasets | label_map.json | No |\n| train | dataset.train.panoptic | train_datasets | images_panoptic.tar.gz | No |\n| train | dataset.val.images | eval_dataset | images.tar.gz | No |\n| train | dataset.val.annotations | eval_dataset | annotations.json | No |\n| train | dataset.val.panoptic | eval_dataset | images_panoptic.tar.gz | No |\n| train | dataset.test.images | eval_dataset | images.tar.gz | No |\n\n### Typical Spec Overrides\n\nData source overrides are **mandatory for every action** — the agent MUST construct data source paths from the Per-Action Dataset Requirements table above and include them in `spec_overrides`.\n\n```python\nS3_TRAIN = \"s3:\u002F\u002Fbucket\u002Fdata\u002Ftrain\"\nS3_EVAL = \"s3:\u002F\u002Fbucket\u002Fdata\u002Feval\"\nS3_INFERENCE = \"s3:\u002F\u002Fbucket\u002Fdata\u002Finference\"\nS3_CALIBRATION = \"s3:\u002F\u002Fbucket\u002Fdata\u002Fcalibration\"\n```\n\n**train (mandatory data sources):**\n```python\n{\n    \"train.num_gpus\": 1,\n    \"train.num_epochs\": 10,\n    \"train.checkpoint_interval\": 10,\n    \"train.validation_interval\": 10,\n    \"model.sem_seg_head.num_classes\": 133,\n    \"dataset.contiguous_id\": True,\n    \"train.precision\": \"32\",\n    \"dataset.train.images\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.train.annotations\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.label_map\": f\"{S3_TRAIN}\u002Flabel_map.json\",\n    \"dataset.train.panoptic\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.annotations\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n}\n```\n\n**evaluate (mandatory data sources):**\n```python\n{\n    \"evaluate.checkpoint\": \"\u003Cselected train\u002FAutoML checkpoint>\",\n    \"model.sem_seg_head.num_classes\": 133,\n    \"dataset.contiguous_id\": True,\n    \"dataset.train.images\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.label_map\": f\"{S3_TRAIN}\u002Flabel_map.json\",\n    \"dataset.train.annotations\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.train.panoptic\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.annotations\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.test.annotations\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.test.panoptic\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n}\n```\n\n**export:**\n```python\n{\n    \"export.checkpoint\": \"\u003Cselected train\u002FAutoML checkpoint>\",\n    \"model.sem_seg_head.num_classes\": 133,\n    \"model.export\": True,\n    \"export.onnx_file\": \"\u002Fresults\u002Foneformer_export_640.onnx\",\n}\n```\n\n**inference (mandatory data sources):**\n```python\n{\n    \"inference.checkpoint\": \"\u003Cselected train\u002FAutoML checkpoint>\",\n    \"dataset.train.images\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.label_map\": f\"{S3_TRAIN}\u002Flabel_map.json\",\n    \"dataset.train.annotations\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.train.panoptic\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.annotations\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.images\": f\"{S3_INFERENCE}\u002Fimages.tar.gz\",\n    \"inference.images_dir\": f\"{S3_INFERENCE}\u002Fimages.tar.gz\",\n}\n```\n\n**quantize (mandatory data sources):**\n```python\n{\n    \"quantize.model_path\": \"\u003Cselected train\u002FAutoML checkpoint>\",\n    \"dataset.train.images\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.train.annotations\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.label_map\": f\"{S3_TRAIN}\u002Flabel_map.json\",\n    \"dataset.train.panoptic\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.annotations\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.quant_calibration_dataset.images_dir\": f\"{S3_CALIBRATION}\u002Fimages.tar.gz\",\n}\n```\n\n## Checkpoint Selection\n\nOneFormer training writes epoch-step checkpoints such as\n`model_epoch_000_step_00017.pth` and may also write a\n`oneformer_model_latest.pth` symlink. For checkpoint-dependent actions, use the\nmodel-skill or SDK parent-model resolver and pass the exact selected checkpoint\npath into `evaluate.checkpoint`, `inference.checkpoint`, `export.checkpoint`,\n`quantize.model_path`, or `train.resume_training_checkpoint_path`. Do not pick\nthe `oneformer_model_latest.pth` symlink by name unless the user explicitly asks\nfor latest checkpoint behavior. If the resolver reports a best checkpoint, use\nthat best checkpoint for evaluation\u002Fexport\u002Finference; if the user asks for a\nspecific epoch or step, use the matching epoch-step checkpoint.\n## Eval Dataset\n\nOptional. Val data configured alongside train in the dataset config.\n\n## Important Parameters\n\n- **model.sem_seg_head.num_classes**: Number of segmentation class indices available to the head. Default 133 for COCO panoptic data when `dataset.contiguous_id: True` remaps raw category ids through the label map. Do not shrink this to a global workflow class count unless the label map and annotations have actually been reduced to that class set.\n- **model.one_former.hidden_dim**: Keep at 256 for local smoke runs unless\n  the text encoder width is changed in lock-step. Reducing hidden_dim alone\n  causes a text feature\u002Fcontext dimension mismatch during training.\n- **model.backbone.name**: Default D2SwinTransformer (Swin-based). embed_dim=192, depths=[2,2,18,2] by default.\n- **train.num_epochs**: Default 50 — significantly higher than most TAO models. OneFormer needs more epochs for convergence.\n- **train.optim.lr**: Learning rate. Default 1e-5. Lower than Mask2Former's 2e-4.\n- **model.task_toggling**: Enable\u002Fdisable specific tasks: semantic_on, instance_on, panoptic_on.\n- **export.task**: Export task mode. Options: semantic, instance, panoptic. Default semantic. Export input defaults to 640x640.\n- **inference.mode**: Inference mode. Options: semantic, instance, panoptic. Default semantic. image_size defaults to [1024, 1024].\n- **evaluate.iou_per_class**: Report per-class IoU in evaluation. Default True.\n\n## Multi-GPU \u002F Multi-Node\n\n**Launch method:** Lightning-managed (single `python` process, Lightning spawns workers).\n\n| Spec Key | Description | Default |\n|----------|-------------|---------|\n| `train.num_gpus` | Number of GPUs | 1 |\n| `train.gpu_ids` | GPU device indices | [0] |\n| `train.num_nodes` | Number of nodes | 1 |\n\n- Uses explicit `DDPStrategy` with `find_unused_parameters=True`, `gradient_as_bucket_view=True`, `process_group_backend=\"nccl\"`\n- `sync_batchnorm` is always enabled\n- No fsdp support — DDP only\n\n**Multi-node env vars** (set by orchestrator): `WORLD_SIZE`, `NODE_RANK`, `MASTER_ADDR`, `MASTER_PORT`, `NUM_GPU_PER_NODE`.\n\n## Hardware\n\nMinimum 2 GPU(s), recommended 4 GPU(s). 24GB+ (A100 recommended) VRAM per GPU. OneFormer is memory-intensive like Mask2Former. batch_size=1 is the default. Multi-GPU needed for reasonable training speed, especially with 50 epochs.\n\n## Error Patterns\n\n**CUDA out of memory**: batch_size is already 1. Reduce image resolution or use a smaller Swin configuration.\n\n**Extracted S3 tarball points one level too high**: For local Docker runs,\n`images.tar.gz` and `images_panoptic.tar.gz` may extract wrapper directories\nsuch as `images\u002F` and `images_panoptic\u002F`. Set `dataset.*.images`,\n`dataset.*.panoptic`, `inference.images_dir`, and quantization calibration\npaths to the actual folder containing image or panoptic files, not the wrapper\ndirectory. A one-level-too-high path fails with `FileNotFoundError` for the\nfirst annotation image even though recursive file counts look correct.\n\n**default_specs missing results_dir**: The CLI `default_specs` subtask ignores\n`-e` experiment specs for `results_dir`; pass a Hydra-style override instead:\n`oneformer default_specs results_dir=\u002Fpath\u002Fto\u002Fdefault_specs`.\n\n**Invalid Lightning precision `fp32`**: Use `train.precision: \"32\"` in\ntrain\u002FAutoML\u002Fevaluate\u002Finference specs. The current Lightning stack rejects the\nlegacy `fp32` string.\n\n**PyTorch 2.6 checkpoint load failure on downstream actions**: Current\nOneFormer checkpoints include OmegaConf objects. For checkpoints produced by\nthe same trusted TAO train\u002FAutoML workflow, set\n`TORCH_FORCE_NO_WEIGHTS_ONLY_LOAD=1` in downstream evaluate, inference, export,\nquantize, or resume job env vars so Lightning can load the full checkpoint.\nDo not use this env var for untrusted checkpoints.\n\n**CUDA device-side assert in matcher\u002Fclass cost**: If training fails in\n`oneformer\u002Futils\u002Fmatcher.py` while indexing `out_prob[:, tgt_ids]`, compare\nthe effective target ids with `model.sem_seg_head.num_classes`. The packaged\nCOCO panoptic sample has 133 compact classes after `dataset.contiguous_id:\nTrue` remapping, so use `model.sem_seg_head.num_classes: 133` even when a\nbroader validation workflow passes a smaller generic `num_classes` value.\nOnly use a smaller class count when the label map and annotations are reduced\nto that exact contiguous class set.\n\n**Inference returns PASS with no predictions**: OneFormer prediction reads\n`inference.images_dir`, not `dataset.test.images`. Declare and populate\n`inference.images_dir` with the image folder or tarball for every inference\nrun. `dataset.test.images` may still be useful for shared dataset context, but\nit does not drive the PyTorch predict dataloader.\n\n**Export output path pre-created as a directory**: Do not declare\n`export.onnx_file` as a file output. The OneFormer exporter asserts that the\nONNX path does not already exist, while the local runner pre-creates declared\noutput paths. Set `export.onnx_file` explicitly in the spec to a non-existing\nfile path under the mounted results tree. Keep the default 640x640 export\nshape for smoke validation; very small export shapes can trigger PyTorch ONNX\nshape-inference failures.\n\n**Quantize cannot find the training label map from an AutoML checkpoint**:\nOneFormer Lightning checkpoints retain train-time absolute dataset paths in\ntheir saved hparams. When running downstream actions from an AutoML child\ncheckpoint, keep the parent AutoML job directory accessible at its original\n`\u002Fresults\u002F\u003Cjob_id>` path inside the action container in addition to passing the\nresolved checkpoint path. Otherwise quantize can fail while loading checkpoint\nhparams even when the current spec includes a valid `dataset.label_map`.\n\n**Slow training**: 50 default epochs with batch_size=1 is slow on single GPU. Use multi-GPU distributed training.\n\n## Spec Param \u002F Parent Model Inference\n\nModel-specific inference mappings belong in this MD file, not in `config.json`. Generated runners should read this section and apply the mappings with SDK helpers before `create_job()`. This mirrors the old microservices `infer_params.py` flow.\n\nInference mappings from TAO Core `oneformer.config.json`:\n\n| Action | Spec Field | Inference Function | Meaning |\n|---|---|---|---|\n| evaluate | `encryption_key` | `key` | encryption key |\n| evaluate | `evaluate.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| evaluate | `evaluate.trt_engine` | `parent_model` | model file inferred from the parent job results folder |\n| evaluate | `results_dir` | `output_dir` | current job results directory |\n| export | `encryption_key` | `key` | encryption key |\n| export | `export.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| export | `export.onnx_file` | `create_onnx_file` | output ONNX path |\n| export | `results_dir` | `output_dir` | current job results directory |\n| gen_trt_engine | `encryption_key` | `key` | encryption key |\n| gen_trt_engine | `gen_trt_engine.onnx_file` | `parent_model` | model file inferred from the parent job results folder |\n| gen_trt_engine | `gen_trt_engine.trt_engine` | `create_engine_file` | output TensorRT engine path |\n| gen_trt_engine | `results_dir` | `output_dir` | current job results directory |\n| inference | `encryption_key` | `key` | encryption key |\n| inference | `inference.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| inference | `inference.trt_engine` | `parent_model` | model file inferred from the parent job results folder |\n| inference | `results_dir` | `output_dir` | current job results directory |\n| quantize | `encryption_key` | `key` | encryption key |\n| quantize | `quantize.model_path` | `parent_model` | model file inferred from the parent job results folder |\n| quantize | `results_dir` | `output_dir` | current job results directory |\n| train | `encryption_key` | `key` | encryption key |\n| train | `results_dir` | `output_dir` | current job results directory |\n| train | `train.pretrained_backbone` | `{'link': 'https:\u002F\u002Fgithub.com\u002FSwinTransformer\u002Fstorage\u002Freleases\u002Fdownload\u002Fv1.0.8\u002Fswin_tiny_patch4_window7_224_22k.pth', 'destination_path': '\u002Fptm\u002Fmask2former\u002Fswin_tiny_patch4_window7_224_22k\u002Fswin_tiny_patch4_window7_224_22k.pth'}` | {'link': 'https:\u002F\u002Fgithub.com\u002FSwinTransformer\u002Fstorage\u002Freleases\u002Fdownload\u002Fv1.0.8\u002Fswin_tiny_patch4_window7_224_22k.pth', 'destination_path': '\u002Fptm\u002Fmask2former\u002Fswin_tiny_patch4_window7_224_22k\u002Fswin_tiny_patch4_window7_224_22k.pth'} |\n| train | `train.pretrained_model` | `ptm_if_no_resume_model` | PTM when no resume checkpoint exists |\n| train | `train.resume_training_checkpoint_path` | `resume_model` | model file inferred from the current job results folder |\n\nFor `parent_model` or `parent_model_folder`, pass the upstream train\u002Fexport\u002FAutoML child job id as `parent_job_id`. The SDK lists the parent result folder, filters checkpoint artifacts, and returns the selected model file or folder. Do not add these mappings back to `config.json` and do not patch generated runner scripts to guess checkpoint paths.\n\n## Deployment\n\n- [tao-deploy-oneformer](references\u002Ftao-deploy-oneformer.md)\n","# OneFormer\n\nOneFormer for universal image segmentation. Unifies panoptic, instance, and semantic segmentation with a single architecture using task-conditioned queries.\n\nSet train.pretrained_backbone and\u002For train.pretrained_model.\n\nFor TAO Deploy TensorRT actions (`gen_trt_engine`, TensorRT `evaluate`, and TensorRT `inference`), read `references\u002Ftao-deploy-oneformer.md` first. Deploy spec templates live in this skill's `references\u002F` folder with the `spec_template_deploy_*.yaml` prefix.\n\n## Dataclass Schemas\n\nGenerated TAO Core schemas are packaged in `schemas\u002F\u003Caction>.schema.json`, with `schemas\u002Fmanifest.json` listing available actions. Each generated schema also emits `references\u002Fspec_template_\u003Caction>.yaml` from the schema top-level `default` field. AutoML enablement is declared at the model layer in `references\u002Fskill_info.yaml` via `automl_enabled`. Runnable AutoML still requires `schemas\u002Ftrain.schema.json` and `references\u002Fspec_template_train.yaml` to exist and parse. Use the packaged train schema for `automl_default_parameters`, `automl_disabled_parameters`, defaults, min\u002Fmax bounds, enums, option weights, math conditions, dependencies, and popular parameters. Do not expect `~\u002Ftao-core` at runtime; maintainers regenerate schemas\u002Ftemplates before packaging the skill bank.\n\n## Train Action Policy\n\nThis model is AutoML-enabled at the model layer. Before handling any train-stage request, read `references\u002Fskill_info.yaml` and resolve the run override from either an explicit `automl_policy` value or the user's workflow request. Use `automl_policy: on` by default and only expose `on` \u002F `off` in new launch prompts. Treat phrases like \"turn off AutoML\", \"disable AutoML\", \"no HPO\", or \"plain training\" as `automl_policy: off` for this run only. When `automl_policy: on`, `automl_enabled: true`, and both `schemas\u002Ftrain.schema.json` and `references\u002Fspec_template_train.yaml` are packaged, route the train action through `tao-skill-bank:tao-run-automl` by default with this model's `skill_dir`. Preserve workflow\u002Fapplication overrides for datasets, specs, output directories, GPU\u002Fplatform settings, parent checkpoints, and `automl_policy`. Use direct model training only when `automl_policy: off` or the packaged train schema\u002Ftemplate is missing; in the missing-schema case, report that AutoML is enabled but not runnable for this model until schemas are generated.\n\nNon-train actions such as `evaluate`, `inference`, `export`, and deploy flows stay in this model skill. The per-run `automl_policy` override does not change model metadata.\n\n## Training Requirements\n\n- **Dataset type:** segmentation\n- **Formats:** coco_panoptic, coco\n- **Monitoring metric:** mIoU\n\n### Per-Action Dataset Requirements\n\n| Action | Spec Key | Source | Files | List? |\n|---|---|---|---|---|\n| evaluate | dataset.train.images | train_datasets | images.tar.gz | No |\n| evaluate | dataset.label_map | train_datasets | label_map.json | No |\n| evaluate | dataset.train.annotations | train_datasets | annotations.json | No |\n| evaluate | dataset.train.panoptic | train_datasets | images_panoptic.tar.gz | No |\n| evaluate | dataset.val.images | eval_dataset | images.tar.gz | No |\n| evaluate | dataset.val.annotations | eval_dataset | annotations.json | No |\n| evaluate | dataset.val.panoptic | eval_dataset | images_panoptic.tar.gz | No |\n| evaluate | dataset.test.images | eval_dataset | images.tar.gz | No |\n| evaluate | dataset.test.annotations | eval_dataset | annotations.json | No |\n| evaluate | dataset.test.panoptic | eval_dataset | images_panoptic.tar.gz | No |\n| inference | dataset.train.images | train_datasets | images.tar.gz | No |\n| inference | dataset.label_map | train_datasets | label_map.json | No |\n| inference | dataset.train.annotations | train_datasets | annotations.json | No |\n| inference | dataset.train.panoptic | train_datasets | images_panoptic.tar.gz | No |\n| inference | dataset.val.images | eval_dataset | images.tar.gz | No |\n| inference | dataset.val.annotations | eval_dataset | annotations.json | No |\n| inference | dataset.val.panoptic | eval_dataset | images_panoptic.tar.gz | No |\n| inference | dataset.test.images | inference_dataset | images.tar.gz | No |\n| quantize | dataset.train.images | train_datasets | images.tar.gz | No |\n| quantize | dataset.train.annotations | train_datasets | annotations.json | No |\n| quantize | dataset.label_map | train_datasets | label_map.json | No |\n| quantize | dataset.train.panoptic | train_datasets | images_panoptic.tar.gz | No |\n| quantize | dataset.val.images | eval_dataset | images.tar.gz | No |\n| quantize | dataset.val.annotations | eval_dataset | annotations.json | No |\n| quantize | dataset.val.panoptic | eval_dataset | images_panoptic.tar.gz | No |\n| quantize | dataset.test.images | eval_dataset | images.tar.gz | No |\n| quantize | dataset.quant_calibration_dataset.images_dir | calibration_dataset | images.tar.gz | No |\n| train | dataset.train.images | train_datasets | images.tar.gz | No |\n| train | dataset.train.annotations | train_datasets | annotations.json | No |\n| train | dataset.label_map | train_datasets | label_map.json | No |\n| train | dataset.train.panoptic | train_datasets | images_panoptic.tar.gz | No |\n| train | dataset.val.images | eval_dataset | images.tar.gz | No |\n| train | dataset.val.annotations | eval_dataset | annotations.json | No |\n| train | dataset.val.panoptic | eval_dataset | images_panoptic.tar.gz | No |\n| train | dataset.test.images | eval_dataset | images.tar.gz | No |\n\n### Typical Spec Overrides\n\nData source overrides are **mandatory for every action** — the agent MUST construct data source paths from the Per-Action Dataset Requirements table above and include them in `spec_overrides`.\n\n```python\nS3_TRAIN = \"s3:\u002F\u002Fbucket\u002Fdata\u002Ftrain\"\nS3_EVAL = \"s3:\u002F\u002Fbucket\u002Fdata\u002Feval\"\nS3_INFERENCE = \"s3:\u002F\u002Fbucket\u002Fdata\u002Finference\"\nS3_CALIBRATION = \"s3:\u002F\u002Fbucket\u002Fdata\u002Fcalibration\"\n```\n\n**train (mandatory data sources):**\n```python\n{\n    \"train.num_gpus\": 1,\n    \"train.num_epochs\": 10,\n    \"train.checkpoint_interval\": 10,\n    \"train.validation_interval\": 10,\n    \"model.sem_seg_head.num_classes\": 133,\n    \"dataset.contiguous_id\": True,\n    \"train.precision\": \"32\",\n    \"dataset.train.images\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.train.annotations\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.label_map\": f\"{S3_TRAIN}\u002Flabel_map.json\",\n    \"dataset.train.panoptic\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.annotations\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n}\n```\n\n**evaluate (mandatory data sources):**\n```python\n{\n    \"evaluate.checkpoint\": \"\u003Cselected train\u002FAutoML checkpoint>\",\n    \"model.sem_seg_head.num_classes\": 133,\n    \"dataset.contiguous_id\": True,\n    \"dataset.train.images\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.label_map\": f\"{S3_TRAIN}\u002Flabel_map.json\",\n    \"dataset.train.annotations\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.train.panoptic\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.annotations\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.test.annotations\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.test.panoptic\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n}\n```\n\n**export:**\n```python\n{\n    \"export.checkpoint\": \"\u003Cselected train\u002FAutoML checkpoint>\",\n    \"model.sem_seg_head.num_classes\": 133,\n    \"model.export\": True,\n    \"export.onnx_file\": \"\u002Fresults\u002Foneformer_export_640.onnx\",\n}\n```\n\n**inference (mandatory data sources):**\n```python\n{\n    \"inference.checkpoint\": \"\u003Cselected train\u002FAutoML checkpoint>\",\n    \"dataset.train.images\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.label_map\": f\"{S3_TRAIN}\u002Flabel_map.json\",\n    \"dataset.train.annotations\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.train.panoptic\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.annotations\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.images\": f\"{S3_INFERENCE}\u002Fimages.tar.gz\",\n    \"inference.images_dir\": f\"{S3_INFERENCE}\u002Fimages.tar.gz\",\n}\n```\n\n**quantize (mandatory data sources):**\n```python\n{\n    \"quantize.model_path\": \"\u003Cselected train\u002FAutoML checkpoint>\",\n    \"dataset.train.images\": f\"{S3_TRAIN}\u002Fimages.tar.gz\",\n    \"dataset.train.annotations\": f\"{S3_TRAIN}\u002Fannotations.json\",\n    \"dataset.label_map\": f\"{S3_TRAIN}\u002Flabel_map.json\",\n    \"dataset.train.panoptic\": f\"{S3_TRAIN}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.val.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.val.annotations\": f\"{S3_EVAL}\u002Fannotations.json\",\n    \"dataset.val.panoptic\": f\"{S3_EVAL}\u002Fimages_panoptic.tar.gz\",\n    \"dataset.test.images\": f\"{S3_EVAL}\u002Fimages.tar.gz\",\n    \"dataset.quant_calibration_dataset.images_dir\": f\"{S3_CALIBRATION}\u002Fimages.tar.gz\",\n}\n```\n\n## Checkpoint Selection\n\nOneFormer training writes epoch-step checkpoints such as\n`model_epoch_000_step_00017.pth` and may also write a\n`oneformer_model_latest.pth` symlink. For checkpoint-dependent actions, use the\nmodel-skill or SDK parent-model resolver and pass the exact selected checkpoint\npath into `evaluate.checkpoint`, `inference.checkpoint`, `export.checkpoint`,\n`quantize.model_path`, or `train.resume_training_checkpoint_path`. Do not pick\nthe `oneformer_model_latest.pth` symlink by name unless the user explicitly asks\nfor latest checkpoint behavior. If the resolver reports a best checkpoint, use\nthat best checkpoint for evaluation\u002Fexport\u002Finference; if the user asks for a\nspecific epoch or step, use the matching epoch-step checkpoint.\n## Eval Dataset\n\nOptional. Val data configured alongside train in the dataset config.\n\n## Important Parameters\n\n- **model.sem_seg_head.num_classes**: Number of segmentation class indices available to the head. Default 133 for COCO panoptic data when `dataset.contiguous_id: True` remaps raw category ids through the label map. Do not shrink this to a global workflow class count unless the label map and annotations have actually been reduced to that class set.\n- **model.one_former.hidden_dim**: Keep at 256 for local smoke runs unless\n  the text encoder width is changed in lock-step. Reducing hidden_dim alone\n  causes a text feature\u002Fcontext dimension mismatch during training.\n- **model.backbone.name**: Default D2SwinTransformer (Swin-based). embed_dim=192, depths=[2,2,18,2] by default.\n- **train.num_epochs**: Default 50 — significantly higher than most TAO models. OneFormer needs more epochs for convergence.\n- **train.optim.lr**: Learning rate. Default 1e-5. Lower than Mask2Former's 2e-4.\n- **model.task_toggling**: Enable\u002Fdisable specific tasks: semantic_on, instance_on, panoptic_on.\n- **export.task**: Export task mode. Options: semantic, instance, panoptic. Default semantic. Export input defaults to 640x640.\n- **inference.mode**: Inference mode. Options: semantic, instance, panoptic. Default semantic. image_size defaults to [1024, 1024].\n- **evaluate.iou_per_class**: Report per-class IoU in evaluation. Default True.\n\n## Multi-GPU \u002F Multi-Node\n\n**Launch method:** Lightning-managed (single `python` process, Lightning spawns workers).\n\n| Spec Key | Description | Default |\n|----------|-------------|---------|\n| `train.num_gpus` | Number of GPUs | 1 |\n| `train.gpu_ids` | GPU device indices | [0] |\n| `train.num_nodes` | Number of nodes | 1 |\n\n- Uses explicit `DDPStrategy` with `find_unused_parameters=True`, `gradient_as_bucket_view=True`, `process_group_backend=\"nccl\"`\n- `sync_batchnorm` is always enabled\n- No fsdp support — DDP only\n\n**Multi-node env vars** (set by orchestrator): `WORLD_SIZE`, `NODE_RANK`, `MASTER_ADDR`, `MASTER_PORT`, `NUM_GPU_PER_NODE`.\n\n## Hardware\n\nMinimum 2 GPU(s), recommended 4 GPU(s). 24GB+ (A100 recommended) VRAM per GPU. OneFormer is memory-intensive like Mask2Former. batch_size=1 is the default. Multi-GPU needed for reasonable training speed, especially with 50 epochs.\n\n## Error Patterns\n\n**CUDA out of memory**: batch_size is already 1. Reduce image resolution or use a smaller Swin configuration.\n\n**Extracted S3 tarball points one level too high**: For local Docker runs,\n`images.tar.gz` and `images_panoptic.tar.gz` may extract wrapper directories\nsuch as `images\u002F` and `images_panoptic\u002F`. Set `dataset.*.images`,\n`dataset.*.panoptic`, `inference.images_dir`, and quantization calibration\npaths to the actual folder containing image or panoptic files, not the wrapper\ndirectory. A one-level-too-high path fails with `FileNotFoundError` for the\nfirst annotation image even though recursive file counts look correct.\n\n**default_specs missing results_dir**: The CLI `default_specs` subtask ignores\n`-e` experiment specs for `results_dir`; pass a Hydra-style override instead:\n`oneformer default_specs results_dir=\u002Fpath\u002Fto\u002Fdefault_specs`.\n\n**Invalid Lightning precision `fp32`**: Use `train.precision: \"32\"` in\ntrain\u002FAutoML\u002Fevaluate\u002Finference specs. The current Lightning stack rejects the\nlegacy `fp32` string.\n\n**PyTorch 2.6 checkpoint load failure on downstream actions**: Current\nOneFormer checkpoints include OmegaConf objects. For checkpoints produced by\nthe same trusted TAO train\u002FAutoML workflow, set\n`TORCH_FORCE_NO_WEIGHTS_ONLY_LOAD=1` in downstream evaluate, inference, export,\nquantize, or resume job env vars so Lightning can load the full checkpoint.\nDo not use this env var for untrusted checkpoints.\n\n**CUDA device-side assert in matcher\u002Fclass cost**: If training fails in\n`oneformer\u002Futils\u002Fmatcher.py` while indexing `out_prob[:, tgt_ids]`, compare\nthe effective target ids with `model.sem_seg_head.num_classes`. The packaged\nCOCO panoptic sample has 133 compact classes after `dataset.contiguous_id:\nTrue` remapping, so use `model.sem_seg_head.num_classes: 133` even when a\nbroader validation workflow passes a smaller generic `num_classes` value.\nOnly use a smaller class count when the label map and annotations are reduced\nto that exact contiguous class set.\n\n**Inference returns PASS with no predictions**: OneFormer prediction reads\n`inference.images_dir`, not `dataset.test.images`. Declare and populate\n`inference.images_dir` with the image folder or tarball for every inference\nrun. `dataset.test.images` may still be useful for shared dataset context, but\nit does not drive the PyTorch predict dataloader.\n\n**Export output path pre-created as a directory**: Do not declare\n`export.onnx_file` as a file output. The OneFormer exporter asserts that the\nONNX path does not already exist, while the local runner pre-creates declared\noutput paths. Set `export.onnx_file` explicitly in the spec to a non-existing\nfile path under the mounted results tree. Keep the default 640x640 export\nshape for smoke validation; very small export shapes can trigger PyTorch ONNX\nshape-inference failures.\n\n**Quantize cannot find the training label map from an AutoML checkpoint**:\nOneFormer Lightning checkpoints retain train-time absolute dataset paths in\ntheir saved hparams. When running downstream actions from an AutoML child\ncheckpoint, keep the parent AutoML job directory accessible at its original\n`\u002Fresults\u002F\u003Cjob_id>` path inside the action container in addition to passing the\nresolved checkpoint path. Otherwise quantize can fail while loading checkpoint\nhparams even when the current spec includes a valid `dataset.label_map`.\n\n**Slow training**: 50 default epochs with batch_size=1 is slow on single GPU. Use multi-GPU distributed training.\n\n## Spec Param \u002F Parent Model Inference\n\nModel-specific inference mappings belong in this MD file, not in `config.json`. Generated runners should read this section and apply the mappings with SDK helpers before `create_job()`. This mirrors the old microservices `infer_params.py` flow.\n\nInference mappings from TAO Core `oneformer.config.json`:\n\n| Action | Spec Field | Inference Function | Meaning |\n|---|---|---|---|\n| evaluate | `encryption_key` | `key` | encryption key |\n| evaluate | `evaluate.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| evaluate | `evaluate.trt_engine` | `parent_model` | model file inferred from the parent job results folder |\n| evaluate | `results_dir` | `output_dir` | current job results directory |\n| export | `encryption_key` | `key` | encryption key |\n| export | `export.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| export | `export.onnx_file` | `create_onnx_file` | output ONNX path |\n| export | `results_dir` | `output_dir` | current job results directory |\n| gen_trt_engine | `encryption_key` | `key` | encryption key |\n| gen_trt_engine | `gen_trt_engine.onnx_file` | `parent_model` | model file inferred from the parent job results folder |\n| gen_trt_engine | `gen_trt_engine.trt_engine` | `create_engine_file` | output TensorRT engine path |\n| gen_trt_engine | `results_dir` | `output_dir` | current job results directory |\n| inference | `encryption_key` | `key` | encryption key |\n| inference | `inference.checkpoint` | `parent_model` | model file inferred from the parent job results folder |\n| inference | `inference.trt_engine` | `parent_model` | model file inferred from the parent job results folder |\n| inference | `results_dir` | `output_dir` | current job results directory |\n| quantize | `encryption_key` | `key` | encryption key |\n| quantize | `quantize.model_path` | `parent_model` | model file inferred from the parent job results folder |\n| quantize | `results_dir` | `output_dir` | current job results directory |\n| train | `encryption_key` | `key` | encryption key |\n| train | `results_dir` | `output_dir` | current job results directory |\n| train | `train.pretrained_backbone` | `{'link': 'https:\u002F\u002Fgithub.com\u002FSwinTransformer\u002Fstorage\u002Freleases\u002Fdownload\u002Fv1.0.8\u002Fswin_tiny_patch4_window7_224_22k.pth', 'destination_path': '\u002Fptm\u002Fmask2former\u002Fswin_tiny_patch4_window7_224_22k\u002Fswin_tiny_patch4_window7_224_22k.pth'}` | {'link': 'https:\u002F\u002Fgithub.com\u002FSwinTransformer\u002Fstorage\u002Freleases\u002Fdownload\u002Fv1.0.8\u002Fswin_tiny_patch4_window7_224_22k.pth', 'destination_path': '\u002Fptm\u002Fmask2former\u002Fswin_tiny_patch4_window7_224_22k\u002Fswin_tiny_patch4_window7_224_22k.pth'} |\n| train | `train.pretrained_model` | `ptm_if_no_resume_model` | PTM when no resume checkpoint exists |\n| train | `train.resume_training_checkpoint_path` | `resume_model` | model file inferred from the current job results folder |\n\nFor `parent_model` or `parent_model_folder`, pass the upstream train\u002Fexport\u002FAutoML child job id as `parent_job_id`. The SDK lists the parent result folder, filters checkpoint artifacts, and returns the selected model file or folder. Do not add these mappings back to `config.json` and do not patch generated runner scripts to guess checkpoint paths.\n\n## Deployment\n\n- [tao-deploy-oneformer](references\u002Ftao-deploy-oneformer.md)\n",{"name":5,"tags":24,"license":15,"metadata":26,"description":7,"allowed-tools":29,"compatibility":30},[25],"segmentation",{"author":27,"version":28},"NVIDIA Corporation","0.1.0","Read Bash","Requires docker + nvidia-container-toolkit.","main","86cc27ffd16af6cb85948f1155578e6f3f61cc4c","skillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn","https:\u002F\u002Fgithub.com\u002FSolizardking","https:\u002F\u002Fmusebook.trade","Got a mile high and never came down","2026-10-08 11:52:53",{"source":8,"skillName":5,"commands":40,"prompt":50,"zipAvailable":51},[41,44,47],{"tool":42,"command":43},"npx","npx skills add Solizardking\u002Ftrain2earn --skill tao-train-oneformer",{"tool":45,"command":46},"bunx","bunx skills add Solizardking\u002Ftrain2earn --skill tao-train-oneformer",{"tool":48,"command":49},"pnpm","pnpm dlx skills add Solizardking\u002Ftrain2earn --skill tao-train-oneformer","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002FSKILL.md",true,[53,59,63,67,71,75,78,82,86,90,94,98,101,105,109,113,117,121,124,128,132,136,140],{"path":54,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":57,"sourceHtmlUrl":58},"BENCHMARK.md","REFERENCE","参考文档",4072,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002FBENCHMARK.md",{"path":60,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":61,"sourceHtmlUrl":62},"evals\u002Fevals.json",783,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Fevals\u002Fevals.json",{"path":64,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":65,"sourceHtmlUrl":66},"references\u002Fskill_info.yaml",9661,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Freferences\u002Fskill_info.yaml",{"path":68,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":69,"sourceHtmlUrl":70},"references\u002Fspec_template_deploy_evaluate.yaml",521,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Freferences\u002Fspec_template_deploy_evaluate.yaml",{"path":72,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":73,"sourceHtmlUrl":74},"references\u002Fspec_template_deploy_gen_trt_engine.yaml",277,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Freferences\u002Fspec_template_deploy_gen_trt_engine.yaml",{"path":76,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":69,"sourceHtmlUrl":77},"references\u002Fspec_template_deploy_inference.yaml","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Freferences\u002Fspec_template_deploy_inference.yaml",{"path":79,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":80,"sourceHtmlUrl":81},"references\u002Fspec_template_evaluate.yaml",4751,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Freferences\u002Fspec_template_evaluate.yaml",{"path":83,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":84,"sourceHtmlUrl":85},"references\u002Fspec_template_export.yaml",4820,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Freferences\u002Fspec_template_export.yaml",{"path":87,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":88,"sourceHtmlUrl":89},"references\u002Fspec_template_gen_trt_engine.yaml",4883,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Freferences\u002Fspec_template_gen_trt_engine.yaml",{"path":91,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":92,"sourceHtmlUrl":93},"references\u002Fspec_template_inference.yaml",4796,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Freferences\u002Fspec_template_inference.yaml",{"path":95,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":96,"sourceHtmlUrl":97},"references\u002Fspec_template_quantize.yaml",4604,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Freferences\u002Fspec_template_quantize.yaml",{"path":99,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":96,"sourceHtmlUrl":100},"references\u002Fspec_template_train.yaml","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Freferences\u002Fspec_template_train.yaml",{"path":102,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":103,"sourceHtmlUrl":104},"references\u002Ftao-deploy-oneformer.md",6134,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Freferences\u002Ftao-deploy-oneformer.md",{"path":106,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":107,"sourceHtmlUrl":108},"references\u002Ftao-deploy-oneformer.skill_info.yaml",3759,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Freferences\u002Ftao-deploy-oneformer.skill_info.yaml",{"path":110,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":111,"sourceHtmlUrl":112},"schemas\u002Fevaluate.schema.json",74630,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Fschemas\u002Fevaluate.schema.json",{"path":114,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":115,"sourceHtmlUrl":116},"schemas\u002Fexport.schema.json",75291,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Fschemas\u002Fexport.schema.json",{"path":118,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":119,"sourceHtmlUrl":120},"schemas\u002Fgen_trt_engine.schema.json",77185,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Fschemas\u002Fgen_trt_engine.schema.json",{"path":122,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":115,"sourceHtmlUrl":123},"schemas\u002Finference.schema.json","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Fschemas\u002Finference.schema.json",{"path":125,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":126,"sourceHtmlUrl":127},"schemas\u002Fmanifest.json",18662,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Fschemas\u002Fmanifest.json",{"path":129,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":130,"sourceHtmlUrl":131},"schemas\u002Fquantize.schema.json",71837,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Fschemas\u002Fquantize.schema.json",{"path":133,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":134,"sourceHtmlUrl":135},"schemas\u002Ftrain.schema.json",71831,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Fschemas\u002Ftrain.schema.json",{"path":137,"resourceType":55,"resourceTypeDesc":56,"sizeBytes":138,"sourceHtmlUrl":139},"skill-card.md",4002,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Fskill-card.md",{"path":141,"resourceType":142,"resourceTypeDesc":143,"sizeBytes":144,"sourceHtmlUrl":145},"skill.oms.sig","OTHER","其他",9361,"https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fnvidia\u002Ftao-train-oneformer\u002Fskill.oms.sig",[147,155,163,171,178,186],{"skillNo":148,"name":149,"nameZh":6,"description":150,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":151,"licenseFileUrl":6,"sourceHtmlUrl":152,"categories":153,"keywords":154,"publishedAt":19},"01M78B94RSCAKMH1QS79VE6DG9","testing","For testing with Light Protocol programs and clients on localnet, devnet, and mainnet validation.","MIT","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Ftesting\u002FSKILL.md",[],[],{"skillNo":156,"name":157,"nameZh":6,"description":158,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":151,"licenseFileUrl":159,"sourceHtmlUrl":160,"categories":161,"keywords":162,"publishedAt":19},"01M78B81BKY8RX12HETPG8YKWK","qedgen","Formally verify programs by writing Lean 4 proofs. Trigger this skill whenever the user wants to formally verify code, generate Lean 4 proofs, prove properties about algorithms or smart contracts, verify invariants, convert program logic into formal specifications, or anything involving Lean 4 and formal verification. Also trigger when the user mentions \"qedgen\", \"lean proof\", \"formal proof\", \"verify my code\", \"prove correctness\", \"formal verification\", or wants mathematical guarantees about their implementation.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-formal-verification\u002FLICENSE","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-formal-verification\u002FSKILL.md",[],[],{"skillNo":164,"name":165,"nameZh":6,"description":166,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":151,"licenseFileUrl":167,"sourceHtmlUrl":168,"categories":169,"keywords":170,"publishedAt":19},"01M78B7Q7C5K54E01DN83A60KG","solana-dev","Use when user asks to \"build a Solana dapp\", \"write an Anchor program\", \"create a token\", \"debug Solana errors\", \"set up wallet connection\", \"test my Solana program\", \"deploy to devnet\", or \"explain Solana concepts\" (rent, accounts, PDAs, CPIs, etc.). Also use for quick on-chain lookups via public RPC + curl — \"what's the balance of \u003Cwallet>\", \"look up transaction \u003Csig>\", \"token balance for \u003Caccount>\", \"check this address on mainnet\u002Fdevnet\". End-to-end Solana development playbook covering wallet connection, Anchor\u002FPinocchio programs, Codama client generation, LiteSVM\u002FMollusk\u002FSurfpool testing, security checklists, and JSON-RPC curl lookups against public clusters. Integrates with the Solana MCP server for live documentation search. Prefers framework-kit (@solana\u002Fclient + @solana\u002Freact-hooks) for UI, wallet-standard-first connection (incl. ConnectorKit), @solana\u002Fkit for client\u002FRPC code, and @solana\u002Fweb3-compat for legacy boundaries.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-dev\u002FLICENSE","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-dev\u002FSKILL.md",[],[],{"skillNo":172,"name":173,"nameZh":6,"description":174,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":151,"licenseFileUrl":6,"sourceHtmlUrl":175,"categories":176,"keywords":177,"publishedAt":19},"01M78B7HXD6N6GWKSVRQ8F6Q31","solana-common-errors","Diagnose and fix common Solana development errors — GLIBC mismatches, Anchor version conflicts, cargo build-sbf \u002F platform-tools failures, LiteSVM issues, edition2024 crate pins, RPC airdrops, and Anchor 0.29→0.32 migrations. Use when builds fail, Anchor CLI won't install, or CI breaks on Debian\u002FUbuntu.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fsolana-common-errors\u002FSKILL.md",[],[],{"skillNo":179,"name":180,"nameZh":6,"description":181,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":182,"sourceHtmlUrl":183,"categories":184,"keywords":185,"publishedAt":19},"01M78B6T7YSYWQ0N4DP40QDXEZ","skill-creator","Create or update AgentSkills. Use when designing, structuring, or packaging skills with scripts, references, and assets.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fskill-creator\u002Flicense.txt","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fskill-creator\u002FSKILL.md",[],[],{"skillNo":187,"name":188,"nameZh":6,"description":189,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":151,"licenseFileUrl":6,"sourceHtmlUrl":190,"categories":191,"keywords":192,"publishedAt":19},"01M78B1VFT9X5AND7AE1HZPZGF","phantom-wallet-mcp","Execute wallet operations through the Phantom MCP server. Use when the user wants to interact with their Phantom wallet directly — get addresses, transfer SOL or SPL tokens, buy\u002Fswap tokens, sign transactions, and sign messages across Solana, Ethereum, Bitcoin, and Sui. Requires the @phantom\u002Fmcp-server to be configured as an MCP server.","https:\u002F\u002Fgithub.com\u002FSolizardking\u002Ftrain2earn\u002Fblob\u002Fmain\u002Fskillhub\u002Fskills\u002Fphantom-wallet-mcp\u002FSKILL.md",[],[]]