training-data-configs
Plan Sana training data schemas, config overrides, launch commands, and safe validation for image, video, LoRA, Sprint, WM, Streaming, and Sol-RL workflows.
- License 许可
- Apache-2.0
- 最近更新
- 2026-09-03
- Stars
- ★ 351
- Forks
- 27
01 前言 Front Matter
- name
- training-data-configs
- license
- Apache 2.0
- metadata
- { "disco-role": "operating" }
- description
- Plan Sana training data schemas, config overrides, launch commands, and safe validation for image, video, LoRA, Sprint, WM, Streaming, and Sol-RL workflows.
- disable-model-invocation
- true
02 资源文件 6
- 参考文档references/data-and-configs.md11.8 KB
- 参考文档references/lora-and-post-training.md8.9 KB
- 参考文档references/training-workflows.md12.5 KB
- 参考文档references/troubleshooting.md9.4 KB
- 脚本scripts/plan_training_command.py21.0 KB
- 脚本scripts/validate_dataset_layout.py18.9 KB
03 SKILL.md 正文
Sana training data and config planner
Use this sub-skill when a user asks how to prepare data, choose a training recipe, plan config overrides, or draft a safe launch command for Sana training or post-training. It covers image-text training, multi-scale WIDS/WebDataset data, DDP/FSDP image training, Sprint sCM/LADD, DreamBooth LoRA, SANA-Video, LongSANA, SANA-WM Stage-1 and distillation, SANA-Streaming V2V, Sol-RL, and the boundary to Cosmos-RL.
Do not use this sub-skill for inference-only requests. Route image inference to the image-generation sub-skill, video/world/streaming inference to the video-world-streaming sub-skill, and metrics, conversion, or deployment requests to the evaluation-conversion-deployment sub-skill.
Fast operating path
- Classify the request into one training family:
- image: SanaImgDataset image-text pairs or SanaWebDatasetMS WIDS/WebDataset shards.
- sprint: one-step Sana-Sprint sCM plus LADD training.
- lora: DreamBooth LoRA over a diffusers Sana base model.
- video: SANA-Video 480p WanVAE or 720p LTX2 VAE training.
- longsana: LongSANA ODE, self-forcing, or long-video stage.
- wm-stage1: SANA-WM bidirectional or chunk-causal Stage-1 teacher.
- wm-distill: SANA-WM ODE, T43 self-forcing, or T121 self-forcing/DMD distillation.
- streaming-v2v: SANA-Streaming bidirectional short V2V or long V2V fine-tuning.
- sol-rl: in-repo reinforcement-learning post-training launchers.
- cosmos-rl: external Cosmos-RL SFT/RL integration boundary.
- Identify the data schema and verify it before planning training. Use the bundled validator when the user gives a local data path:
python skills/disco/sana/sub-skills/training-data-configs/scripts/validate_dataset_layout.py \
--path data/my_sana_data \
--mode auto \
--max-samples 20
- Generate a safe command plan instead of launching training. Use the bundled planner for a first draft:
python skills/disco/sana/sub-skills/training-data-configs/scripts/plan_training_command.py \
--family image \
--data-dir data/my_sana_data \
--data-type SanaImgDataset \
--work-dir output/my_sana_run \
--gpus 2 \
--batch-size 8 \
--num-workers 4
- Explain what the plan can and cannot verify locally. Dataset shape and manifest checks are safe; actual model loading, HF downloads, CUDA kernels, FSDP, CP, VAE encoding, reward services, and quality convergence are not verified by these helpers.
- When a command depends on external assets, call out the asset explicitly: HF model or dataset repo id, local checkpoint, reward checkpoint, VAE cache, WIDS metadata, wandb login, or distributed rendezvous settings.
Bundled references
references/data-and-configs.md: dataset layouts, WIDS/WebDataset conversion planning, config override syntax, and preflight checks.references/training-workflows.md: command templates for image, FSDP, Sprint, video, LongSANA, SANA-WM, SANA-Streaming, checkpoints, and native test candidates.references/lora-and-post-training.md: DreamBooth LoRA, Sol-RL, Cosmos-RL boundaries, rewards, and logging.references/troubleshooting.md: data, cache, VAE/text-feature, torchrun, FSDP, OOM, HF, wandb, resume, and license failure modes.
Source evidence labels
This sub-skill was distilled from Sana documentation, config classes, dataset loaders, train launchers, and training smoke tests. Evidence labels include docs/sana.md, docs/sana_sprint.md, docs/sana_lora_dreambooth.md, docs/sana_video.md, docs/longsana.md, docs/sana_wm.md, docs/sana_streaming.md, docs/sol_rl.md, docs/sana_cosmos_rl.md, diffusion/utils/config.py, diffusion/data/, train_scripts/, train_video_scripts/, configs/, and tests/bash/training/.
04 同仓库更多 Skills
passnet-triton-opt
Make a single PassNet Triton kernel fast AND numerically faithful: performance model (when a replacement can win at all), block/grid/warp tuning, autotune policy, launch overhead, and per-op numeric recipes to pass the dtype baseline tolerances. Use when a pass matches and is correct but speedup below expected, or when correctness fails by small numeric margins.
passnet-solve
END-TO-END playbook for solving one PassNet sample: analyze the computation graphs, decide the optimization strategy (what to fuse, what to replace, what to leave alone), drive the iteration loop, and maximize the sample score. This is the ENTRY skill — invoke it first for any PassNet optimization task; it tells you when to use passnet-pattern-fusion, passnet-triton-opt and passnet-feedback.
passnet-skill
PassNet GPU kernel optimization via compiler passes. Design and implement Triton-based optimization passes, create pass files under ./pass_dir/, self-evaluate with pass_evaluator, and iterate to maximize GPU speedup.
passnet-pattern-fusion
Author PassNet pass files: write patterns that actually MATCH the FX graph, pick fusion regions (which ops to absorb into one Triton kernel), and structure multi-pass submissions with the mandatory shared-dispatch architecture. Use when creating or fixing pattern()/replacement_args()/replacement_func() files, when a pass "failed to match", or when deciding how to fuse multiple kernels/ops.
passnet-orchestrate
Round/batch planning and decision support for PassNet graph optimization. Use for multi-sample triage, worker allocation, eval-budget policy, and post-eval keep/revert decisions. For solving one concrete sample end to end, use passnet-solve as the entry skill; consult this skill only when you need broader planning or a specific decision gate.
passnet-feedback
Fast, deterministic feedback for PassNet work: pre-flight pattern/match verification WITHOUT burning a GPU evaluation, per-node bottleneck analysis of a sample's graphs, and eval-log parsing into per-variant status + estimated score + failure classification. Use BEFORE every GPU evaluation (check_pattern), at the START of a sample (analyze_graph), and AFTER every evaluation (parse_eval_log).