[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7F8DN4NER7N5ME3MTH7G9Z8":3,"skill-same:01M7F8DN4NER7N5ME3MTH7G9Z8":62},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":27,"commitSha":28,"skillDirectory":29,"forksCount":30,"repositoryHtmlUrl":31,"repositoryHomepageUrl":6,"ownerHtmlUrl":32,"ownerBlogUrl":6,"ownerDescription":33,"updatedAt":34,"install":35,"resources":47},"01M7F8DN4NER7N5ME3MTH7G9Z8","data-and-tracking",null,"Use DALLE2-pytorch dataloaders, WebDataset and embedding layouts, tracker\u002Flog\u002Fsave\u002Fload configuration, and safe data-layout diagnostics for training workflows.","lza6\u002FArmor-piercing-system-prompts","lza6","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F128880206?v=4","01M7EB3K7WPX5T28EJ2NVHE6EG","Chinese-tingfeng","01M7EB3K97E1KQ16QWKJMFNGX8",11,"MIT","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F06-前端与设计\u002Fdalle2-pytorch\u002Fsub-skills\u002Fdata-and-tracking\u002FSKILL.md",[],[],"2026-11-16 10:05:34",false,"---\nname: data-and-tracking\ndescription: \"Use DALLE2-pytorch dataloaders, WebDataset and embedding layouts,\n  tracker\u002Flog\u002Fsave\u002Fload configuration, and safe data-layout diagnostics for\n  training workflows.\"\ndisable-model-invocation: true\nmetadata:\n  disco-role: operating\nlicense: MIT\n---\n\n# data-and-tracking\n\nUse this sub-skill when the task is to prepare DALLE2-pytorch training data, validate WebDataset\u002Fembedding shard layout, configure `ImageEmbeddingDataset` or `PriorEmbeddingDataset`, or set up experiment trackers, checkpoint loading, and checkpoint saving.\n\n## Load This When\n\n- Checking decoder WebDataset `.tar` shards, `.jpg`\u002F`.npy` keys, sidecar image\u002Ftext embedding folders, shard widths, or `index_width`.\n- Using `create_image_embedding_dataloader`, `ImageEmbeddingDataset`, `get_reader`, `make_splits`, or `PriorEmbeddingDataset`.\n- Debugging S3\u002Ffsspec data URLs, `s3cmd`, `s3fs`, missing embeddings, zero sidecar embeddings, or resampling\u002Fshuffling behavior.\n- Configuring console\u002FW&B logging, local\u002FURL\u002FW&B checkpoint loading, or local\u002FW&B\u002FHuggingFace saving.\n- Separating public package workflow guidance from credentials, private data, and tracker artifacts.\n\n## Route Elsewhere\n\n- Model architecture, prior\u002Fdecoder construction, `DALLE2`, `dream`, inpainting, or CLIP adapters: `..\u002Fgeneration-and-api\u002FSKILL.md`.\n- JSON training configs, trainer APIs, launcher commands, and distributed training: `..\u002Ftraining-and-configs\u002FSKILL.md`.\n\n## Runtime Contract\n\n- Public package: `pip install dalle2-pytorch`.\n- Public data imports: `from dalle2_pytorch.dataloaders import ImageEmbeddingDataset, create_image_embedding_dataloader, get_reader, make_splits, PriorEmbeddingDataset`.\n- Public tracker\u002Fconfig imports: `from dalle2_pytorch.train_configs import TrackerConfig`; tracker provider behavior lives behind config classes.\n- This skill does not provide datasets, credentials, model weights, S3 buckets, W&B runs, or HuggingFace tokens. It helps validate user-provided paths\u002Fconfigs safely.\n\n## References And Bundled Script\n\n- Decoder and prior data formats: [references\u002Fdata-formats.md](references\u002Fdata-formats.md).\n- Tracker, loader, saver, and checkpoint destinations: [references\u002Ftracking-and-checkpoints.md](references\u002Ftracking-and-checkpoints.md).\n- Data\u002Ftracker troubleshooting: [references\u002Ftroubleshooting.md](references\u002Ftroubleshooting.md).\n- Safe layout checker: [scripts\u002Fvalidate_webdataset_layout.py](scripts\u002Fvalidate_webdataset_layout.py).\n\n## Typical Flow\n\n1. Read [references\u002Fdata-formats.md](references\u002Fdata-formats.md) to decide whether the task uses decoder WebDataset shards or prior EmbeddingReader folders.\n2. For decoder configs, inspect shard and sidecar naming without loading large data:\n\n   ```bash\n   python scripts\u002Fvalidate_webdataset_layout.py --tar-pattern 'data\u002Fshards\u002F{}.tar' --start-shard 0 --end-shard 9 --shard-width 1 --index-width 4\n   ```\n\n3. Add sidecar folders when embeddings are outside the tar files:\n\n   ```bash\n   python scripts\u002Fvalidate_webdataset_layout.py --tar-pattern 'data\u002Fshards\u002F{}.tar' --start-shard 0 --end-shard 9 --shard-width 1 --index-width 4 --image-embeddings data\u002Fimg_emb --text-embeddings data\u002Ftext_emb\n   ```\n\n4. Read [references\u002Ftracking-and-checkpoints.md](references\u002Ftracking-and-checkpoints.md) before enabling W&B, HuggingFace, S3, URL loaders, or auto-resume.\n\n## Safety Defaults\n\n- Prefer local filesystem paths and `log_type: console` for first checks.\n- Do not inspect or upload private tracker credentials; require the user to supply and approve them at execution time.\n- Treat network, S3, W&B, HuggingFace, and URL loaders\u002Fsavers as credentialed or networked workflows, not default smoke tests.\n- Use `--inspect-tar` on at most a small shard; otherwise the bundled checker only validates names and file existence.\n","# data-and-tracking\n\nUse this sub-skill when the task is to prepare DALLE2-pytorch training data, validate WebDataset\u002Fembedding shard layout, configure `ImageEmbeddingDataset` or `PriorEmbeddingDataset`, or set up experiment trackers, checkpoint loading, and checkpoint saving.\n\n## Load This When\n\n- Checking decoder WebDataset `.tar` shards, `.jpg`\u002F`.npy` keys, sidecar image\u002Ftext embedding folders, shard widths, or `index_width`.\n- Using `create_image_embedding_dataloader`, `ImageEmbeddingDataset`, `get_reader`, `make_splits`, or `PriorEmbeddingDataset`.\n- Debugging S3\u002Ffsspec data URLs, `s3cmd`, `s3fs`, missing embeddings, zero sidecar embeddings, or resampling\u002Fshuffling behavior.\n- Configuring console\u002FW&B logging, local\u002FURL\u002FW&B checkpoint loading, or local\u002FW&B\u002FHuggingFace saving.\n- Separating public package workflow guidance from credentials, private data, and tracker artifacts.\n\n## Route Elsewhere\n\n- Model architecture, prior\u002Fdecoder construction, `DALLE2`, `dream`, inpainting, or CLIP adapters: `..\u002Fgeneration-and-api\u002FSKILL.md`.\n- JSON training configs, trainer APIs, launcher commands, and distributed training: `..\u002Ftraining-and-configs\u002FSKILL.md`.\n\n## Runtime Contract\n\n- Public package: `pip install dalle2-pytorch`.\n- Public data imports: `from dalle2_pytorch.dataloaders import ImageEmbeddingDataset, create_image_embedding_dataloader, get_reader, make_splits, PriorEmbeddingDataset`.\n- Public tracker\u002Fconfig imports: `from dalle2_pytorch.train_configs import TrackerConfig`; tracker provider behavior lives behind config classes.\n- This skill does not provide datasets, credentials, model weights, S3 buckets, W&B runs, or HuggingFace tokens. It helps validate user-provided paths\u002Fconfigs safely.\n\n## References And Bundled Script\n\n- Decoder and prior data formats: [references\u002Fdata-formats.md](references\u002Fdata-formats.md).\n- Tracker, loader, saver, and checkpoint destinations: [references\u002Ftracking-and-checkpoints.md](references\u002Ftracking-and-checkpoints.md).\n- Data\u002Ftracker troubleshooting: [references\u002Ftroubleshooting.md](references\u002Ftroubleshooting.md).\n- Safe layout checker: [scripts\u002Fvalidate_webdataset_layout.py](scripts\u002Fvalidate_webdataset_layout.py).\n\n## Typical Flow\n\n1. Read [references\u002Fdata-formats.md](references\u002Fdata-formats.md) to decide whether the task uses decoder WebDataset shards or prior EmbeddingReader folders.\n2. For decoder configs, inspect shard and sidecar naming without loading large data:\n\n   ```bash\n   python scripts\u002Fvalidate_webdataset_layout.py --tar-pattern 'data\u002Fshards\u002F{}.tar' --start-shard 0 --end-shard 9 --shard-width 1 --index-width 4\n   ```\n\n3. Add sidecar folders when embeddings are outside the tar files:\n\n   ```bash\n   python scripts\u002Fvalidate_webdataset_layout.py --tar-pattern 'data\u002Fshards\u002F{}.tar' --start-shard 0 --end-shard 9 --shard-width 1 --index-width 4 --image-embeddings data\u002Fimg_emb --text-embeddings data\u002Ftext_emb\n   ```\n\n4. Read [references\u002Ftracking-and-checkpoints.md](references\u002Ftracking-and-checkpoints.md) before enabling W&B, HuggingFace, S3, URL loaders, or auto-resume.\n\n## Safety Defaults\n\n- Prefer local filesystem paths and `log_type: console` for first checks.\n- Do not inspect or upload private tracker credentials; require the user to supply and approve them at execution time.\n- Treat network, S3, W&B, HuggingFace, and URL loaders\u002Fsavers as credentialed or networked workflows, not default smoke tests.\n- Use `--inspect-tar` on at most a small shard; otherwise the bundled checker only validates names and file existence.\n",{"name":5,"license":15,"metadata":24,"description":7,"disable-model-invocation":26},{"disco-role":25},"operating",true,"main","d69096e239f2a89aabc2cd078c47664a9d3b1e11","06-前端与设计\u002Fdalle2-pytorch\u002Fsub-skills\u002Fdata-and-tracking",3,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts","https:\u002F\u002Fgithub.com\u002Flza6","个人vx：Tf00798\r\n个人✈：@TFGY999","2026-10-08 14:29:22",{"source":8,"skillName":5,"commands":36,"prompt":46,"zipAvailable":26},[37,40,43],{"tool":38,"command":39},"npx","npx skills add lza6\u002FArmor-piercing-system-prompts --skill data-and-tracking",{"tool":41,"command":42},"bunx","bunx skills add lza6\u002FArmor-piercing-system-prompts --skill data-and-tracking",{"tool":44,"command":45},"pnpm","pnpm dlx skills add lza6\u002FArmor-piercing-system-prompts --skill data-and-tracking","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F06-前端与设计\u002Fdalle2-pytorch\u002Fsub-skills\u002Fdata-and-tracking\u002FSKILL.md",[48,54,58],{"path":49,"resourceType":50,"resourceTypeDesc":51,"sizeBytes":52,"sourceHtmlUrl":53},"references\u002Fdata-formats.md","REFERENCE","参考文档",5035,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F06-前端与设计\u002Fdalle2-pytorch\u002Fsub-skills\u002Fdata-and-tracking\u002Freferences\u002Fdata-formats.md",{"path":55,"resourceType":50,"resourceTypeDesc":51,"sizeBytes":56,"sourceHtmlUrl":57},"references\u002Ftracking-and-checkpoints.md",4097,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F06-前端与设计\u002Fdalle2-pytorch\u002Fsub-skills\u002Fdata-and-tracking\u002Freferences\u002Ftracking-and-checkpoints.md",{"path":59,"resourceType":50,"resourceTypeDesc":51,"sizeBytes":60,"sourceHtmlUrl":61},"references\u002Ftroubleshooting.md",3604,"https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F06-前端与设计\u002Fdalle2-pytorch\u002Fsub-skills\u002Fdata-and-tracking\u002Freferences\u002Ftroubleshooting.md",[63,70,75,82,89,96],{"skillNo":64,"name":65,"nameZh":6,"description":66,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":67,"categories":68,"keywords":69,"publishedAt":19},"01M7FFG485KY83TD6HSC4YPCMC","obsidian-clipper-template-creator","Guide for creating templates for the Obsidian Web Clipper. Use when you want to create a new clipping template, understand available variables, or format clipped content.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobsidian-clipper-template-creator\u002FSKILL.md",[],[],{"skillNo":71,"name":65,"nameZh":6,"description":66,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":72,"categories":73,"keywords":74,"publishedAt":19},"01M7FFG0T6AZ0STEJPSB3CX84K","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobsidian-clipper-template-creator-antigravity-awesome-skills-main\u002FSKILL.md",[],[],{"skillNo":76,"name":77,"nameZh":6,"description":78,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":79,"categories":80,"keywords":81,"publishedAt":19},"01M7FFFY0QEM14SKWPDYGMXM2P","python-api","Programmatic Object-Detection-Metrics API guidance for BoundingBox, BoundingBoxes, Evaluator, enums, coordinate conversion, AP\u002FmAP semantics, and source-style import diagnostics.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobject-detection-metrics\u002Fsub-skills\u002Fpython-api\u002FSKILL.md",[],[],{"skillNo":83,"name":84,"nameZh":6,"description":85,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":86,"categories":87,"keywords":88,"publishedAt":19},"01M7FFFVZQZ2GJ0C0TGP7JHD20","file-evaluation","Folder-based PASCAL VOC AP\u002FmAP evaluation from ground-truth and detection text files.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobject-detection-metrics\u002Fsub-skills\u002Ffile-evaluation\u002FSKILL.md",[],[],{"skillNo":90,"name":91,"nameZh":6,"description":92,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":93,"categories":94,"keywords":95,"publishedAt":19},"01M7FFFSFNYSE77SJ6PE1CK2DA","object-detection-metrics","Guides legacy Object-Detection-Metrics PASCAL VOC AP\u002FmAP evaluation from detection text folders and direct Python API classes.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fobject-detection-metrics\u002FSKILL.md",[],[],{"skillNo":97,"name":98,"nameZh":6,"description":99,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":100,"categories":101,"keywords":102,"publishedAt":19},"01M7FFFP0GCK1RVXBCPQ8APBMT","nx-workspace-patterns","Configure and optimize Nx monorepo workspaces. Use when setting up Nx, configuring project boundaries, optimizing build caching, or implementing affected commands.","https:\u002F\u002Fgithub.com\u002Flza6\u002FArmor-piercing-system-prompts\u002Fblob\u002Fmain\u002F07-后端与架构\u002Fnx-workspace-patterns\u002FSKILL.md",[],[]]