[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M71TBFF35T0DNAZHT98RGP5X":3,"skill-same:01M71TBFF35T0DNAZHT98RGP5X":94},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":15,"categories":16,"keywords":17,"publishedAt":37,"linkOnly":38,"markdownContent":39,"markdownBody":40,"frontMatter":41,"refName":56,"commitSha":57,"skillDirectory":58,"forksCount":13,"repositoryHtmlUrl":59,"repositoryHomepageUrl":6,"ownerHtmlUrl":60,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":61,"install":62,"resources":75},"01M71TBFF35T0DNAZHT98RGP5X","axolotl",null,"Axolotl: YAML LLM fine-tuning (LoRA, DPO, GRPO).","eliottbusiness\u002FDeptFlow-Agent","eliottbusiness","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F263418316?v=4","01M71T5T608RHFA07W6QVC6TYX","01M71T5T6R98RMYZ53PYH851T1",0,"MIT","https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent\u002Fblob\u002Fmain\u002Fprofile\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002FSKILL.md",[],[18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36],"Axolotl","KTO","orchestra","PEFT","Accelerate","datasets","tuning","Transformers","HuggingFace","GRPO","ORPO","research","DPO","QLoRA","LoRA","Fine-Tuning","DeepSpeed","yaml","multimodal","2026-11-10 13:02:02",false,"---\nname: axolotl\ndescription: \"Axolotl: YAML LLM fine-tuning (LoRA, DPO, GRPO).\"\nversion: 1.0.0\nauthor: Orchestra Research\nlicense: MIT\ndependencies: [axolotl, torch, transformers, datasets, peft, accelerate, deepspeed]\nmetadata:\n  hermes:\n    tags: [Fine-Tuning, Axolotl, LLM, LoRA, QLoRA, DPO, KTO, ORPO, GRPO, YAML, HuggingFace, DeepSpeed, Multimodal]\n\n---\n\n# Axolotl Skill\n\n## What's inside\n\nExpert guidance for fine-tuning LLMs with Axolotl — YAML configs, 100+ models, LoRA\u002FQLoRA, DPO\u002FKTO\u002FORPO\u002FGRPO, multimodal support.\n\nComprehensive assistance with axolotl development, generated from official documentation.\n\n## When to Use This Skill\n\nThis skill should be triggered when:\n- Working with axolotl\n- Asking about axolotl features or APIs\n- Implementing axolotl solutions\n- Debugging axolotl code\n- Learning axolotl best practices\n\n## Quick Reference\n\n### Common Patterns\n\n**Pattern 1:** To validate that acceptable data transfer speeds exist for your training job, running NCCL Tests can help pinpoint bottlenecks, for example:\n\n```\n.\u002Fbuild\u002Fall_reduce_perf -b 8 -e 128M -f 2 -g 3\n```\n\n**Pattern 2:** Configure your model to use FSDP in the Axolotl yaml. For example:\n\n```\nfsdp_version: 2\nfsdp_config:\n  offload_params: true\n  state_dict_type: FULL_STATE_DICT\n  auto_wrap_policy: TRANSFORMER_BASED_WRAP\n  transformer_layer_cls_to_wrap: LlamaDecoderLayer\n  reshard_after_forward: true\n```\n\n**Pattern 3:** The context_parallel_size should be a divisor of the total number of GPUs. For example:\n\n```\ncontext_parallel_size\n```\n\n**Pattern 4:** For example: - With 8 GPUs and no sequence parallelism: 8 different batches processed per step - With 8 GPUs and context_parallel_size=4: Only 2 different batches processed per step (each split across 4 GPUs) - If your per-GPU micro_batch_size is 2, the global batch size decreases from 16 to 4\n\n```\ncontext_parallel_size=4\n```\n\n**Pattern 5:** Setting save_compressed: true in your configuration enables saving models in a compressed format, which: - Reduces disk space usage by approximately 40% - Maintains compatibility with vLLM for accelerated inference - Maintains compatibility with llmcompressor for further optimization (example: quantization)\n\n```\nsave_compressed: true\n```\n\n**Pattern 6:** Note It is not necessary to place your integration in the integrations folder. It can be in any location, so long as it’s installed in a package in your python env. See this repo for an example: https:\u002F\u002Fgithub.com\u002Faxolotl-ai-cloud\u002Fdiff-transformer\n\n```\nintegrations\n```\n\n**Pattern 7:** Handle both single-example and batched data. - single example: sample[‘input_ids’] is a list[int] - batched data: sample[‘input_ids’] is a list[list[int]]\n\n```\nutils.trainer.drop_long_seq(sample, sequence_len=2048, min_sequence_len=2)\n```\n\n### Example Code Patterns\n\n**Example 1** (python):\n```python\ncli.cloud.modal_.ModalCloud(config, app=None)\n```\n\n**Example 2** (python):\n```python\ncli.cloud.modal_.run_cmd(cmd, run_folder, volumes=None)\n```\n\n**Example 3** (python):\n```python\ncore.trainers.base.AxolotlTrainer(\n    *_args,\n    bench_data_collator=None,\n    eval_data_collator=None,\n    dataset_tags=None,\n    **kwargs,\n)\n```\n\n**Example 4** (python):\n```python\ncore.trainers.base.AxolotlTrainer.log(logs, start_time=None)\n```\n\n**Example 5** (python):\n```python\nprompt_strategies.input_output.RawInputOutputPrompter()\n```\n\n## Reference Files\n\nThis skill includes comprehensive documentation in `references\u002F`:\n\n- **api.md** - Api documentation\n- **dataset-formats.md** - Dataset-Formats documentation\n- **other.md** - Other documentation\n\nUse `view` to read specific reference files when detailed information is needed.\n\n## Working with This Skill\n\n### For Beginners\nStart with the getting_started or tutorials reference files for foundational concepts.\n\n### For Specific Features\nUse the appropriate category reference file (api, guides, etc.) for detailed information.\n\n### For Code Examples\nThe quick reference section above contains common patterns extracted from the official docs.\n\n## Resources\n\n### references\u002F\nOrganized documentation extracted from official sources. These files contain:\n- Detailed explanations\n- Code examples with language annotations\n- Links to original documentation\n- Table of contents for quick navigation\n\n### scripts\u002F\nAdd helper scripts here for common automation tasks.\n\n### assets\u002F\nAdd templates, boilerplate, or example projects here.\n\n## Notes\n\n- This skill was automatically generated from official documentation\n- Reference files preserve the structure and examples from source docs\n- Code examples include language detection for better syntax highlighting\n- Quick reference patterns are extracted from common usage examples in the docs\n\n## Updating\n\nTo refresh this skill with updated documentation:\n1. Re-run the scraper with the same configuration\n2. The skill will be rebuilt with the latest information\n\n\n","# Axolotl Skill\n\n## What's inside\n\nExpert guidance for fine-tuning LLMs with Axolotl — YAML configs, 100+ models, LoRA\u002FQLoRA, DPO\u002FKTO\u002FORPO\u002FGRPO, multimodal support.\n\nComprehensive assistance with axolotl development, generated from official documentation.\n\n## When to Use This Skill\n\nThis skill should be triggered when:\n- Working with axolotl\n- Asking about axolotl features or APIs\n- Implementing axolotl solutions\n- Debugging axolotl code\n- Learning axolotl best practices\n\n## Quick Reference\n\n### Common Patterns\n\n**Pattern 1:** To validate that acceptable data transfer speeds exist for your training job, running NCCL Tests can help pinpoint bottlenecks, for example:\n\n```\n.\u002Fbuild\u002Fall_reduce_perf -b 8 -e 128M -f 2 -g 3\n```\n\n**Pattern 2:** Configure your model to use FSDP in the Axolotl yaml. For example:\n\n```\nfsdp_version: 2\nfsdp_config:\n  offload_params: true\n  state_dict_type: FULL_STATE_DICT\n  auto_wrap_policy: TRANSFORMER_BASED_WRAP\n  transformer_layer_cls_to_wrap: LlamaDecoderLayer\n  reshard_after_forward: true\n```\n\n**Pattern 3:** The context_parallel_size should be a divisor of the total number of GPUs. For example:\n\n```\ncontext_parallel_size\n```\n\n**Pattern 4:** For example: - With 8 GPUs and no sequence parallelism: 8 different batches processed per step - With 8 GPUs and context_parallel_size=4: Only 2 different batches processed per step (each split across 4 GPUs) - If your per-GPU micro_batch_size is 2, the global batch size decreases from 16 to 4\n\n```\ncontext_parallel_size=4\n```\n\n**Pattern 5:** Setting save_compressed: true in your configuration enables saving models in a compressed format, which: - Reduces disk space usage by approximately 40% - Maintains compatibility with vLLM for accelerated inference - Maintains compatibility with llmcompressor for further optimization (example: quantization)\n\n```\nsave_compressed: true\n```\n\n**Pattern 6:** Note It is not necessary to place your integration in the integrations folder. It can be in any location, so long as it’s installed in a package in your python env. See this repo for an example: https:\u002F\u002Fgithub.com\u002Faxolotl-ai-cloud\u002Fdiff-transformer\n\n```\nintegrations\n```\n\n**Pattern 7:** Handle both single-example and batched data. - single example: sample[‘input_ids’] is a list[int] - batched data: sample[‘input_ids’] is a list[list[int]]\n\n```\nutils.trainer.drop_long_seq(sample, sequence_len=2048, min_sequence_len=2)\n```\n\n### Example Code Patterns\n\n**Example 1** (python):\n```python\ncli.cloud.modal_.ModalCloud(config, app=None)\n```\n\n**Example 2** (python):\n```python\ncli.cloud.modal_.run_cmd(cmd, run_folder, volumes=None)\n```\n\n**Example 3** (python):\n```python\ncore.trainers.base.AxolotlTrainer(\n    *_args,\n    bench_data_collator=None,\n    eval_data_collator=None,\n    dataset_tags=None,\n    **kwargs,\n)\n```\n\n**Example 4** (python):\n```python\ncore.trainers.base.AxolotlTrainer.log(logs, start_time=None)\n```\n\n**Example 5** (python):\n```python\nprompt_strategies.input_output.RawInputOutputPrompter()\n```\n\n## Reference Files\n\nThis skill includes comprehensive documentation in `references\u002F`:\n\n- **api.md** - Api documentation\n- **dataset-formats.md** - Dataset-Formats documentation\n- **other.md** - Other documentation\n\nUse `view` to read specific reference files when detailed information is needed.\n\n## Working with This Skill\n\n### For Beginners\nStart with the getting_started or tutorials reference files for foundational concepts.\n\n### For Specific Features\nUse the appropriate category reference file (api, guides, etc.) for detailed information.\n\n### For Code Examples\nThe quick reference section above contains common patterns extracted from the official docs.\n\n## Resources\n\n### references\u002F\nOrganized documentation extracted from official sources. These files contain:\n- Detailed explanations\n- Code examples with language annotations\n- Links to original documentation\n- Table of contents for quick navigation\n\n### scripts\u002F\nAdd helper scripts here for common automation tasks.\n\n### assets\u002F\nAdd templates, boilerplate, or example projects here.\n\n## Notes\n\n- This skill was automatically generated from official documentation\n- Reference files preserve the structure and examples from source docs\n- Code examples include language detection for better syntax highlighting\n- Quick reference patterns are extracted from common usage examples in the docs\n\n## Updating\n\nTo refresh this skill with updated documentation:\n1. Re-run the scraper with the same configuration\n2. The skill will be rebuilt with the latest information\n\n\n",{"name":5,"author":42,"license":14,"version":43,"metadata":44,"description":7,"dependencies":50},"Orchestra Research","1.0.0",{"hermes":45},{"tags":46},[33,18,47,32,31,30,19,28,27,48,26,34,49],"LLM","YAML","Multimodal",[5,51,52,23,53,54,55],"torch","transformers","peft","accelerate","deepspeed","main","3ffb682eba417bd920665a7146fecc206b3bccf8","profile\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl","https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent","https:\u002F\u002Fgithub.com\u002Feliottbusiness","2026-05-03 19:19:17",{"source":8,"skillName":5,"commands":63,"prompt":73,"zipAvailable":74},[64,67,70],{"tool":65,"command":66},"npx","npx skills add eliottbusiness\u002FDeptFlow-Agent --skill axolotl",{"tool":68,"command":69},"bunx","bunx skills add eliottbusiness\u002FDeptFlow-Agent --skill axolotl",{"tool":71,"command":72},"pnpm","pnpm dlx skills add eliottbusiness\u002FDeptFlow-Agent --skill axolotl","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent\u002Fblob\u002Fmain\u002Fprofile\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002FSKILL.md",true,[76,82,86,90],{"path":77,"resourceType":78,"resourceTypeDesc":79,"sizeBytes":80,"sourceHtmlUrl":81},"references\u002Fapi.md","REFERENCE","参考文档",121144,"https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent\u002Fblob\u002Fmain\u002Fprofile\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002Freferences\u002Fapi.md",{"path":83,"resourceType":78,"resourceTypeDesc":79,"sizeBytes":84,"sourceHtmlUrl":85},"references\u002Fdataset-formats.md",46043,"https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent\u002Fblob\u002Fmain\u002Fprofile\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002Freferences\u002Fdataset-formats.md",{"path":87,"resourceType":78,"resourceTypeDesc":79,"sizeBytes":88,"sourceHtmlUrl":89},"references\u002Findex.md",199,"https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent\u002Fblob\u002Fmain\u002Fprofile\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002Freferences\u002Findex.md",{"path":91,"resourceType":78,"resourceTypeDesc":79,"sizeBytes":92,"sourceHtmlUrl":93},"references\u002Fother.md",140405,"https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent\u002Fblob\u002Fmain\u002Fprofile\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002Freferences\u002Fother.md",[95,138,163,180,199,222],{"skillNo":96,"name":97,"nameZh":6,"description":98,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":99,"categories":100,"keywords":117,"publishedAt":37},"01M71TEDB3XPT9H5R3SH05XWES","writing-plans","Write implementation plans: bite-sized tasks, paths, code.","https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent\u002Fblob\u002Fmain\u002Fprofile\u002Fskills\u002Fsoftware-development\u002Fwriting-plans\u002FSKILL.md",[101,106,109,114],{"categoryNo":102,"categoryName":103,"taxonomyType":104,"taxonomyTypeDesc":105},"01JBSEEDCAT000000000000015","视觉设计","SCENARIO","使用场景",{"categoryNo":107,"categoryName":108,"taxonomyType":104,"taxonomyTypeDesc":105},"01JBSEEDCAT000000000000018","写作与文案",{"categoryNo":110,"categoryName":111,"taxonomyType":112,"taxonomyTypeDesc":113},"01JBSEEDCAT000000000000030","开发工程师","PROFESSION","适用职业",{"categoryNo":115,"categoryName":116,"taxonomyType":112,"taxonomyTypeDesc":113},"01JBSEEDCAT000000000000036","内容创作者",[118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136,137],"writing","writing plans","plans","test-driven","test-driven-development","superpowers","design","workflow","code","tasks","subagent","code-review","review","documentation","write","paths","planning","development","test","implementation",{"skillNo":139,"name":122,"nameZh":6,"description":140,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":141,"categories":142,"keywords":149,"publishedAt":37},"01M71TEB43BNQKKCRMQZDZ7SAQ","TDD: enforce RED-GREEN-REFACTOR, tests before code.","https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent\u002Fblob\u002Fmain\u002Fprofile\u002Fskills\u002Fsoftware-development\u002Ftest-driven-development\u002FSKILL.md",[143,146],{"categoryNo":144,"categoryName":145,"taxonomyType":104,"taxonomyTypeDesc":105},"01JBSEEDCAT000000000000007","代码审查",{"categoryNo":147,"categoryName":148,"taxonomyType":104,"taxonomyTypeDesc":105},"01JBSEEDCAT000000000000008","测试与质量",[150,135,136,151,152,153,154,123,118,155,126,128,156,157,158,159,160,120,161,162],"test driven development","driven","green","red-green-refactor","testing","debugging","systematic","refactor","systematic-debugging","enforce","tests","tdd","quality",{"skillNo":164,"name":158,"nameZh":6,"description":165,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":166,"categories":167,"keywords":169,"publishedAt":37},"01M71TE76KV9R1WY1V5XQXMMTJ","4-phase root cause debugging: understand bugs before fixing.","https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent\u002Fblob\u002Fmain\u002Fprofile\u002Fskills\u002Fsoftware-development\u002Fsystematic-debugging\u002FSKILL.md",[168],{"categoryNo":147,"categoryName":148,"taxonomyType":104,"taxonomyTypeDesc":105},[170,155,156,121,171,172,122,123,118,128,173,174,135,175,120,176,136,177,178,179],"systematic debugging","problem","problem-solving","phase","bugs","root cause","root-cause","investigation","understand","hermes",{"skillNo":181,"name":182,"nameZh":6,"description":183,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":184,"categories":185,"keywords":191,"publishedAt":37},"01M71TE2Y2TRFZNT6YRPKQA33R","subagent-driven-development","Execute plans via delegate_task subagents (2-stage review).","https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent\u002Fblob\u002Fmain\u002Fprofile\u002Fskills\u002Fsoftware-development\u002Fsubagent-driven-development\u002FSKILL.md",[186,187,190],{"categoryNo":107,"categoryName":108,"taxonomyType":104,"taxonomyTypeDesc":105},{"categoryNo":188,"categoryName":189,"taxonomyType":104,"taxonomyTypeDesc":105},"01JBSEEDCAT000000000000023","Skill与智能体开发",{"categoryNo":115,"categoryName":116,"taxonomyType":112,"taxonomyTypeDesc":113},[192,128,135,151,121,122,193,194,123,118,125,126,129,130,195,196,120,197,198,136],"subagent driven development","delegate","delegation","subagents","parallel","stage","task",{"skillNo":200,"name":201,"nameZh":6,"description":202,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":203,"categories":204,"keywords":208,"publishedAt":37},"01M71TE0E7WRGXY6N0WTMDXY23","spike","Throwaway experiments to validate an idea before build.","https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent\u002Fblob\u002Fmain\u002Fprofile\u002Fskills\u002Fsoftware-development\u002Fspike\u002FSKILL.md",[205],{"categoryNo":206,"categoryName":207,"taxonomyType":104,"taxonomyTypeDesc":105},"01JBSEEDCAT000000000000021","资料检索与研究",[201,209,210,211,134,135,120,212,213,118,214,215,128,216,217,29,218,219,220,221],"concept","exploration","get","throwaway","shit","proof-of-concept","done","prototype","plan","build","sketch","mvp","validate",{"skillNo":223,"name":224,"nameZh":6,"description":225,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":226,"categories":227,"keywords":230,"publishedAt":37},"01M71TDY3JXZHWSYNF3AZ2XM2D","requesting-code-review","Pre-commit review: security scan, quality gates, auto-fix.","https:\u002F\u002Fgithub.com\u002Feliottbusiness\u002FDeptFlow-Agent\u002Fblob\u002Fmain\u002Fprofile\u002Fskills\u002Fsoftware-development\u002Frequesting-code-review\u002FSKILL.md",[228,229],{"categoryNo":144,"categoryName":145,"taxonomyType":104,"taxonomyTypeDesc":105},{"categoryNo":110,"categoryName":111,"taxonomyType":112,"taxonomyTypeDesc":113},[231,232,126,130,121,122,233,234,123,235,118,236,237,128,129,238,239,135,240,120],"code review","requesting code review","fix","auto-fix","auto","security scan","commit","verification","security","scan"]