[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M71PZS5ATCE6D12JKRDF5463":3,"skill-same:01M71PZS5ATCE6D12JKRDF5463":96},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":15,"categories":16,"keywords":17,"publishedAt":38,"linkOnly":39,"markdownContent":40,"markdownBody":41,"frontMatter":42,"refName":58,"commitSha":59,"skillDirectory":60,"forksCount":13,"repositoryHtmlUrl":61,"repositoryHomepageUrl":6,"ownerHtmlUrl":62,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":63,"install":64,"resources":77},"01M71PZS5ATCE6D12JKRDF5463","axolotl",null,"Expert guidance for fine-tuning LLMs with Axolotl - YAML configs, 100+ models, LoRA\u002FQLoRA, DPO\u002FKTO\u002FORPO\u002FGRPO, multimodal support","gjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN","gjbvsjjvgm-sketch","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F278511911?v=4","01M71F3JXKZQ70H2KCHHTXKZDA","01M71PENEVFN19DBZFNHJPCHQ7",0,"MIT","https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN\u002Fblob\u002Fmain\u002Fcore\u002Fhermes_sovereign_data\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002FSKILL.md",[],[18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37],"Axolotl","ORPO","for","orchestra","with","Accelerate","expert","models","Transformers","HuggingFace","GRPO","llms","KTO","DPO","QLoRA","LoRA","Fine-Tuning","DeepSpeed","support","research","2026-11-10 13:02:02",false,"---\nname: axolotl\ndescription: Expert guidance for fine-tuning LLMs with Axolotl - YAML configs, 100+ models, LoRA\u002FQLoRA, DPO\u002FKTO\u002FORPO\u002FGRPO, multimodal support\nversion: 1.0.0\nauthor: Orchestra Research\nlicense: MIT\ndependencies: [axolotl, torch, transformers, datasets, peft, accelerate, deepspeed]\nmetadata:\n  hermes:\n    tags: [Fine-Tuning, Axolotl, LLM, LoRA, QLoRA, DPO, KTO, ORPO, GRPO, YAML, HuggingFace, DeepSpeed, Multimodal]\n\n---\n\n# Axolotl Skill\n\nComprehensive assistance with axolotl development, generated from official documentation.\n\n## When to Use This Skill\n\nThis skill should be triggered when:\n- Working with axolotl\n- Asking about axolotl features or APIs\n- Implementing axolotl solutions\n- Debugging axolotl code\n- Learning axolotl best practices\n\n## Quick Reference\n\n### Common Patterns\n\n**Pattern 1:** To validate that acceptable data transfer speeds exist for your training job, running NCCL Tests can help pinpoint bottlenecks, for example:\n\n```\n.\u002Fbuild\u002Fall_reduce_perf -b 8 -e 128M -f 2 -g 3\n```\n\n**Pattern 2:** Configure your model to use FSDP in the Axolotl yaml. For example:\n\n```\nfsdp_version: 2\nfsdp_config:\n  offload_params: true\n  state_dict_type: FULL_STATE_DICT\n  auto_wrap_policy: TRANSFORMER_BASED_WRAP\n  transformer_layer_cls_to_wrap: LlamaDecoderLayer\n  reshard_after_forward: true\n```\n\n**Pattern 3:** The context_parallel_size should be a divisor of the total number of GPUs. For example:\n\n```\ncontext_parallel_size\n```\n\n**Pattern 4:** For example: - With 8 GPUs and no sequence parallelism: 8 different batches processed per step - With 8 GPUs and context_parallel_size=4: Only 2 different batches processed per step (each split across 4 GPUs) - If your per-GPU micro_batch_size is 2, the global batch size decreases from 16 to 4\n\n```\ncontext_parallel_size=4\n```\n\n**Pattern 5:** Setting save_compressed: true in your configuration enables saving models in a compressed format, which: - Reduces disk space usage by approximately 40% - Maintains compatibility with vLLM for accelerated inference - Maintains compatibility with llmcompressor for further optimization (example: quantization)\n\n```\nsave_compressed: true\n```\n\n**Pattern 6:** Note It is not necessary to place your integration in the integrations folder. It can be in any location, so long as it’s installed in a package in your python env. See this repo for an example: https:\u002F\u002Fgithub.com\u002Faxolotl-ai-cloud\u002Fdiff-transformer\n\n```\nintegrations\n```\n\n**Pattern 7:** Handle both single-example and batched data. - single example: sample[‘input_ids’] is a list[int] - batched data: sample[‘input_ids’] is a list[list[int]]\n\n```\nutils.trainer.drop_long_seq(sample, sequence_len=2048, min_sequence_len=2)\n```\n\n### Example Code Patterns\n\n**Example 1** (python):\n```python\ncli.cloud.modal_.ModalCloud(config, app=None)\n```\n\n**Example 2** (python):\n```python\ncli.cloud.modal_.run_cmd(cmd, run_folder, volumes=None)\n```\n\n**Example 3** (python):\n```python\ncore.trainers.base.AxolotlTrainer(\n    *_args,\n    bench_data_collator=None,\n    eval_data_collator=None,\n    dataset_tags=None,\n    **kwargs,\n)\n```\n\n**Example 4** (python):\n```python\ncore.trainers.base.AxolotlTrainer.log(logs, start_time=None)\n```\n\n**Example 5** (python):\n```python\nprompt_strategies.input_output.RawInputOutputPrompter()\n```\n\n## Reference Files\n\nThis skill includes comprehensive documentation in `references\u002F`:\n\n- **api.md** - Api documentation\n- **dataset-formats.md** - Dataset-Formats documentation\n- **other.md** - Other documentation\n\nUse `view` to read specific reference files when detailed information is needed.\n\n## Working with This Skill\n\n### For Beginners\nStart with the getting_started or tutorials reference files for foundational concepts.\n\n### For Specific Features\nUse the appropriate category reference file (api, guides, etc.) for detailed information.\n\n### For Code Examples\nThe quick reference section above contains common patterns extracted from the official docs.\n\n## Resources\n\n### references\u002F\nOrganized documentation extracted from official sources. These files contain:\n- Detailed explanations\n- Code examples with language annotations\n- Links to original documentation\n- Table of contents for quick navigation\n\n### scripts\u002F\nAdd helper scripts here for common automation tasks.\n\n### assets\u002F\nAdd templates, boilerplate, or example projects here.\n\n## Notes\n\n- This skill was automatically generated from official documentation\n- Reference files preserve the structure and examples from source docs\n- Code examples include language detection for better syntax highlighting\n- Quick reference patterns are extracted from common usage examples in the docs\n\n## Updating\n\nTo refresh this skill with updated documentation:\n1. Re-run the scraper with the same configuration\n2. The skill will be rebuilt with the latest information\n\n\n","# Axolotl Skill\n\nComprehensive assistance with axolotl development, generated from official documentation.\n\n## When to Use This Skill\n\nThis skill should be triggered when:\n- Working with axolotl\n- Asking about axolotl features or APIs\n- Implementing axolotl solutions\n- Debugging axolotl code\n- Learning axolotl best practices\n\n## Quick Reference\n\n### Common Patterns\n\n**Pattern 1:** To validate that acceptable data transfer speeds exist for your training job, running NCCL Tests can help pinpoint bottlenecks, for example:\n\n```\n.\u002Fbuild\u002Fall_reduce_perf -b 8 -e 128M -f 2 -g 3\n```\n\n**Pattern 2:** Configure your model to use FSDP in the Axolotl yaml. For example:\n\n```\nfsdp_version: 2\nfsdp_config:\n  offload_params: true\n  state_dict_type: FULL_STATE_DICT\n  auto_wrap_policy: TRANSFORMER_BASED_WRAP\n  transformer_layer_cls_to_wrap: LlamaDecoderLayer\n  reshard_after_forward: true\n```\n\n**Pattern 3:** The context_parallel_size should be a divisor of the total number of GPUs. For example:\n\n```\ncontext_parallel_size\n```\n\n**Pattern 4:** For example: - With 8 GPUs and no sequence parallelism: 8 different batches processed per step - With 8 GPUs and context_parallel_size=4: Only 2 different batches processed per step (each split across 4 GPUs) - If your per-GPU micro_batch_size is 2, the global batch size decreases from 16 to 4\n\n```\ncontext_parallel_size=4\n```\n\n**Pattern 5:** Setting save_compressed: true in your configuration enables saving models in a compressed format, which: - Reduces disk space usage by approximately 40% - Maintains compatibility with vLLM for accelerated inference - Maintains compatibility with llmcompressor for further optimization (example: quantization)\n\n```\nsave_compressed: true\n```\n\n**Pattern 6:** Note It is not necessary to place your integration in the integrations folder. It can be in any location, so long as it’s installed in a package in your python env. See this repo for an example: https:\u002F\u002Fgithub.com\u002Faxolotl-ai-cloud\u002Fdiff-transformer\n\n```\nintegrations\n```\n\n**Pattern 7:** Handle both single-example and batched data. - single example: sample[‘input_ids’] is a list[int] - batched data: sample[‘input_ids’] is a list[list[int]]\n\n```\nutils.trainer.drop_long_seq(sample, sequence_len=2048, min_sequence_len=2)\n```\n\n### Example Code Patterns\n\n**Example 1** (python):\n```python\ncli.cloud.modal_.ModalCloud(config, app=None)\n```\n\n**Example 2** (python):\n```python\ncli.cloud.modal_.run_cmd(cmd, run_folder, volumes=None)\n```\n\n**Example 3** (python):\n```python\ncore.trainers.base.AxolotlTrainer(\n    *_args,\n    bench_data_collator=None,\n    eval_data_collator=None,\n    dataset_tags=None,\n    **kwargs,\n)\n```\n\n**Example 4** (python):\n```python\ncore.trainers.base.AxolotlTrainer.log(logs, start_time=None)\n```\n\n**Example 5** (python):\n```python\nprompt_strategies.input_output.RawInputOutputPrompter()\n```\n\n## Reference Files\n\nThis skill includes comprehensive documentation in `references\u002F`:\n\n- **api.md** - Api documentation\n- **dataset-formats.md** - Dataset-Formats documentation\n- **other.md** - Other documentation\n\nUse `view` to read specific reference files when detailed information is needed.\n\n## Working with This Skill\n\n### For Beginners\nStart with the getting_started or tutorials reference files for foundational concepts.\n\n### For Specific Features\nUse the appropriate category reference file (api, guides, etc.) for detailed information.\n\n### For Code Examples\nThe quick reference section above contains common patterns extracted from the official docs.\n\n## Resources\n\n### references\u002F\nOrganized documentation extracted from official sources. These files contain:\n- Detailed explanations\n- Code examples with language annotations\n- Links to original documentation\n- Table of contents for quick navigation\n\n### scripts\u002F\nAdd helper scripts here for common automation tasks.\n\n### assets\u002F\nAdd templates, boilerplate, or example projects here.\n\n## Notes\n\n- This skill was automatically generated from official documentation\n- Reference files preserve the structure and examples from source docs\n- Code examples include language detection for better syntax highlighting\n- Quick reference patterns are extracted from common usage examples in the docs\n\n## Updating\n\nTo refresh this skill with updated documentation:\n1. Re-run the scraper with the same configuration\n2. The skill will be rebuilt with the latest information\n\n\n",{"name":5,"author":43,"license":14,"version":44,"metadata":45,"description":7,"dependencies":51},"Orchestra Research","1.0.0",{"hermes":46},{"tags":47},[34,18,48,33,32,31,30,19,28,49,27,35,50],"LLM","YAML","Multimodal",[5,52,53,54,55,56,57],"torch","transformers","datasets","peft","accelerate","deepspeed","main","6746276ba18cb774853eb61b3b9399658bc9bc5c","core\u002Fhermes_sovereign_data\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl","https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN","https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch","2026-04-28 17:01:03",{"source":8,"skillName":5,"commands":65,"prompt":75,"zipAvailable":76},[66,69,72],{"tool":67,"command":68},"npx","npx skills add gjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN --skill axolotl",{"tool":70,"command":71},"bunx","bunx skills add gjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN --skill axolotl",{"tool":73,"command":74},"pnpm","pnpm dlx skills add gjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN --skill axolotl","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN\u002Fblob\u002Fmain\u002Fcore\u002Fhermes_sovereign_data\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002FSKILL.md",true,[78,84,88,92],{"path":79,"resourceType":80,"resourceTypeDesc":81,"sizeBytes":82,"sourceHtmlUrl":83},"references\u002Fapi.md","REFERENCE","参考文档",121144,"https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN\u002Fblob\u002Fmain\u002Fcore\u002Fhermes_sovereign_data\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002Freferences\u002Fapi.md",{"path":85,"resourceType":80,"resourceTypeDesc":81,"sizeBytes":86,"sourceHtmlUrl":87},"references\u002Fdataset-formats.md",46043,"https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN\u002Fblob\u002Fmain\u002Fcore\u002Fhermes_sovereign_data\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002Freferences\u002Fdataset-formats.md",{"path":89,"resourceType":80,"resourceTypeDesc":81,"sizeBytes":90,"sourceHtmlUrl":91},"references\u002Findex.md",199,"https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN\u002Fblob\u002Fmain\u002Fcore\u002Fhermes_sovereign_data\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002Freferences\u002Findex.md",{"path":93,"resourceType":80,"resourceTypeDesc":81,"sizeBytes":94,"sourceHtmlUrl":95},"references\u002Fother.md",140407,"https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN\u002Fblob\u002Fmain\u002Fcore\u002Fhermes_sovereign_data\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002Freferences\u002Fother.md",[97,140,165,182,201,220],{"skillNo":98,"name":99,"nameZh":6,"description":100,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":101,"categories":102,"keywords":119,"publishedAt":38},"01M71QG27G1R2H2ZWEG4S0WTZT","writing-plans","Write implementation plans: bite-sized tasks, paths, code.","https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN\u002Fblob\u002Fmain\u002Fcore\u002Fskills\u002Fsoftware-development\u002Fwriting-plans\u002FSKILL.md",[103,108,111,116],{"categoryNo":104,"categoryName":105,"taxonomyType":106,"taxonomyTypeDesc":107},"01JBSEEDCAT000000000000015","视觉设计","SCENARIO","使用场景",{"categoryNo":109,"categoryName":110,"taxonomyType":106,"taxonomyTypeDesc":107},"01JBSEEDCAT000000000000018","写作与文案",{"categoryNo":112,"categoryName":113,"taxonomyType":114,"taxonomyTypeDesc":115},"01JBSEEDCAT000000000000030","开发工程师","PROFESSION","适用职业",{"categoryNo":117,"categoryName":118,"taxonomyType":114,"taxonomyTypeDesc":115},"01JBSEEDCAT000000000000036","内容创作者",[120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136,137,138,139],"writing","writing plans","plans","test-driven","test-driven-development","superpowers","design","workflow","code","tasks","subagent","code-review","review","documentation","write","paths","planning","development","test","implementation",{"skillNo":141,"name":124,"nameZh":6,"description":142,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":143,"categories":144,"keywords":151,"publishedAt":38},"01M71QFZYRTJXMAE551MRAKZ14","TDD: enforce RED-GREEN-REFACTOR, tests before code.","https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN\u002Fblob\u002Fmain\u002Fcore\u002Fskills\u002Fsoftware-development\u002Ftest-driven-development\u002FSKILL.md",[145,148],{"categoryNo":146,"categoryName":147,"taxonomyType":106,"taxonomyTypeDesc":107},"01JBSEEDCAT000000000000007","代码审查",{"categoryNo":149,"categoryName":150,"taxonomyType":106,"taxonomyTypeDesc":107},"01JBSEEDCAT000000000000008","测试与质量",[152,137,138,153,154,155,156,125,120,157,128,130,158,159,160,161,162,122,163,164],"test driven development","driven","green","red-green-refactor","testing","debugging","systematic","refactor","systematic-debugging","enforce","tests","tdd","quality",{"skillNo":166,"name":160,"nameZh":6,"description":167,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":168,"categories":169,"keywords":171,"publishedAt":38},"01M71QFWR5Q8EYEQ6MCS3SM6MC","4-phase root cause debugging: understand bugs before fixing.","https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN\u002Fblob\u002Fmain\u002Fcore\u002Fskills\u002Fsoftware-development\u002Fsystematic-debugging\u002FSKILL.md",[170],{"categoryNo":149,"categoryName":150,"taxonomyType":106,"taxonomyTypeDesc":107},[172,157,158,123,173,174,124,125,120,130,175,176,137,177,122,178,138,179,180,181],"systematic debugging","problem","problem-solving","phase","bugs","root cause","root-cause","investigation","understand","hermes",{"skillNo":183,"name":184,"nameZh":6,"description":185,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":186,"categories":187,"keywords":193,"publishedAt":38},"01M71QFS9S04MD8JP747W5WM0N","subagent-driven-development","Execute plans via delegate_task subagents (2-stage review).","https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN\u002Fblob\u002Fmain\u002Fcore\u002Fskills\u002Fsoftware-development\u002Fsubagent-driven-development\u002FSKILL.md",[188,189,192],{"categoryNo":109,"categoryName":110,"taxonomyType":106,"taxonomyTypeDesc":107},{"categoryNo":190,"categoryName":191,"taxonomyType":106,"taxonomyTypeDesc":107},"01JBSEEDCAT000000000000023","Skill与智能体开发",{"categoryNo":117,"categoryName":118,"taxonomyType":114,"taxonomyTypeDesc":115},[194,130,137,153,123,124,195,196,125,120,127,128,131,132,197,198,122,199,200,138],"subagent driven development","delegate","delegation","subagents","parallel","stage","task",{"skillNo":202,"name":203,"nameZh":6,"description":204,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":205,"categories":206,"keywords":209,"publishedAt":38},"01M71QFQ1DBCVAZ511MXFE6T2V","requesting-code-review","Pre-commit review: security scan, quality gates, auto-fix.","https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN\u002Fblob\u002Fmain\u002Fcore\u002Fskills\u002Fsoftware-development\u002Frequesting-code-review\u002FSKILL.md",[207,208],{"categoryNo":146,"categoryName":147,"taxonomyType":106,"taxonomyTypeDesc":107},{"categoryNo":112,"categoryName":113,"taxonomyType":114,"taxonomyTypeDesc":115},[210,211,128,132,123,124,212,213,125,214,120,215,216,130,131,217,218,137,219,122],"code review","requesting code review","fix","auto-fix","auto","security scan","commit","verification","security","scan",{"skillNo":221,"name":222,"nameZh":6,"description":223,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":224,"categories":225,"keywords":227,"publishedAt":38},"01M71QFM7KWM540YR67FRN807Q","python-debugpy","Debug Python: pdb REPL + debugpy remote (DAP).","https:\u002F\u002Fgithub.com\u002Fgjbvsjjvgm-sketch\u002FWORM_V2_SOVEREIGN\u002Fblob\u002Fmain\u002Fcore\u002Fskills\u002Fsoftware-development\u002Fpython-debugpy\u002FSKILL.md",[226],{"categoryNo":112,"categoryName":113,"taxonomyType":114,"taxonomyTypeDesc":115},[228,229,230,231,232,233,234,235,157,158,236,237,238,160,239,240,241,242,181,243],"debugpy","python debugpy","python","dap","inspect","post-mortem","pdb","remote","debugger","node","commands","debug","post","breakpoints","node-inspect","tui"]