[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M71JCDNMDWD3VQ3GQ7JZXHDR":3,"skill-same:01M71JCDNMDWD3VQ3GQ7JZXHDR":97},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":15,"categories":16,"keywords":17,"publishedAt":38,"linkOnly":39,"markdownContent":40,"markdownBody":41,"frontMatter":42,"refName":58,"commitSha":59,"skillDirectory":60,"forksCount":61,"repositoryHtmlUrl":62,"repositoryHomepageUrl":6,"ownerHtmlUrl":63,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":64,"install":65,"resources":78},"01M71JCDNMDWD3VQ3GQ7JZXHDR","axolotl",null,"Expert guidance for fine-tuning LLMs with Axolotl - YAML configs, 100+ models, LoRA\u002FQLoRA, DPO\u002FKTO\u002FORPO\u002FGRPO, multimodal support","xuanxuan1983\u002Fhermes-skills-backup","xuanxuan1983","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F151701653?v=4","01M71HCZNB5H19QJ6YBF98W2WH","01M71HCZP14T0921BD0TC9EPD3",1,"MIT","https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup\u002Fblob\u002Fmain\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002FSKILL.md",[],[18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37],"Axolotl","ORPO","for","orchestra","with","Accelerate","expert","models","Transformers","HuggingFace","GRPO","llms","KTO","DPO","QLoRA","LoRA","Fine-Tuning","DeepSpeed","support","research","2026-11-10 10:12:30",false,"---\nname: axolotl\ndescription: Expert guidance for fine-tuning LLMs with Axolotl - YAML configs, 100+ models, LoRA\u002FQLoRA, DPO\u002FKTO\u002FORPO\u002FGRPO, multimodal support\nversion: 1.0.0\nauthor: Orchestra Research\nlicense: MIT\ndependencies: [axolotl, torch, transformers, datasets, peft, accelerate, deepspeed]\nmetadata:\n  hermes:\n    tags: [Fine-Tuning, Axolotl, LLM, LoRA, QLoRA, DPO, KTO, ORPO, GRPO, YAML, HuggingFace, DeepSpeed, Multimodal]\n\n---\n\n# Axolotl Skill\n\nComprehensive assistance with axolotl development, generated from official documentation.\n\n## When to Use This Skill\n\nThis skill should be triggered when:\n- Working with axolotl\n- Asking about axolotl features or APIs\n- Implementing axolotl solutions\n- Debugging axolotl code\n- Learning axolotl best practices\n\n## Quick Reference\n\n### Common Patterns\n\n**Pattern 1:** To validate that acceptable data transfer speeds exist for your training job, running NCCL Tests can help pinpoint bottlenecks, for example:\n\n```\n.\u002Fbuild\u002Fall_reduce_perf -b 8 -e 128M -f 2 -g 3\n```\n\n**Pattern 2:** Configure your model to use FSDP in the Axolotl yaml. For example:\n\n```\nfsdp_version: 2\nfsdp_config:\n  offload_params: true\n  state_dict_type: FULL_STATE_DICT\n  auto_wrap_policy: TRANSFORMER_BASED_WRAP\n  transformer_layer_cls_to_wrap: LlamaDecoderLayer\n  reshard_after_forward: true\n```\n\n**Pattern 3:** The context_parallel_size should be a divisor of the total number of GPUs. For example:\n\n```\ncontext_parallel_size\n```\n\n**Pattern 4:** For example: - With 8 GPUs and no sequence parallelism: 8 different batches processed per step - With 8 GPUs and context_parallel_size=4: Only 2 different batches processed per step (each split across 4 GPUs) - If your per-GPU micro_batch_size is 2, the global batch size decreases from 16 to 4\n\n```\ncontext_parallel_size=4\n```\n\n**Pattern 5:** Setting save_compressed: true in your configuration enables saving models in a compressed format, which: - Reduces disk space usage by approximately 40% - Maintains compatibility with vLLM for accelerated inference - Maintains compatibility with llmcompressor for further optimization (example: quantization)\n\n```\nsave_compressed: true\n```\n\n**Pattern 6:** Note It is not necessary to place your integration in the integrations folder. It can be in any location, so long as it’s installed in a package in your python env. See this repo for an example: https:\u002F\u002Fgithub.com\u002Faxolotl-ai-cloud\u002Fdiff-transformer\n\n```\nintegrations\n```\n\n**Pattern 7:** Handle both single-example and batched data. - single example: sample[‘input_ids’] is a list[int] - batched data: sample[‘input_ids’] is a list[list[int]]\n\n```\nutils.trainer.drop_long_seq(sample, sequence_len=2048, min_sequence_len=2)\n```\n\n### Example Code Patterns\n\n**Example 1** (python):\n```python\ncli.cloud.modal_.ModalCloud(config, app=None)\n```\n\n**Example 2** (python):\n```python\ncli.cloud.modal_.run_cmd(cmd, run_folder, volumes=None)\n```\n\n**Example 3** (python):\n```python\ncore.trainers.base.AxolotlTrainer(\n    *_args,\n    bench_data_collator=None,\n    eval_data_collator=None,\n    dataset_tags=None,\n    **kwargs,\n)\n```\n\n**Example 4** (python):\n```python\ncore.trainers.base.AxolotlTrainer.log(logs, start_time=None)\n```\n\n**Example 5** (python):\n```python\nprompt_strategies.input_output.RawInputOutputPrompter()\n```\n\n## Reference Files\n\nThis skill includes comprehensive documentation in `references\u002F`:\n\n- **api.md** - Api documentation\n- **dataset-formats.md** - Dataset-Formats documentation\n- **other.md** - Other documentation\n\nUse `view` to read specific reference files when detailed information is needed.\n\n## Working with This Skill\n\n### For Beginners\nStart with the getting_started or tutorials reference files for foundational concepts.\n\n### For Specific Features\nUse the appropriate category reference file (api, guides, etc.) for detailed information.\n\n### For Code Examples\nThe quick reference section above contains common patterns extracted from the official docs.\n\n## Resources\n\n### references\u002F\nOrganized documentation extracted from official sources. These files contain:\n- Detailed explanations\n- Code examples with language annotations\n- Links to original documentation\n- Table of contents for quick navigation\n\n### scripts\u002F\nAdd helper scripts here for common automation tasks.\n\n### assets\u002F\nAdd templates, boilerplate, or example projects here.\n\n## Notes\n\n- This skill was automatically generated from official documentation\n- Reference files preserve the structure and examples from source docs\n- Code examples include language detection for better syntax highlighting\n- Quick reference patterns are extracted from common usage examples in the docs\n\n## Updating\n\nTo refresh this skill with updated documentation:\n1. Re-run the scraper with the same configuration\n2. The skill will be rebuilt with the latest information\n\n\n","# Axolotl Skill\n\nComprehensive assistance with axolotl development, generated from official documentation.\n\n## When to Use This Skill\n\nThis skill should be triggered when:\n- Working with axolotl\n- Asking about axolotl features or APIs\n- Implementing axolotl solutions\n- Debugging axolotl code\n- Learning axolotl best practices\n\n## Quick Reference\n\n### Common Patterns\n\n**Pattern 1:** To validate that acceptable data transfer speeds exist for your training job, running NCCL Tests can help pinpoint bottlenecks, for example:\n\n```\n.\u002Fbuild\u002Fall_reduce_perf -b 8 -e 128M -f 2 -g 3\n```\n\n**Pattern 2:** Configure your model to use FSDP in the Axolotl yaml. For example:\n\n```\nfsdp_version: 2\nfsdp_config:\n  offload_params: true\n  state_dict_type: FULL_STATE_DICT\n  auto_wrap_policy: TRANSFORMER_BASED_WRAP\n  transformer_layer_cls_to_wrap: LlamaDecoderLayer\n  reshard_after_forward: true\n```\n\n**Pattern 3:** The context_parallel_size should be a divisor of the total number of GPUs. For example:\n\n```\ncontext_parallel_size\n```\n\n**Pattern 4:** For example: - With 8 GPUs and no sequence parallelism: 8 different batches processed per step - With 8 GPUs and context_parallel_size=4: Only 2 different batches processed per step (each split across 4 GPUs) - If your per-GPU micro_batch_size is 2, the global batch size decreases from 16 to 4\n\n```\ncontext_parallel_size=4\n```\n\n**Pattern 5:** Setting save_compressed: true in your configuration enables saving models in a compressed format, which: - Reduces disk space usage by approximately 40% - Maintains compatibility with vLLM for accelerated inference - Maintains compatibility with llmcompressor for further optimization (example: quantization)\n\n```\nsave_compressed: true\n```\n\n**Pattern 6:** Note It is not necessary to place your integration in the integrations folder. It can be in any location, so long as it’s installed in a package in your python env. See this repo for an example: https:\u002F\u002Fgithub.com\u002Faxolotl-ai-cloud\u002Fdiff-transformer\n\n```\nintegrations\n```\n\n**Pattern 7:** Handle both single-example and batched data. - single example: sample[‘input_ids’] is a list[int] - batched data: sample[‘input_ids’] is a list[list[int]]\n\n```\nutils.trainer.drop_long_seq(sample, sequence_len=2048, min_sequence_len=2)\n```\n\n### Example Code Patterns\n\n**Example 1** (python):\n```python\ncli.cloud.modal_.ModalCloud(config, app=None)\n```\n\n**Example 2** (python):\n```python\ncli.cloud.modal_.run_cmd(cmd, run_folder, volumes=None)\n```\n\n**Example 3** (python):\n```python\ncore.trainers.base.AxolotlTrainer(\n    *_args,\n    bench_data_collator=None,\n    eval_data_collator=None,\n    dataset_tags=None,\n    **kwargs,\n)\n```\n\n**Example 4** (python):\n```python\ncore.trainers.base.AxolotlTrainer.log(logs, start_time=None)\n```\n\n**Example 5** (python):\n```python\nprompt_strategies.input_output.RawInputOutputPrompter()\n```\n\n## Reference Files\n\nThis skill includes comprehensive documentation in `references\u002F`:\n\n- **api.md** - Api documentation\n- **dataset-formats.md** - Dataset-Formats documentation\n- **other.md** - Other documentation\n\nUse `view` to read specific reference files when detailed information is needed.\n\n## Working with This Skill\n\n### For Beginners\nStart with the getting_started or tutorials reference files for foundational concepts.\n\n### For Specific Features\nUse the appropriate category reference file (api, guides, etc.) for detailed information.\n\n### For Code Examples\nThe quick reference section above contains common patterns extracted from the official docs.\n\n## Resources\n\n### references\u002F\nOrganized documentation extracted from official sources. These files contain:\n- Detailed explanations\n- Code examples with language annotations\n- Links to original documentation\n- Table of contents for quick navigation\n\n### scripts\u002F\nAdd helper scripts here for common automation tasks.\n\n### assets\u002F\nAdd templates, boilerplate, or example projects here.\n\n## Notes\n\n- This skill was automatically generated from official documentation\n- Reference files preserve the structure and examples from source docs\n- Code examples include language detection for better syntax highlighting\n- Quick reference patterns are extracted from common usage examples in the docs\n\n## Updating\n\nTo refresh this skill with updated documentation:\n1. Re-run the scraper with the same configuration\n2. The skill will be rebuilt with the latest information\n\n\n",{"name":5,"author":43,"license":14,"version":44,"metadata":45,"description":7,"dependencies":51},"Orchestra Research","1.0.0",{"hermes":46},{"tags":47},[34,18,48,33,32,31,30,19,28,49,27,35,50],"LLM","YAML","Multimodal",[5,52,53,54,55,56,57],"torch","transformers","datasets","peft","accelerate","deepspeed","main","17ee50c38aefa9426a89d7e8ee167fdc4c184fb7","skills\u002Fmlops\u002Ftraining\u002Faxolotl",0,"https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup","https:\u002F\u002Fgithub.com\u002Fxuanxuan1983","2026-05-24 00:14:48",{"source":8,"skillName":5,"commands":66,"prompt":76,"zipAvailable":77},[67,70,73],{"tool":68,"command":69},"npx","npx skills add xuanxuan1983\u002Fhermes-skills-backup --skill axolotl",{"tool":71,"command":72},"bunx","bunx skills add xuanxuan1983\u002Fhermes-skills-backup --skill axolotl",{"tool":74,"command":75},"pnpm","pnpm dlx skills add xuanxuan1983\u002Fhermes-skills-backup --skill axolotl","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup\u002Fblob\u002Fmain\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002FSKILL.md",true,[79,85,89,93],{"path":80,"resourceType":81,"resourceTypeDesc":82,"sizeBytes":83,"sourceHtmlUrl":84},"references\u002Fapi.md","REFERENCE","参考文档",121144,"https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup\u002Fblob\u002Fmain\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002Freferences\u002Fapi.md",{"path":86,"resourceType":81,"resourceTypeDesc":82,"sizeBytes":87,"sourceHtmlUrl":88},"references\u002Fdataset-formats.md",46043,"https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup\u002Fblob\u002Fmain\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002Freferences\u002Fdataset-formats.md",{"path":90,"resourceType":81,"resourceTypeDesc":82,"sizeBytes":91,"sourceHtmlUrl":92},"references\u002Findex.md",199,"https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup\u002Fblob\u002Fmain\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002Freferences\u002Findex.md",{"path":94,"resourceType":81,"resourceTypeDesc":82,"sizeBytes":95,"sourceHtmlUrl":96},"references\u002Fother.md",140405,"https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup\u002Fblob\u002Fmain\u002Fskills\u002Fmlops\u002Ftraining\u002Faxolotl\u002Freferences\u002Fother.md",[98,140,168,184,206,227],{"skillNo":99,"name":100,"nameZh":6,"description":101,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":102,"categories":103,"keywords":120,"publishedAt":38},"01M71JFHVW1W4XE013TY9ZYN9P","writing-plans","Use when you have a spec or requirements for a multi-step task. Creates comprehensive implementation plans with bite-sized tasks, exact file paths, and complete code examples.","https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup\u002Fblob\u002Fmain\u002Fskills\u002Fsoftware-development\u002Fwriting-plans\u002FSKILL.md",[104,109,112,117],{"categoryNo":105,"categoryName":106,"taxonomyType":107,"taxonomyTypeDesc":108},"01JBSEEDCAT000000000000015","视觉设计","SCENARIO","使用场景",{"categoryNo":110,"categoryName":111,"taxonomyType":107,"taxonomyTypeDesc":108},"01JBSEEDCAT000000000000018","写作与文案",{"categoryNo":113,"categoryName":114,"taxonomyType":115,"taxonomyTypeDesc":116},"01JBSEEDCAT000000000000030","开发工程师","PROFESSION","适用职业",{"categoryNo":118,"categoryName":119,"taxonomyType":115,"taxonomyTypeDesc":116},"01JBSEEDCAT000000000000036","内容创作者",[121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136,137,138,139,20],"writing","writing plans","plans","test-driven","test-driven-development","superpowers","design","when","workflow","you","code","tasks","subagent","code-review","review","documentation","paths","planning","development",{"skillNo":141,"name":125,"nameZh":6,"description":142,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":143,"categories":144,"keywords":153,"publishedAt":38},"01M71JFF859RV0XGWS206X1TMB","Use when implementing any feature or bugfix, before writing implementation code. Enforces RED-GREEN-REFACTOR cycle with test-first approach.","https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup\u002Fblob\u002Fmain\u002Fskills\u002Fsoftware-development\u002Ftest-driven-development\u002FSKILL.md",[145,148,151,152],{"categoryNo":146,"categoryName":147,"taxonomyType":107,"taxonomyTypeDesc":108},"01JBSEEDCAT000000000000007","代码审查",{"categoryNo":149,"categoryName":150,"taxonomyType":107,"taxonomyTypeDesc":108},"01JBSEEDCAT000000000000008","测试与质量",{"categoryNo":110,"categoryName":111,"taxonomyType":107,"taxonomyTypeDesc":108},{"categoryNo":118,"categoryName":119,"taxonomyType":115,"taxonomyTypeDesc":116},[154,139,155,156,157,158,159,160,161,162,126,121,163,128,131,133,164,165,166,167],"test driven development","test","driven","test-first","green","cycle","red-green-refactor","testing","implementing","debugging","systematic","bugfix","refactor","systematic-debugging",{"skillNo":169,"name":167,"nameZh":6,"description":170,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":171,"categories":172,"keywords":174,"publishedAt":38},"01M71JFCA5S48PZ5M7DG31R8K5","Use when encountering any bug, test failure, or unexpected behavior. 4-phase root cause investigation — NO fixes without understanding the problem first.","https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup\u002Fblob\u002Fmain\u002Fskills\u002Fsoftware-development\u002Fsystematic-debugging\u002FSKILL.md",[173],{"categoryNo":149,"categoryName":150,"taxonomyType":107,"taxonomyTypeDesc":108},[175,163,164,124,176,177,125,126,121,128,133,178,179,139,180,181,123,182,183,155],"systematic debugging","problem","problem-solving","phase","bug","fixes","root cause","use","root-cause",{"skillNo":185,"name":186,"nameZh":6,"description":187,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":188,"categories":189,"keywords":199,"publishedAt":38},"01M71JF9RQ092KM5ZXCBBT6FS1","subagent-driven-development","Use when executing implementation plans with independent tasks. Dispatches fresh delegate_task per task with two-stage review (spec compliance then code quality).","https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup\u002Fblob\u002Fmain\u002Fskills\u002Fsoftware-development\u002Fsubagent-driven-development\u002FSKILL.md",[190,191,194,195,196],{"categoryNo":110,"categoryName":111,"taxonomyType":107,"taxonomyTypeDesc":108},{"categoryNo":192,"categoryName":193,"taxonomyType":107,"taxonomyTypeDesc":108},"01JBSEEDCAT000000000000023","Skill与智能体开发",{"categoryNo":113,"categoryName":114,"taxonomyType":115,"taxonomyTypeDesc":116},{"categoryNo":118,"categoryName":119,"taxonomyType":115,"taxonomyTypeDesc":116},{"categoryNo":197,"categoryName":198,"taxonomyType":115,"taxonomyTypeDesc":116},"01JBSEEDCAT000000000000037","律师与法务",[200,133,139,156,124,125,201,202,126,121,128,129,131,132,134,135,203,204,205,123],"subagent driven development","delegate","delegation","fresh","parallel","code quality",{"skillNo":207,"name":208,"nameZh":6,"description":209,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":210,"categories":211,"keywords":214,"publishedAt":38},"01M71JF76DA8ARZ4JRYR4VBRWM","requesting-code-review","Pre-commit verification pipeline — static security scan, baseline-aware quality gates, independent reviewer subagent, and auto-fix loop. Use after code changes and before committing, pushing, or opening a PR.","https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup\u002Fblob\u002Fmain\u002Fskills\u002Fsoftware-development\u002Frequesting-code-review\u002FSKILL.md",[212,213],{"categoryNo":146,"categoryName":147,"taxonomyType":107,"taxonomyTypeDesc":108},{"categoryNo":113,"categoryName":114,"taxonomyType":115,"taxonomyTypeDesc":116},[215,216,131,135,124,217,218,125,219,220,126,221,121,222,223,224,133,134,225,226],"code review","requesting code review","pipeline","static","fix","auto-fix","auto","loop","security scan","commit","reviewer","verification",{"skillNo":228,"name":229,"nameZh":6,"description":230,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":231,"categories":232,"keywords":233,"publishedAt":38},"01M71JF52HZT5VQXFVF9K2H76K","plan","Plan mode for Hermes — inspect context, write a markdown plan into the active workspace's `.hermes\u002Fplans\u002F` directory, and do not execute the work.","https:\u002F\u002Fgithub.com\u002Fxuanxuan1983\u002Fhermes-skills-backup\u002Fblob\u002Fmain\u002Fskills\u002Fsoftware-development\u002Fplan\u002FSKILL.md",[],[229,234,235,138,139,20,236,237,123,121,129,133,238,239,240,241,242,243,244,245],"plan-mode","do","inspect","mode","work","markdown","active","directory","workspace","plan mode","write","implementation"]