AGENT SKILL

llama-factory

Expert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal support

License 许可
MIT
所属仓库
beyondai/sandbox
最近更新
2026-11-08
Stars
★ 0
Forks
0

01 前言 Front Matter

name
llama-factory
tags
[ "Fine-Tuning", "LLaMA Factory", "LLM", "WebUI", "No-Code", "QLoRA", "LoRA", "Multimodal", "HuggingFace", "Llama", "Qwen", "Gemma" ]
author
Orchestra Research
license
MIT
version
1.0.0
description
Expert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal support
dependencies
[ "llmtuner", "torch", "transformers", "datasets", "peft", "accelerate", "gradio" ]

02 资源文件 5

03 SKILL.md 正文

Llama-Factory Skill

Comprehensive assistance with llama-factory development, generated from official documentation.

When to Use This Skill

This skill should be triggered when:

  • Working with llama-factory
  • Asking about llama-factory features or APIs
  • Implementing llama-factory solutions
  • Debugging llama-factory code
  • Learning llama-factory best practices

Quick Reference

Common Patterns

Quick reference patterns will be added as you use the skill.

Reference Files

This skill includes comprehensive documentation in references/:

  • _images.md - Images documentation
  • advanced.md - Advanced documentation
  • getting_started.md - Getting Started documentation
  • other.md - Other documentation

Use view to read specific reference files when detailed information is needed.

Working with This Skill

For Beginners

Start with the getting_started or tutorials reference files for foundational concepts.

For Specific Features

Use the appropriate category reference file (api, guides, etc.) for detailed information.

For Code Examples

The quick reference section above contains common patterns extracted from the official docs.

Resources

references/

Organized documentation extracted from official sources. These files contain:

  • Detailed explanations
  • Code examples with language annotations
  • Links to original documentation
  • Table of contents for quick navigation

scripts/

Add helper scripts here for common automation tasks.

assets/

Add templates, boilerplate, or example projects here.

Notes

  • This skill was automatically generated from official documentation
  • Reference files preserve the structure and examples from source docs
  • Code examples include language detection for better syntax highlighting
  • Quick reference patterns are extracted from common usage examples in the docs

Updating

To refresh this skill with updated documentation:

  1. Re-run the scraper with the same configuration
  2. The skill will be rebuilt with the latest information

04 同仓库更多 Skills

beyondai
beyondai/sandbox

weights-and-biases

Track ML experiments with automatic logging, visualize training in real-time, optimize hyperparameters with sweeps, and manage model registry with W&B - collaborative MLOps platform

★ 0
beyondai
beyondai/sandbox

serving-llms-vllm

Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.

★ 0
beyondai
beyondai/sandbox

verl-rl-training

Provides guidance for training LLMs with reinforcement learning using verl (Volcano Engine RL). Use when implementing RLHF, GRPO, PPO, or other RL algorithms for LLM post-training at scale with flexible infrastructure backends.

★ 0
beyondai
beyondai/sandbox

unsloth

Expert guidance for fast fine-tuning with Unsloth - 2-5x faster training, 50-80% less memory, LoRA/QLoRA optimization

★ 0
beyondai
beyondai/sandbox

fine-tuning-with-trl

Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers.

★ 0
beyondai
beyondai/sandbox

torchforge-rl-training

Provides guidance for PyTorch-native agentic RL using torchforge, Meta's library separating infra from algorithms. Use when you want clean RL abstractions, easy algorithm experimentation, or scalable training with Monarch and TorchTitan.

★ 0