agilerl
Use AgileRL for reinforcement learning workflows: classical RL training, evolutionary HPO, evolvable networks, multi-agent PettingZoo training, offline/bandit data, and LLM fine-tuning.
- License 许可
- Apache-2.0
- 最近更新
- 2026-10-08
- Stars
- ★ 11
- Forks
- 3
01 前言 Front Matter
- name
- agilerl
- license
- Apache 2.0
- metadata
- { "disco-role": "operating" }
- description
- Use AgileRL for reinforcement learning workflows: classical RL training, evolutionary HPO, evolvable networks, multi-agent PettingZoo training, offline/bandit data, and LLM fine-tuning.
- disable-model-invocation
- true
02 资源文件 5
- 参考文档references/benchmarking.md1.8 KB
- 参考文档references/package-overview.md2.9 KB
- 参考文档references/repo-provenance.md1.0 KB
- 参考文档references/repo-routing-metadata.json513 B
- 参考文档references/troubleshooting.md2.8 KB
03 SKILL.md 正文
AgileRL
Use this repo skill when a task involves AgileRL, agilerl, evolutionary hyperparameter optimization for RL, Gymnasium/PettingZoo training with AgileRL algorithms, AgileRL evolvable modules/networks, offline RL datasets, contextual bandits, or AgileRL LLM post-training.
Quick Start
- Install:
pip install agilerl. - Optional LLM stack:
pip install "agilerl[llm]"only when the task uses GRPO/CISPO/GSPO, DPO/SFT, vLLM, PEFT, DeepSpeed, or transformer datasets. - Import check:
python -c "import agilerl, importlib.metadata as md; print(md.version('agilerl'))". - Read
references/package-overview.mdfor the algorithm family map,references/troubleshooting.mdfor cross-cutting dependency/backend issues, andreferences/repo-provenance.mdwhen checking whether this skill is stale. - Run
scripts/check_agilerl_install.py --helpfor a safe local capability probe; it does not train, download models, or require the source checkout.
Route By Task
| User task | Read |
|---|---|
Train PPO, DQN, RainbowDQN, DDPG, or TD3 on Gymnasium; wire create_population, train_on_policy, train_off_policy, replay/rollout buffers, or distributed classical training |
sub-skills/training-workflows/SKILL.md |
| Configure tournament selection, mutations, mutable RL hyperparameters, architecture mutation probabilities, or population evolution | sub-skills/hpo-and-mutation/SKILL.md |
Build custom EvolvableModule/EvolvableNetwork objects, net_config, MLP/CNN/LSTM/MultiInput/SimBa configs, actors, critics, or DummyEvolvable wrappers |
sub-skills/evolvable-modules/SKILL.md |
Use PettingZoo multi-agent training, MADDPG, MATD3, IPPO, AsyncPettingZooVecEnv, agent id grouping, or AgileRL wrappers |
sub-skills/multi-agent-and-wrappers/SKILL.md |
Use offline datasets, HDF5/Minari conversion, replay filling, CQL/ILQL, contextual bandits, NeuralUCB, NeuralTS, or BanditEnv |
sub-skills/offline-bandits-data/SKILL.md |
Plan LLM fine-tuning/post-training with GRPO, CISPO, GSPO, LLM PPO, REINFORCE, SFT, DPO, vLLM, DeepSpeed, PEFT, or AgileRL LLM envs |
sub-skills/llm-fine-tuning/SKILL.md |
| Compare benchmark scripts or adapt performance runs safely | references/benchmarking.md |
Common AgileRL Building Blocks
- Algorithms:
PPO,DQN,RainbowDQN,DDPG,TD3,CQN,ILQL,NeuralUCB,NeuralTS,MADDPG,MATD3,IPPO,GRPO,CISPO,GSPO, LLM PPO, REINFORCE,SFT, andDPO. - Population setup usually starts with
agilerl.utils.utils.create_population(...)and a Gymnasium or PettingZoo observation/action space. - Evolution usually combines
TournamentSelection(...)andMutations(...); useHyperparameterConfigandRLParameterfor mutable algorithm attributes. - Network configuration usually uses
net_configwithencoder_config,head_config, and optional recurrent/CNN/MultiInput fields. - Training helpers return trained populations and fitness metrics; full training can be long, so prefer import/config/smoke checks before launching runs.
Safe Validation Pattern
- Check installation and optional dependency availability with
scripts/check_agilerl_install.py. - Validate spaces, algorithm names,
INIT_HP,net_config, and HPO configs with the nearest sub-skill helper script. - Run tiny constructor/import checks before full training.
- Treat demos, tutorials, benchmark launchers, and original repo tests as evidence only; do not depend on the AgileRL source checkout from this generated skill.
- For long training, LLM, GPU, vLLM, DeepSpeed, Minari remote, UCI, or benchmark tasks, document required hardware/data/network first and ask before expensive execution.
Troubleshooting First Reads
- Install/import, Python version, missing optional extras, Torch/Gymnasium/PettingZoo/JAX/W&B issues:
references/troubleshooting.md. - Training shape/config errors:
sub-skills/training-workflows/references/troubleshooting.md. - Mutation/HPO mistakes:
sub-skills/hpo-and-mutation/references/troubleshooting.md. - Network architecture/config mistakes:
sub-skills/evolvable-modules/references/troubleshooting.md. - Multi-agent env/wrapper mistakes:
sub-skills/multi-agent-and-wrappers/references/troubleshooting.md. - Offline/bandit data schema mistakes:
sub-skills/offline-bandits-data/references/troubleshooting.md. - LLM optional dependency and backend mistakes:
sub-skills/llm-fine-tuning/references/troubleshooting.md.
04 同仓库更多 Skills
obsidian-clipper-template-creator
Guide for creating templates for the Obsidian Web Clipper. Use when you want to create a new clipping template, understand available variables, or format clipped content.
obsidian-clipper-template-creator
Guide for creating templates for the Obsidian Web Clipper. Use when you want to create a new clipping template, understand available variables, or format clipped content.
python-api
Programmatic Object-Detection-Metrics API guidance for BoundingBox, BoundingBoxes, Evaluator, enums, coordinate conversion, AP/mAP semantics, and source-style import diagnostics.
file-evaluation
Folder-based PASCAL VOC AP/mAP evaluation from ground-truth and detection text files.
object-detection-metrics
Guides legacy Object-Detection-Metrics PASCAL VOC AP/mAP evaluation from detection text folders and direct Python API classes.
nx-workspace-patterns
Configure and optimize Nx monorepo workspaces. Use when setting up Nx, configuring project boundaries, optimizing build caching, or implementing affected commands.