AGENT SKILL

finetuning

Fine-tune models on Azure AI Foundry using SFT (supervised), DPO (preference), or RFT (reinforcement with graders). Covers dataset preparation, training job submission, deployment, and evaluation. USE FOR: fine-tune, SFT, DPO, RFT, training data, grader, distillation, fine-tuned model, training job, large file upload, calibrate grader, deploy fine-tuned model, evaluate fine-tuned model. DO NOT USE FOR: general model deployment without fine-tuning (use deploy-model), agent creation (use agents), prompt optimization without training (use prompt-optimizer).

License 许可
MIT
最近更新
2026-07-13
Stars
★ 0
Forks
0

01 前言 Front Matter

name
finetuning
license
MIT
metadata
{ "author": "Microsoft", "version": "0.0.0-placeholder" }
description
Fine-tune models on Azure AI Foundry using SFT (supervised), DPO (preference), or RFT (reinforcement with graders). Covers dataset preparation, training job submission, deployment, and evaluation. USE FOR: fine-tune, SFT, DPO, RFT, training data, grader, distillation, fine-tuned model, training job, large file upload, calibrate grader, deploy fine-tuned model, evaluate fine-tuned model. DO NOT USE FOR: general model deployment without fine-tuning (use deploy-model), agent creation (use agents), prompt optimization without training (use prompt-optimizer).

02 资源文件 32

03 SKILL.md 正文

Fine-Tuning on Azure AI Foundry

Fine-tune models using SFT (supervised), DPO (preference), or RFT (reinforcement with graders). Covers dataset prep, training, deployment, and evaluation.

When to Use

Use this sub-skill when the user asks about:

  • Fine-tuning a model (SFT, DPO, or RFT)
  • Preparing, validating, or formatting training data
  • Submitting, monitoring, or diagnosing training jobs
  • Calibrating graders or pass thresholds for RFT
  • Deploying or evaluating a fine-tuned model
  • Choosing between training types (SFT vs DPO vs RFT)
  • Distillation, synthetic data generation, or dataset quality scoring
  • Large file uploads for training data
  • Cleaning up fine-tuning resources (files, deployments)

Do NOT use for: General model deployment without fine-tuning (use deploy-model), agent creation (use agents), prompt optimization without training (use prompt-optimizer).

Workflows

Stage Guide
Quick start workflows/quickstart.md
Full pipeline workflows/full-pipeline.md
Create data workflows/dataset-creation.md
Iterate workflows/iterative-training.md
Diagnose workflows/diagnose-poor-results.md

References

Topic File
SFT vs DPO vs RFT references/training-types.md
Hyperparameters references/hyperparameters.md
Data formats references/dataset-formats.md
Grader design (RFT) references/grader-design.md
Reward hacking references/reward-hacking.md
Agentic RFT (tools) references/agentic-rft.md
Deployment references/deployment.md
Training curves references/training-curves.md
Evaluation references/evaluation.md
Vision fine-tuning references/vision-fine-tuning.md
Large file uploads references/large-file-uploads.md
Platform gotchas references/platform-gotchas.md

Scripts

Script Purpose
scripts/submit_training.py Submit SFT/DPO/RFT jobs
scripts/monitor_training.py Poll job until completion
scripts/calibrate_grader.py Find optimal RFT pass_threshold
scripts/check_training.py Analyze curves, list checkpoints
scripts/deploy_model.py Deploy via ARM REST API
scripts/evaluate_model.py LLM judge evaluation
scripts/convert_dataset.py Convert between SFT/DPO/RFT formats
scripts/generate_distillation_data.py Generate synthetic training data
scripts/score_dataset.py Quality scoring on training data
scripts/cleanup.py Delete old files and deployments
scripts/validate/ Data validators (SFT, DPO, RFT) + stats

Rules

  1. Always baseline first — evaluate the base model before fine-tuning
  2. Validate data before submitting — run scripts/validate/validate_sft.py
  3. Calibrate RFT graders — target 25-50% failure rate on the base model
  4. Evaluate checkpoints — don't blindly deploy the final one
  5. Measure token cost alongside accuracy when comparing models

Quick Reference

Task Command
Validate SFT data python scripts/validate/validate_sft.py data.jsonl
Submit SFT job python scripts/submit_training.py --model gpt-4.1-mini --training-file train.jsonl --validation-file val.jsonl --type sft
Monitor job python scripts/monitor_training.py --job-id ftjob-xxx
Analyze curves python scripts/check_training.py --job-id ftjob-xxx
Deploy model python scripts/deploy_model.py --model-id ft:gpt-4.1-mini:... --name my-eval
Evaluate model python scripts/evaluate_model.py --deployment-name my-eval --test-file test.jsonl

Error Handling

Error Cause Fix
"API version not supported" Older openai SDK on /v1/ endpoint Upgrade to openai>=1.0
"does not support fine-tuning with Standard TrainingType" OSS model needs globalStandard Use --use-rest flag or script auto-falls back
Job stuck in post-training eval Under-provisioned tool endpoint (RFT) Scale to S2+, enable Always On
"DeploymentNotReady" after ARM succeeds ARM/data-plane race condition Delete and recreate deployment, wait 5 min
Content safety block at deployment PII-dense training data Remove problematic document types

04 同仓库更多 Skills

janpereira-dev
janpereira-dev/skillsCurate

zustand-5

Zustand 5 state management patterns. Trigger: When managing React state with Zustand.

★ 0
janpereira-dev
janpereira-dev/skillsCurate

zod-4

Zod 4 schema validation patterns. Trigger: When using Zod for validation - breaking changes from v3.

★ 0
janpereira-dev
janpereira-dev/skillsCurate

work-unit-commits

Plan commits as reviewable work units. Trigger: implementation, commit splitting, chained PRs, or keeping tests and docs with code.

★ 0
janpereira-dev
janpereira-dev/skillsCurate

web-quality-audit

Comprehensive web quality audit covering performance, accessibility, SEO, and best practices. Use when asked to "audit my site", "review web quality", "run lighthouse audit", "check page quality", or "optimize my website".

★ 0
janpereira-dev
janpereira-dev/skillsCurate

web-artifacts-builder

Suite of tools for creating elaborate, multi-component claude.ai HTML artifacts using modern frontend web technologies (React, Tailwind CSS, shadcn/ui). Use for complex artifacts requiring state management, routing, or shadcn/ui components - not for simple single-file HTML/JSX artifacts.

★ 0
janpereira-dev
janpereira-dev/skillsCurate

vercel-react-view-transitions

Guide for implementing smooth, native-feeling animations using React's View Transition API (`<ViewTransition>` component, `addTransitionType`, and CSS view transition pseudo-elements). Use this skill whenever the user wants to add page transitions, animate route changes, create shared element animations, animate enter/exit of components, animate list reorder, implement directional (forward/back) navigation animations, or integrate view transitions in Next.js. Also use when the user mentions view transitions, `startViewTransition`, `ViewTransition`, transition types, or asks about animating between UI states in React without third-party animation libraries.

★ 0