huggingface-llm-trainer
Trains or fine-tunes language and vision models with TRL or Unsloth on Hugging Face Jobs: SFT, DPO, GRPO, reward modeling and GGUF conversion.
- Kind
- Skill
- Works with
- Claude Code
- Source
- Hugging Face Skills @ 25910b3d0ba3
- Path
- skills/huggingface-llm-trainer/SKILL.md
- Jobs
- Implementation
- Topics
- Machine learning, LLM apps & RAG
Credit
- Made by
- huggingface
- Original
- github.com/huggingface/skills/blob/25910b3d0ba31a2ba102f901cd…
- License
- Apache-2.0
Listed by Skill Manifest; not made by us.
InstallInstall it by hand, following the source.
hf skills add huggingface-llm-trainer
Install factsScanned 2 Nov 2026
- Adds
- .claude/skills/huggingface-llm-trainer/ (the skill folder)
- 16 file(s) the skill refers to
- Runs scripts
- Yes
- scripts/estimate_cost.py
- scripts/dataset_inspector.py
- train.py
- scripts/hf_benchmarks.py
- Uses the network
- Yes
- downloads Python packages
- Needs secrets
- Yes
- HF_TOKEN
- Reads environment variables
- HF_TOKEN
- Source revision
- 25910b3d0ba3
- Licence
- Apache-2.0
- Last activity
- 30 Oct 2026
- Review
- Reviewed
Found by a static scan of the stored text; nothing is run. “None found” is not a guarantee, so read what you install before you run it.
- Only the main file is read; other files in the folder are not scanned
# TRL Training on Hugging Face Jobs
## Overview
Train language models using TRL (Transformer Reinforcement Learning) on fully managed Hugging Face infrastructure. No local GPU setup required—models train on cloud GPUs and results are automatically saved to the Hugging Face Hub.
**TRL provides multiple training methods:**
- **SFT** (Supervised Fine-Tuning) - Standard instruction tuning
- **DPO** (Direct Preference Optimization) - Alignment from preference data
- **GRPO** (Group Relative Policy Optimization) - Online RL training
- **Reward Modeling** - Train reward models for RLHF
**For detailed TRL method documentation:**
```python
hf_doc_search("your query", product="trl")
hf_doc_fetch("https://huggingface.co/docs/trl/sft_trainer") # SFT
hf_doc_fetch("https://huggingface.co/docs/trl/dpo_trainer") # DPO
# etc.
```
**See also:** `references/training_methods.md` for method overviews and selection guidance
## When to Use This Skill
Use this skill when users want to:
- Fine-tune language models on cloud GPUs without local infrastructure
- Train with TRL methods (SFT, DPO, GRPO, etc.)
- Run training jobs on Hugging Face Jobs infrastructure
…