Overview
peft-fine-tuning is an open-source workflow skill for Claude Code and compatible agents, published by Orchestra-Research. Its author describes it as: “Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or…”. The project has 12k stars on GitHub and is available under the MIT license. Add it to your setup with `/plugin marketplace add Orchestra-Research/AI-Research-SKILLs`.
What peft-fine-tuning does
Fine-tune LLMs by training <1% of parameters using LoRA, QLoRA, and 25+ adapter methods.
What’s inside
The SKILL.md for peft-fine-tuning is organised into these sections:
- When to use PEFT
- Quick start
- Installation
- LoRA fine-tuning (standard)
- QLoRA fine-tuning (memory-efficient)
- LoRA parameter selection
- Rank (r) - capacity vs efficiency
- Alpha (loraalpha) - scaling factor
- Target modules by architecture
- Loading and merging adapters
- Load trained adapter
- Merge adapter into base model
Installation
Add peft-fine-tuning to your agent with:
/plugin marketplace add Orchestra-Research/AI-Research-SKILLsReview a skill’s source before installing it — skills can instruct your agent to run commands. This command comes from the skill’s public repository, which is the source of truth for setup steps. New to skills? Read how to install Claude Code skills.
Supported agents
- Claude Code — ships a claude code plugin marketplace
- Codex — declared in the repository topics
License
peft-fine-tuning is published under the MIT license.
Strengths
- Clear MIT license — safe to read and adapt within its terms
- Ships in Orchestra-Research/AI-Research-SKILLs, an established project with 11,807 GitHub stars
- Works with Claude Code, Codex
Author
Topics
Alternatives to peft-fine-tuning
Similar skills from other repositories:
Frequently asked questions
- What does peft-fine-tuning do?
- Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.
- How do I install peft-fine-tuning?
- Run /plugin marketplace add Orchestra-Research/AI-Research-SKILLs in your agent, then reload your skills. Review the source at https://github.com/Orchestra-Research/AI-Research-SKILLs before installing.
- Is peft-fine-tuning free to use?
- Yes. peft-fine-tuning is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.
- Which agents does peft-fine-tuning work with?
- peft-fine-tuning lists Claude Code and Codex — named in its SKILL.md, its plugin marketplace or its repository topics. Skills use the portable SKILL.md format, so other agents that read that format may load it too.
- Where does peft-fine-tuning come from?
- peft-fine-tuning ships inside Orchestra-Research/AI-Research-SKILLs, a repository that contains 41 catalogued skills in total. The repository's 11,807 GitHub stars apply to that whole collection, not to this skill on its own.