Overview
training-llms-megatron is an open-source workflow skill for Claude Code and compatible agents, published by Orchestra-Research. Its author describes it as: “Trains large language models (2B-462B parameters) using NVIDIA Megatron-Core with advanced parallelism strategies. Use when training models >1B parameters, need maximum GPU efficiency (47% MFU on H100), or require ten…”. The project has 12k stars on GitHub and is available under the MIT license. Add it to your setup with `/plugin marketplace add Orchestra-Research/AI-Research-SKILLs`.
What training-llms-megatron does
Megatron-Core trains LLMs from 2B to 462B parameters with up to 47% Model FLOP Utilization on H100 GPUs through advanced parallelism strategies.
What’s inside
The SKILL.md for training-llms-megatron is organised into these sections:
- Quick start
- Common workflows
- Workflow 1: Train LLaMA-style model with 3D parallelism
- Workflow 2: Configure Mixture of Experts (MoE) training
- Workflow 3: Optimize for maximum throughput
- When to use vs alternatives
- Common issues
- Advanced topics
- Hardware requirements
- Resources
Installation
Add training-llms-megatron to your agent with:
/plugin marketplace add Orchestra-Research/AI-Research-SKILLsReview a skill’s source before installing it — skills can instruct your agent to run commands. This command comes from the skill’s public repository, which is the source of truth for setup steps. New to skills? Read how to install Claude Code skills.
Supported agents
- Claude Code — ships a claude code plugin marketplace
- Codex — declared in the repository topics
License
training-llms-megatron is published under the MIT license.
Strengths
- Clear MIT license — safe to read and adapt within its terms
- Ships in Orchestra-Research/AI-Research-SKILLs, an established project with 11,807 GitHub stars
- Works with Claude Code, Codex
Author
Topics
Frequently asked questions
- What does training-llms-megatron do?
- Trains large language models (2B-462B parameters) using NVIDIA Megatron-Core with advanced parallelism strategies. Use when training models >1B parameters, need maximum GPU efficiency (47% MFU on H100), or require tensor/pipeline/sequence/context/expert parallelism. Production-ready framework used for Nemotron, LLaMA, DeepSeek.
- How do I install training-llms-megatron?
- Run /plugin marketplace add Orchestra-Research/AI-Research-SKILLs in your agent, then reload your skills. Review the source at https://github.com/Orchestra-Research/AI-Research-SKILLs before installing.
- Is training-llms-megatron free to use?
- Yes. training-llms-megatron is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.
- Which agents does training-llms-megatron work with?
- training-llms-megatron lists Claude Code and Codex — named in its SKILL.md, its plugin marketplace or its repository topics. Skills use the portable SKILL.md format, so other agents that read that format may load it too.
- Where does training-llms-megatron come from?
- training-llms-megatron ships inside Orchestra-Research/AI-Research-SKILLs, a repository that contains 41 catalogued skills in total. The repository's 11,807 GitHub stars apply to that whole collection, not to this skill on its own.