torchforge-rl-training

Provides guidance for PyTorch-native agentic RL using torchforge, Meta's library separating infra from algorithms. Use when you want clean RL abstractions, easy algorithm experimentation, or scalable training with Monarch and TorchTitan.

by Orchestra-Research 12k GitHub stars MIT Updated Jun 16, 2026
torchforge-rl-training skill by Orchestra-Research
torchforge-rl-training — Productivity skill by Orchestra-Research

Overview

torchforge-rl-training is an open-source productivity skill for Claude Code and compatible agents, published by Orchestra-Research. Its author describes it as: “Provides guidance for PyTorch-native agentic RL using torchforge, Meta's library separating infra from algorithms. Use when you want clean RL abstractions, easy algorithm experimentation, or scalable training with Mon…”. The project has 12k stars on GitHub and is available under the MIT license. Add it to your setup with `/plugin marketplace add Orchestra-Research/AI-Research-SKILLs`.

What torchforge-rl-training does

torchforge is Meta's PyTorch-native RL library that separates infrastructure concerns from algorithm concerns. It enables rapid RL research by letting you focus on algorithms while handling distributed training, inference, and weight sync automatically.

What’s inside

The SKILL.md for torchforge-rl-training is organised into these sections:

  • When to Use torchforge
  • Key Features
  • Architecture Overview
  • Installation
  • ROCm Installation
  • Quick Start
  • SFT Training (2+ GPUs)
  • GRPO Training (3+ GPUs)
  • Workflow 1: GRPO Training for Math Reasoning
  • Prerequisites Checklist
  • Step 1: Create Configuration
  • Step 2: Define Reward Function

Installation

Add torchforge-rl-training to your agent with:

/plugin marketplace add Orchestra-Research/AI-Research-SKILLs

Review a skill’s source before installing it — skills can instruct your agent to run commands. This command comes from the skill’s public repository, which is the source of truth for setup steps. New to skills? Read how to install Claude Code skills.

Supported agents

  • Claude Code — ships a claude code plugin marketplace
  • Codex — declared in the repository topics

License

torchforge-rl-training is published under the MIT license.

Strengths

  • Clear MIT license — safe to read and adapt within its terms
  • Ships in Orchestra-Research/AI-Research-SKILLs, an established project with 11,807 GitHub stars
  • Works with Claude Code, Codex

Author

Orchestra-Research 41 skills in the catalog · GitHub profile ↗
View skills

Topics

Need a skill like this, tailored to your team?Build a custom skill →

Frequently asked questions

What does torchforge-rl-training do?
Provides guidance for PyTorch-native agentic RL using torchforge, Meta's library separating infra from algorithms. Use when you want clean RL abstractions, easy algorithm experimentation, or scalable training with Monarch and TorchTitan.
How do I install torchforge-rl-training?
Run /plugin marketplace add Orchestra-Research/AI-Research-SKILLs in your agent, then reload your skills. Review the source at https://github.com/Orchestra-Research/AI-Research-SKILLs before installing.
Is torchforge-rl-training free to use?
Yes. torchforge-rl-training is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.
Which agents does torchforge-rl-training work with?
torchforge-rl-training lists Claude Code and Codex — named in its SKILL.md, its plugin marketplace or its repository topics. Skills use the portable SKILL.md format, so other agents that read that format may load it too.
Where does torchforge-rl-training come from?
torchforge-rl-training ships inside Orchestra-Research/AI-Research-SKILLs, a repository that contains 41 catalogued skills in total. The repository's 11,807 GitHub stars apply to that whole collection, not to this skill on its own.

Provides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework. Use when training GLM models, implementing custom data generation workflows, or needing tight Megatron-LM integration for RL scaling.

Claude CodeCodex
12k GitHub stars MIT Updated Jun 16, 2026 Free

Orchestrates end-to-end autonomous AI research projects using a two-loop architecture. The inner loop runs rapid experiment iterations with clear optimization targets. The outer loop synthesizes results, identifies patterns, and steers research direction. Routes to domain-specific skills for execution, supports continuous agent operation via Claude Code /loop and OpenClaw heartbeat, and produces research presentations and papers. Use when starting a research project, running autonomous experiments, or managing a multi-hypothesis research effort.

Claude CodeCodex
12k GitHub stars MIT Updated Jun 16, 2026 Free

Provides guidance for interpreting and manipulating neural network internals using nnsight with optional NDIF remote execution. Use when needing to run interpretability experiments on massive models (70B+) without local GPU resources, or when working with any PyTorch architecture.

Claude CodeCodex
12k GitHub stars MIT Updated Jun 16, 2026 Free

Provides guidance for training and analyzing Sparse Autoencoders (SAEs) using SAELens to decompose neural network activations into interpretable features. Use when discovering interpretable features, analyzing superposition, or studying monosemantic representations in language models.

Claude CodeCodex
12k GitHub stars MIT Updated Jun 16, 2026 Free

Provides guidance for enterprise-grade RL training using miles, a production-ready fork of slime. Use when training large MoE models with FP8/INT4, needing train-inference alignment, or requiring speculative RL for maximum throughput.

Claude CodeCodex
12k GitHub stars MIT Updated Jun 16, 2026 Free