Multi-cloud orchestration for ML workloads with automatic cost optimization. Use when you need to run training or batch jobs across multiple clouds, leverage spot instances with auto-recovery, or optimize GPU costs across providers.
modal-serverless-gpu
modal-serverless-gpu is an open-source devops skill for Claude Code and compatible agents, published by Orchestra-Research. Its author describes it as: “Serverless GPU cloud platform for running ML workloads. Use when you need on-demand GPU access without infrastructure management, deploying ML models as APIs, or running batch jobs with automatic scaling.”. The project has 12k stars on GitHub and is available under the MIT license. Add it to your setup with `/plugin marketplace add Orchestra-Research/AI-Research-SKILLs`.
What modal-serverless-gpu does
Comprehensive guide to running ML workloads on Modal's serverless GPU cloud platform.
Installation
Add modal-serverless-gpu to your agent with:
/plugin marketplace add Orchestra-Research/AI-Research-SKILLsAlways review a skill's source before installing it. This command comes from the skill's public repository; the linked repo is the source of truth for exact setup steps.
What's inside
The SKILL.md for modal-serverless-gpu is organised into these sections:
- When to use Modal
- Quick start
- Installation
- Hello World with GPU
- Basic inference endpoint
- Core concepts
- Key components
- Execution modes
- GPU configuration
- Available GPUs
- GPU specification patterns
- Container images
When to use it
Reach for modal-serverless-gpu when you want devops help from your agent without writing the same instructions every session. Load the skill and the agent picks it up automatically for relevant tasks.
Strengths
- Clear MIT license — safe to read and adapt
- Ships in Orchestra-Research/AI-Research-SKILLs, an established project with 11,807 GitHub stars
- Actively maintained (recent commits)
Topics
Frequently asked questions
- What does modal-serverless-gpu do?
- Serverless GPU cloud platform for running ML workloads. Use when you need on-demand GPU access without infrastructure management, deploying ML models as APIs, or running batch jobs with automatic scaling.
- How do I install modal-serverless-gpu?
- Run /plugin marketplace add Orchestra-Research/AI-Research-SKILLs in your agent, then reload your skills. Review the source at https://github.com/Orchestra-Research/AI-Research-SKILLs before installing.
- Is modal-serverless-gpu free to use?
- Yes. modal-serverless-gpu is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.
- Where does modal-serverless-gpu come from?
- modal-serverless-gpu ships inside Orchestra-Research/AI-Research-SKILLs, a repository that contains 41 catalogued skills in total. The repository's 11,807 GitHub stars apply to that whole collection, not to this skill on its own.
Related skills
More DevOps →Reserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent filesystems, or high-performance multi-node clusters for large-scale training.
Provides guidance for training LLMs with reinforcement learning using verl (Volcano Engine RL). Use when implementing RLHF, GRPO, PPO, or other RL algorithms for LLM post-training at scale with flexible infrastructure backends.
Install our local first extensions for your favorite AI IDE or Terminal Agent. Process your histories into reusable skills with Lore. Sync your conversations to the cloud. File issues and requests.
Deploy Your Frontend in a Single Command. Claude Code Skills supported.