transformer-lens-interpretability

Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, studying attention patterns, or performing activation patching experiments.

by Orchestra-Research 12k GitHub stars MIT Updated Jun 16, 2026
transformer-lens-interpretability skill by Orchestra-Research
transformer-lens-interpretability — Frontend skill by Orchestra-Research

Overview

transformer-lens-interpretability is an open-source frontend skill for Claude Code and compatible agents, published by Orchestra-Research. Its author describes it as: “Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, s…”. The project has 12k stars on GitHub and is available under the MIT license. Add it to your setup with `/plugin marketplace add Orchestra-Research/AI-Research-SKILLs`.

What transformer-lens-interpretability does

TransformerLens is the de facto standard library for mechanistic interpretability research on GPT-style language models. Created by Neel Nanda and maintained by Bryce Meyer, it provides clean interfaces to inspect and manipulate model internals via HookPoints on every activation.

What’s inside

The SKILL.md for transformer-lens-interpretability is organised into these sections:

  • When to Use TransformerLens
  • Installation
  • Core Concepts
  • HookedTransformer
  • Supported Models (50+)
  • Activation Caching
  • ActivationCache Keys
  • Workflow 1: Activation Patching (Causal Tracing)
  • Step-by-Step
  • Checklist
  • Workflow 2: Circuit Analysis (Indirect Object Identification)
  • Workflow 3: Induction Head Detection

Installation

Add transformer-lens-interpretability to your agent with:

/plugin marketplace add Orchestra-Research/AI-Research-SKILLs

Review a skill’s source before installing it — skills can instruct your agent to run commands. This command comes from the skill’s public repository, which is the source of truth for setup steps. New to skills? Read how to install Claude Code skills.

Supported agents

  • Claude Code — ships a claude code plugin marketplace
  • Codex — declared in the repository topics

License

transformer-lens-interpretability is published under the MIT license.

Strengths

  • Clear MIT license — safe to read and adapt within its terms
  • Ships in Orchestra-Research/AI-Research-SKILLs, an established project with 11,807 GitHub stars
  • Works with Claude Code, Codex

Author

Orchestra-Research 41 skills in the catalog · GitHub profile ↗
View skills

Topics

Need a skill like this, tailored to your team?Build a custom skill →

Frequently asked questions

What does transformer-lens-interpretability do?
Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, studying attention patterns, or performing activation patching experiments.
How do I install transformer-lens-interpretability?
Run /plugin marketplace add Orchestra-Research/AI-Research-SKILLs in your agent, then reload your skills. Review the source at https://github.com/Orchestra-Research/AI-Research-SKILLs before installing.
Is transformer-lens-interpretability free to use?
Yes. transformer-lens-interpretability is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.
Which agents does transformer-lens-interpretability work with?
transformer-lens-interpretability lists Claude Code and Codex — named in its SKILL.md, its plugin marketplace or its repository topics. Skills use the portable SKILL.md format, so other agents that read that format may load it too.
Where does transformer-lens-interpretability come from?
transformer-lens-interpretability ships inside Orchestra-Research/AI-Research-SKILLs, a repository that contains 41 catalogued skills in total. The repository's 11,807 GitHub stars apply to that whole collection, not to this skill on its own.

Expert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal support

Claude CodeCodex
12k GitHub stars MIT Updated Jun 16, 2026 Free

flow + prompt = flompt - Visual AI Prompt Builder. Decompose, edit as flowchart, recompile into optimized machine-readable prompts

Claude CodeGemini CLI
140 GitHub stars MIT Updated Mar 30, 2026 Free

Automates browser interactions for web testing, form filling, screenshots, and data extraction. Use when the user needs to navigate websites, interact with web pages, fill forms, take screenshots, test web applications, or extract information from web pages.

↑ GrowingActive CodexCursorOpenCode
69k GitHub stars Other Updated Aug 31, 2026 Free

Browser automation with persistent page state. Use when users ask to navigate websites, fill forms, take screenshots, extract web data, test web apps, or automate browser workflows. Trigger phrases include "go to [url]", "click on", "fill out the form", "take a screenshot", "scrape", "automate", "test the website", "log into", or any browser interaction request.

↑ GrowingActive CodexCursorOpenCode
69k GitHub stars Other Updated Aug 31, 2026 Free