CommunityResearch & Data Analysisgithub.com

shobhitg/playbook

Use when deciding how a software team should work, especially once AI agents write much of the code. Covers how changes get reviewed, approved, merged and rolled out; how to test or verify work, including evals, golden datasets and LLM graders; how to write tasks, CLAUDE.md or REVIEW.md for agents and pick effort or session type; how to run agents unattended or on a schedule; how to design an agent's tools and context; and how to measure engineering cost and quality. Also use when asked how Anthropic or the Claude Code team does any of these.

What is playbook?

playbook is a Claude Code agent skill that use when deciding how a software team should work, especially once AI agents write much of the code. Covers how changes get reviewed, approved, merged and rolled out; how to test or verify work, including evals, golden datasets and LLM graders; how to write tasks, CLAUDE.md or REVIEW.md for agents and pick effort or session type; how to run agents unattended or on a schedule; how to design an agent's tools and context; and how to measure engineering cost and quality. Also use when asked how Anthropic or the Claude Code team does any of these.

Works with✓Claude Code~Codex CLI~Cursor
npx skills add https://github.com/shobhitg/let-it-cook/tree/main/skills/playbook

Installed? Explore more Research & Data Analysis skills: affaan-m/uspto-database, affaan-m/scholar-evaluation, affaan-m/literature-review · View all 6 →

Ask in your favorite AI

Open a new chat with this agent skill pre-loaded.

Documentation

claude.dev-first engineering playbook

Anthropic's teams publish how they build software with agents on claude.dev. This skill carries that guidance, digested post by post. Current through 2026-10-15 (16 posts).

How to answer

  1. Find the question's topic in the table below and read that reference file before answering. Open a post's digest in posts/ when you need its details or exact words.
  2. Shape the answer like this:
    • What Anthropic's teams do: the guidance that applies, each point linked to its post as https://claude.dev/blog/<slug>/.
    • Beyond claude.dev: anything the posts don't cover, answered from general practice and labeled as such. Leave this part out when the posts cover the whole question.
  3. Quote only from the digests in posts/, never from memory.
  4. A digest's "Perishable details" (model names, prices, effort defaults) hold only for the model or version they name. Check what's current before repeating one.
  5. If the user asks for the newest guidance, or the question concerns something after the date above, read https://claude.dev/rss.xml and any post newer than that date before answering.

Topics

The question is aboutRead
Code review, approvals, merging, flags, rollout, rollback, who owns a changereferences/shipping.md
Tests, evals, golden cases, graders, benchmarks, CI gates, agents checking their own workreferences/verification.md
Handing work to agents: task specs, CLAUDE.md, effort, model choice, local or cloud sessions, subagents, skills, output formatsreferences/delegation.md
Agents running unattended or on a schedule: state between runs, credentials, budgets, guardrailsreferences/automation.md
Building agents: tools, context, prompt caching, workflowsreferences/agent-design.md
Cost per task, human time per change, reverts, incidentsreferences/measurement.md

Core rules

  1. Name the finish line and the check that proves it, then let it cook. (Opus 5.5 playbook, Cloud sessions)
  2. No claim without evidence. Agents run real checks and show the output before a person looks, and a different agent does the verifying. (Code review, Dynamic workflows)
  3. Ask which check should catch a problem, not whether a human read the code. Human approvals scale with risk, the change sets the tier, and an agent's approval never counts as a person's. (Code review)
  4. Judge the system by human time per change, with reverts and incidents as the guardrail. (Code review)
  5. Golden cases come from reality, and two experts would agree on each verdict. Turn incidents into eval cases, and read graded transcripts before trusting a grader. (Code review, Eval design)
  6. Trust only gains that beat the noise on cases the tuner never saw. (Eval design)
  7. Give agents a number to beat that is proven to track the real outcome, and ratchet every win in CI. (claude.ai 3x faster)
  8. Make mistakes cheap to undo: a merge queue, short-lived flags, staged rollout, fast rollback, and a named owner for every change. (Code review, claude.ai 3x faster)
  9. Unattended agents fail loudly: a failed read is never a quiet day, and nothing counts as done until the destination confirms it. (Agent automations)
  10. Keep context lean and let the agent find the rest; delete rules as models improve. (Context engineering, Seeing like an agent)
  11. Pay for finished tasks, not tokens: a check is cheaper than more effort, and a retry costs more than any saving. (Task cost)

Sources

PublishedPost
2026-10-15How the Claude Code team does code review
2026-10-08Building effective agent automations
2026-10-06Claude Code in the cloud: a field guide to cloud sessions
2026-10-01Getting started with Claude Code mods
2026-09-28Building with Claude Sonnet 5.5
2026-09-28Automating eval design and hillclimbing with Claude
2026-09-25What a task costs on Opus 5.5
2026-09-25Using Claude Code: Spending your effort
2026-09-23How we made claude.ai 3x faster in two weeks
2026-09-22Getting the most out of Opus 5.5 in Claude and Claude Code
2026-07-24The new rules of context engineering for Claude 5 generation models
2026-06-03Lessons from building Claude Code: How we use skills
2026-06-02A harness for every task: dynamic workflows in Claude Code
2026-05-20Using Claude Code: The unreasonable effectiveness of HTML
2026-04-30Lessons from building Claude Code: Prompt caching is everything
2026-04-10Seeing like an agent: how we design tools in Claude Code

Related Skills