Communitygithub.com

amplitude/builder-skills

실험 결과 요약, 승자 선정, 그리고 이해관계자에게 바로 전달할 수 있는 권장사항 초안 작성. A/B 테스트가 완료되고 결과를 전달해야 할 때 사용하세요.

builder-skills란 무엇인가요?

이 스킬은 제품 관리자와 데이터 팀이 A/B 테스트 결과를 명확하고 실행 가능한 리포트로 전환할 수 있도록 설계되었습니다. 원시 데이터(지표, 표본 크기, 신뢰 구간 등)를 입력하면 가설 요약, 통계적 및 실질적 유의성을 포함한 결과 해석, 승자 선정, 세그먼트 분석, 권장 사항, 그리고 주요 내용(TL;DR)과 영향, 다음 단계를 포함한 이해관계자 커뮤니케이션 초안을 구조화된 형식으로 제공합니다. 통계 전문 지식이 없더라도 리더십, 엔지니어링 팀, 회사 전체 등 다양한 청중에게 맞춤형 메시지를 전달할 수 있습니다. 이 스킬은 Claude Code, Cursor, Codex와 같은 AI 에이전트 플랫폼과 호환되며, 사용자가 제공한 컨텍스트(또는 사용자 요청 시 입력)를 기반으로 프롬프트 템플릿을 통해 일관되고 전문적인 실험 결과 리포트를 생성합니다. 모호한 결과에 대해서도 정직하게 프레이밍하여 강제로 승자를 선정하지 않도록 도와줍니다.

지원 대상~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/amplitude/builder-skills/tree/HEAD/product-skills/skills/craft-experiment-readout

즐겨 사용하는 AI에게 물어보기

이 에이전트 스킬이 미리 로드된 새 채팅을 엽니다.

문서

실험 리포트

실험 결과를 요약하고, 승자를 선정하며, 이해관계자가 바로 사용할 수 있는 권장사항 초안을 작성합니다.

실험이 끝났고 데이터가 준비되었습니다. 이 스킬은 원시 결과를 팀과 리더십이 실행할 수 있는 명확한 리포트(공유를 위한 커뮤니케이션 포함)로 전환하는 데 도움을 줍니다. 통계 학위는 필요하지 않습니다.


프롬프트 템플릿

당신은 다양한 부서의 청중을 위해 A/B 테스트를 요약하는 경험 많은 제품 관리자입니다.

다음은 실험 세부 정보와 결과입니다:

<context>
$ARGUMENTS
</context>

> 위 내용이 비어 있으면 사용자에게 다음을 요청하세요: "{{실험 결과(지표, 표본 크기, 신뢰 구간, 기간 등)를 붙여넣으세요.}}"

청중은: {{예: 리더십, 엔지니어링 팀, 부서 간 파트너, 회사 전체}}

다음을 포함하는 실험 리포트를 작성하세요:

1. **요약** — 한 단락: 무엇을 테스트했는지, 어떤 일이 발생했는지, 권장 사항은 무엇인지.
2. **가설 요약** — 우리가 기대한 것과 그 이유.
3. **결과** — 실제 숫자가 포함된 주요 지표. 통계적 유의성과 실질적 유의성을 언급하세요.
4. **승자** — 어떤 변형이 승리했는지, 또는 결론이 나지 않았음을 선언하세요. 모호한 결과에 대해서는 정직하게 표현하세요.
5. **세그먼트 분석** — 사용자 세그먼트(예: 신규 사용자 vs. 재방문 사용자, 요금제 유형, 플랫폼)에 따라 효과가 달라졌나요?
6. **권장 사항** — 출시, 반복, 또는 중단? 다음 단계는 무엇인가요?
7. **학습 내용** — 즉각적인 테스트 외에 무엇을 배웠나요? 향후 작업에 미치는 영향은 무엇인가요?

그런 다음 리포트를 기반으로 이해관계자 커뮤니케이션 초안을 작성하세요:

8. **핵심 요약(TL;DR)** — 핵심 내용을 담은 한두 문장.
9. **영향** — 이것이 청중에게 의미하는 바. 그들이 알아야 하거나 해야 할 일은 무엇인가요?
10. **다음 단계** — 명확한 작업, 담당자, 가능한 경우 일정.

평이한 언어를 사용하세요. 전문 용어를 피하세요. 청중에 맞게 어조를 조정하세요. 핵심 요약(TL;DR)만 훑어봐도 실행할 수 있을 정도로 권장 사항을 명확하게 만드세요.

팁

  • 분석 도구의 스크린샷이나 표를 붙여넣으세요. 세부 정보가 많을수록 더 좋은 리포트가 생성됩니다.
  • 결과가 결정적이지 않다면 억지로 승자를 선정하지 마세요. 이 스킬은 모호함을 명확하게 프레이밍하는 데 도움을 줍니다.
  • 청중을 구체적으로 지정하세요. "리더십"과 "엔지니어링 팀"은 매우 다른 메시지가 필요합니다.
  • 정기적인 리포트의 경우, 맞춤형 프롬프트를 저장하고 재사용하세요.

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

amplitude/builder-skills

Performs deep analysis of a specific Amplitude chart to explain trends, anomalies, and likely drivers. Use when a metric looks unusual, investigating a spike or drop, or understanding the "why" behind numbers.

amplitude/builder-skills

Deeply analyze Amplitude dashboards by analyzing key charts, surfacing top areas for concern and takeaways, identify anomalies, then explain changes using customer feedback trends.

amplitude/builder-skills

Designs A/B tests with proper metrics and variants, analyzes running or completed experiments, and interprets results with statistical rigor. Use when setting up experiments, checking experiment status, analyzing results, or making ship decisions.

amplitude/builder-skills

Synthesizes customer feedback into actionable themes including feature requests, bugs, pain points, and praise. Use when planning product roadmap, understanding user sentiment, investigating specific issues, or preparing voice-of-customer reports.

amplitude/builder-skills

Analyze MCP server usage instrumented with Amplitude's MCP Analytics SDK: break usage and errors down by tool, read the rationales within each tool to see what callers are trying to do, and produce a prioritized write-up of actionable fixes. Use this skill whenever the user asks to understand how their MCP server is being used, what agents/users are trying to do with it, why tool calls are failing, what to fix or improve in their MCP server, or asks for an "MCP usage report", "tool error analysis", "intent analysis", "rationale clustering", or "MCP insights". Also trigger when the user mentions [MCP]-prefixed events, tool rationale, tool call errors, or just finished instrumenting their MCP server and wants to see what the data says. Requires the Amplitude MCP connector.

amplitude/builder-skills

Read lost deals and churned accounts from your CRM, extract reasons clustered by theme (missing features, pricing, competitors, UX), and write a prioritized weekly analysis with product improvement recommendations. Use before roadmap planning or to build the case for prioritizing retention work.

amplitude/builder-skills

Creates Amplitude charts from natural language descriptions, handling event selection, filters, groupings, and visualization choices. Use when you know what you want to measure but prefer not to build the chart manually.

amplitude/builder-skills

Guide an Amplitude user through building a custom agent by suggesting use cases grounded in their role and data, shaping the idea into a well-formed spec, and generating a ready-to-run Global Agent deeplink that creates it. Use to create, build, or set up a custom agent, automate a recurring analysis, or put a repeated report on a schedule.

amplitude/builder-skills

Builds comprehensive Amplitude dashboards from requirements or goals, organizing charts into logical sections with appropriate layouts. Use when creating a complete dashboard from scratch or assembling existing charts into a cohesive view.

amplitude/builder-skills

Monitors all active and recently completed experiments across Amplitude projects, triages them by importance, then runs deep analysis and reporting on the most impactful ones. Use when the user asks to "check on experiments", "experiment status", "experiment review", "what experiments are running", or wants a periodic experiment health report.

amplitude/builder-skills

Pull Intercom tickets and Slack support messages from the past 7 days, classify each signal, enrich with CRM data (ARR, plan, renewal), score by customer value and churn risk, and output a tiered priority report saved to Drive. Use when you need a fast, data-driven view of what support signals matter most.

amplitude/builder-skills

Use this skill whenever a user wants to improve existing pages on their website to get cited more by AI models — whether they say "our pages aren't getting cited", "improve this page for AI visibility", "which of our pages should we update", "make this article more cite-worthy", "our competitors are getting cited instead of us", "update our content for AI search", or any variation where the goal is improving an existing asset rather than creating something new. This skill pulls owned pages from AI Visibility, identifies which ones have citation potential but are underperforming, compares them against the external pages that are winning citations on the same topics, and produces section-level rewrites or a full-page update — then pushes the revision to the CMS as a draft. Trigger even if the user just says "help me get cited more" or "why is [competitor] getting cited instead of us".

amplitude/builder-skills

Use this skill whenever a user wants to win AI citations on prompts that competitors currently dominate — whether they say "competitors are getting cited instead of us", "we're losing on these prompts", "how do I outrank [competitor] in AI answers", "find prompts where we should be winning", "create content to beat [competitor]", or any variation where the goal is capturing AI share on prompts a competitor currently owns. This skill pulls competitor visibility data from AI Visibility, identifies the specific prompts where competitors win and Amplitude is absent, clusters them by intent, and produces targeted comparison pages, alternatives content, or rebuttal assets — then pushes drafts to CMS. Trigger on any mention of competitor, prompt hijack, outrank, or "why is [competitor] getting cited instead of us".

amplitude/builder-skills

Use this skill whenever a user wants to turn AI Visibility data into published content — whether they say "find content gaps", "what should we write about", "which topics have low visibility", "help me get cited by AI models", "create a blog post from our AI Visibility gaps", "we're losing to competitors on these prompts", or any variation where they want to go from AI visibility weakness to a draft article, landing page, or FAQ. This skill connects directly to Amplitude AI Visibility data (topics, prompts, visibility scores, citations, competitor data, full LLM responses and sources) and produces a publish-ready content brief plus full article draft. If the user mentions CMS (WordPress, Webflow, Contentful, Sanity, HubSpot, Ghost, Shopify), also trigger this skill to push the draft directly. Trigger even if they just say something vague like "what content should we create?" in an AI Visibility context.

amplitude/builder-skills

Use this skill whenever a user wants to test content variants before publishing to find which one will get cited most by AI models — whether they say "which version of this content will perform better", "test this article before we publish", "simulate how AI will respond to this content", "which angle should we use", "generate content variants and pick the winner", "run a simulation before publishing", or any variation where the goal is data-driven content selection rather than gut-feel publishing. This skill takes an identified content opportunity, generates 2–3 distinct variants with different angles or structures, scores them against actual AI model responses from AI Visibility, references the Simulate Changes feature for pre-publish validation, and produces a clear recommendation on which variant to publish — then pushes the winner to CMS. Trigger on any mention of "simulate", "test variants", "which performs better", "A/B content", or "before we publish".

amplitude/builder-skills

Use this skill whenever a user wants to understand which external sources are being cited by AI models on topics relevant to their brand, and wants to create content that will outrank those sources — whether they say "what sources are AI models citing", "why is [third-party site] being cited instead of us", "we want to be the definitive source on X", "build something that gets cited more than G2 or TechRadar", "create an authoritative asset", or any variation where the goal is producing a new reference asset (definition page, benchmark, methodology, glossary, comparison hub) designed to beat existing top-cited sources. This skill analyzes AI Visibility source data, reverse-engineers what makes top-cited pages authoritative, and produces a superior source asset — then pushes it to CMS as a draft. Trigger on any mention of "sources", "third-party citations", "authoritative content", "definitional pages", or "outrank".

amplitude/builder-skills

Instrument a Node/TypeScript MCP server with Amplitude's @amplitude/mcp-analytics SDK so tool calls, sessions, and rationale are tracked as Amplitude events. Use this skill whenever the user wants to add Amplitude analytics to their MCP server, mentions "MCP Analytics", "@amplitude/mcp-analytics", "instrument my MCP server", "track MCP tool calls", "add rationale to my MCP tools", or wants agent traffic (Claude, Cursor, ChatGPT) attributed back to Amplitude. Also use for adding UTM tagging to MCP-returned links, or for troubleshooting identity/user_id mismatches between MCP events and web/mobile Amplitude data.

amplitude/builder-skills

Instruments a pull request with Amplitude analytics that conform to the project's existing taxonomy. Reads the tracking plan via the Amplitude MCP server (events, properties, naming conventions), analyzes the PR diff to find the few user actions genuinely worth tracking, detects the codebase's SDK and tracking patterns, and adds instrumentation that matches both. Optionally (opt-in) stages new events and properties on an Amplitude tracking-plan branch for data-governance review. Use when asked to "instrument this PR", "add analytics to this change", "add tracking", "add Amplitude events", "instrument this feature", or "what should I track here".

amplitude/builder-skills

Diagnoses product health by cross-referencing Amplitude analytics (dashboards, charts, funnels, feedback, AI agent analytics), optionally Datadog (errors, latency, stack traces), and optionally Slack (qualitative feedback, bug reports, feature requests). Identifies what's broken, what's working, and what to do about it — with root causes, not just symptoms. Use when asked to "diagnose my product", "what's going on", "product health check", "what's broken", "where are users struggling", "give me a product diagnosis", or "what should I focus on".

amplitude/builder-skills

Summarizes B2B account health by analyzing usage patterns, engagement trends, risk signals, and expansion opportunities. Use for customer success reviews, renewal preparation, QBRs, or account prioritization.

관련 스킬