Community生产力与协作github.com

google/adk-eval-guide

运行任何 ADK 评估前必读。涵盖 ADK 评估方法论——评估指标、评估集模式、LLM 作为评估者、工具轨迹评分及常见失败原因。适用于评估代理质量、运行 adk eval 或调试评估结果。不适用于 API 代码模式(请使用 adk-cheatsheet)、部署(请使用 adk-deploy-guide)或项目脚手架(请使用 adk-scaffold)。

adk-eval-guide 是什么?

该技能提供了在 Agent Development Kit (ADK) 框架下进行代理评估的完整方法论指导。它详细介绍了评估指标、评估集(evalset)的模式定义、如何使用 LLM 作为评判者(LLM-as-judge)进行自动化评估,以及工具轨迹(tool trajectory)的评分机制。通过分析常见失败原因,帮助开发者快速定位并解决评估中的问题,从而提升代理质量。本技能适用于需要运行 `adk eval` 命令、调试评估结果或定义代理评估标准的场景。请注意,它不涉及 API 代码模式、部署或项目脚手架等主题。

兼容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/google/adk-docs/tree/main/skills/adk-eval-guide

Installed? Explore more 生产力与协作 skills: steipete/gemini, steipete/gh-issues, steipete/skill-creator · View all 6 →

在你喜欢的 AI 中提问

打开一个已预加载此 Agent Skill 的新对话。

文档

adk-eval-guide 是做什么的?

运行任何 ADK 评估前必读。ADK 评估方法论——评估指标、评估集模式、LLM 作为评估者、工具轨迹评分及常见失败原因。适用于评估代理质量、运行 adk eval 或调试评估结果。不适用于 API 代码模式(请使用 adk-cheatsheet)、部署(请使用 adk-deploy-guide)或项目脚手架(请使用 adk-scaffold)。

Individual skills in this repo

This repo contains 5 individual skills — each has its own dedicated page.

google/adk-cheatsheet

MUST READ before writing or modifying ADK agent code. ADK API quick reference for Python — agent types, tool definitions, orchestration patterns, callbacks, and state management. Includes an index of all ADK documentation pages. Do NOT use for creating new projects (use adk-scaffold).

google/adk-deploy-guide

MUST READ before deploying any ADK agent. ADK deployment guide — Agent Engine, Cloud Run, GKE, CI/CD pipelines, secrets, observability, and production workflows. Use when deploying agents to Google Cloud or troubleshooting deployments. Do NOT use for API code patterns (use adk-cheatsheet), evaluation (use adk-eval-guide), or project scaffolding (use adk-scaffold).

google/adk-dev-guide

ALWAYS ACTIVE — read at the start of any ADK agent development session. ADK development lifecycle and mandatory coding guidelines — spec-driven workflow, code preservation rules, model selection, and troubleshooting.

google/adk-observability-guide

MUST READ before setting up observability for ADK agents or when analyzing production traffic, debugging agent behavior, or improving agent performance. ADK observability guide — Cloud Trace, prompt-response logging, BigQuery Agent Analytics, third-party integrations, and troubleshooting. Use when configuring monitoring, tracing, or logging for agents, or when understanding how a deployed agent handles real traffic.

google/adk-scaffold

MUST READ before creating or enhancing any ADK agent project. Use when the user wants to build a new agent (e.g. "build me a search agent") or enhance an existing project (e.g. "add CI/CD to my project", "add RAG").

相关技能