task 是做什麼的?
將自然語言描述轉換為 coder-eval 任務 YAML — 使用最簡提示、加權檢查輸出內容的標準,並透過 coder-eval plan 進行驗證。適用於使用者想要編寫、新增或生成評估任務時。
將自然語言描述轉換為 coder-eval 任務 YAML — 使用最簡提示、加權檢查輸出內容的標準,並透過 `coder-eval plan` 進行驗證。適用於使用者想要編寫、新增或生成評估任務時。
此技能旨在幫助使用者從自然語言描述快速生成符合 coder-eval 格式的任務 YAML 檔案。它會引導使用者提供最簡的提示,並根據輸出內容設置加權的評估標準,最後透過 `coder-eval plan` 指令進行自動驗證,確保任務定義的正確性。這對於需要為 AI 代碼生成或評估建立結構化測試任務的開發者與研究人員特別有用。該技能支援命令列工具 (CLI) 與符合 coder-eval 規範的開發流程。核心工作流程包括:解析使用者輸入的自然語言任務描述、產生對應的 YAML 結構(包含提示、加權標準等欄位)、以及輸出可供後續驗證的任務定義。
npx skills add https://github.com/UiPath/coder_eval/tree/main/plugins/coder-eval/skills/task將自然語言描述轉換為 coder-eval 任務 YAML — 使用最簡提示、加權檢查輸出內容的標準,並透過 coder-eval plan 進行驗證。適用於使用者想要編寫、新增或生成評估任務時。
This repo contains 5 individual skills — each has its own dedicated page.
Analyze a finished coder-eval run and write analysis.md — cluster failures into systemic patterns and recommend fixes. Use when the user wants to know why a run failed, what regressed or got worse since a previous run, what to fix, or what a run says about their tasks.
Generate and run a coder-eval activation suite for a Claude Code skill. Use when the user asks whether a skill triggers, wants to test skill activation, or worries a skill has silently stopped firing.
Generate a GitHub Actions workflow that runs a coder-eval suite as a CI gate or on a schedule, using the published composite action — with the agent runtime, credentials, JUnit output and the run reports wired correctly.
Set up coder-eval in this repository — scan for what is worth evaluating (Claude Code skills, an MCP server, a CLI), then scaffold a task directory with one real task and the command to run it.
Review existing coder-eval task YAML — find criteria that cannot fail, prompts that leak the answer, and near-duplicate tasks, each with a fix. Read-only. Use when the user wants existing tasks reviewed, linted, audited, or checked for gaps.
ElevenLabs text-to-speech with mac-style say UX.
Oracle CLI second-model review/debug/refactor/design with selected files, dry-run token checks, API or browser engine.
Capture and automate macOS UI with the Peekaboo CLI.
Generate multiple radically different interface designs for a module using parallel sub-agents. Use when user wants to design an API, explore interface options, compare module shapes, or mentions "design it twice".
Build a throwaway prototype to flesh out a design — a runnable terminal app for state/business-logic questions, or several radically different UI variations toggleable from one route.
Interview the user relentlessly about a plan or design until reaching shared understanding, resolving each branch of the decision tree. Use when user wants to stress-test a plan, get grilled on their design, or mentions "grill me".