자동화 에이전트를 프로덕션 운영에 신뢰하기 전에 실제 엔터프라이즈 스타일의 IT 시나리오를 실행하여 성능을 검증합니다.
이 스킬은 ITBench를 활용하여 SRE(사이트 안정성 엔지니어링), CISO(최고 정보 보안 책임자), FinOps(클라우드 재무 운영) 영역의 현실적인 엔터프라이즈 IT 시나리오를 통해 AI 자동화 에이전트의 성능을 벤치마킹합니다. 에이전트가 프로덕션 환경에서 안정적으로 작동할 수 있는지 사전에 검증하고자 하는 DevOps, SRE, 보안 및 클라우드 운영 팀에게 필수적인 도구입니다. ITBench 리더보드는 완전 관리형 시나리오 환경을 제공하며, 연구자와 개발자는 자신의 시스템에서 에이전트를 실행하고 결과를 제출하여 성과를 비교할 수 있습니다. GitHub에서 오픈소스로 제공되며, Python 환경과 특정 종속성만 있으면 누구나 쉽게 시작할 수 있습니다.
npx skills add https://github.com/agentskillexchange/skills/tree/main/skills/benchmark-it-automation-agents-on-realistic-sre-ciso-and-finops-scenarios-with-itbench자동화 에이전트를 프로덕션 운영에 신뢰하기 전에 실제 엔터프라이즈 스타일의 IT 시나리오를 실행하여 성능을 검증합니다.
Python 환경, 벤치마크 종속성, 지원되는 시나리오 환경 또는 자체 호스팅 설정 도구에 대한 접근 권한, 대상 에이전트 구현
기본 사용법 또는 시작 방법:
ITBench 리더보드는 SRE, FinOps, CISO 시나리오에서 에이전트 성능을 추적합니다. 완전 관리형 시나리오 환경을 제공하며, 연구자와 개발자는 자신의 시스템에서 에이전트를 실행하고 결과를 제출합니다.
질문이 있거나 ITBench 시작에 도움이 필요하신가요?
상위 문서에서 추출: https://raw.githubusercontent.com/itbench-hub/ITBench/HEAD/README.md
This repo contains 20 individual skills — each has its own dedicated page.
Builds citation networks from Semantic Scholar API and CrossRef DOI metadata. Visualizes paper influence graphs using NetworkX, identifies seminal works, and tracks research lineage across fields.
Exposes Advanced Custom Fields data through the WordPress REST API using register_rest_field and acf_format_value. Handles repeater fields, flexible content layouts, and gallery fields with proper serialization.
An ASE skill built around ACF Extended, the WordPress enhancement suite for Advanced Custom Fields that adds field types, admin improvements, front-end forms, options pages, and developer tooling. It is a practical fit for agents working inside complex WordPress content models and custom field workflows.
Converts Advanced Custom Fields field groups into native Gutenberg blocks using the ACF Block API v2 and @wordpress/scripts build pipeline. Maps ACF repeaters, groups, and flexible content to InnerBlocks and block attributes with server-side rendering via acf_register_block_type().
Activepieces is an open-source, self-hostable workflow automation platform with 200+ integrations. It provides a visual builder for creating automated workflows and exposes all its connectors as MCP servers for AI agent use.
ActivityWatch is a privacy-first, open-source automated time tracker that records application usage, browser activity, and AFK status across Windows, macOS, and Linux. With 16k+ GitHub stars, it provides detailed productivity analytics without sending data to external servers.
act is an open-source CLI tool that runs GitHub Actions workflows locally using Docker, enabling fast feedback on workflow changes without pushing to GitHub. It is a standard tool for local Actions development and testing.
Use AgentClick when an agent should pause before risky commands, plans, drafts, or code changes so a human can inspect, edit, approve, or reject them in a purpose-built browser UI.
Use UX/UI Agent Skills when Claude should generate tokens, component specs, accessibility audits, and framework-specific UI code from a repeatable design workflow.
Use Bats-core when an agent needs to turn fragile shell scripts or command-line workflows into something it can verify repeatedly after edits. The agent writes focused Bash tests for success paths, failure paths, and output contracts, then runs them locally or in CI before a refactor, release, or incident fix goes out.
Use Cognee to ingest project knowledge into graph and vector memory so agents can retrieve durable context across sessions and workflows.
Give a coding agent symbol-aware lookup, cross-file rename, and structural edit tools before it starts making brittle text-only changes.
Give LangGraph agents memory management and search tools so they can store, retrieve, and update durable facts across sessions.
Use SimpleMem to store, compress, index, and retrieve text or multimodal memories for agents through MCP or Python integrations.
Keep Claude Code sessions grounded in prior decisions, project context, and daily handoff notes instead of starting from zero every time.
Store embeddings beside application data in Postgres, create vector indexes, and query nearest neighbors for semantic search, RAG, recommendations, or agent memory retrieval.
Find the open PR for the current branch, gather unresolved review comments, and drive a focused comment-resolution workflow with gh-authenticated context.
Use VoltAgent to intercept, validate, and enforce input/output policies in TypeScript agent workflows.
Use Zep as an external context layer for agents that need to store events, assemble temporal graph context, and retrieve relevant memory before model calls.
Calls Adobe Firefly
Extract frames or short clips from videos using ffmpeg.
Summarize or transcribe URLs, YouTube/videos, podcasts, articles, transcripts, PDFs, and local files.
Use when testing, fixing, or extending the OpenClaw Control UI GUI with Vitest + Playwright end-to-end checks, mocked Gateway WebSocket flows, mocked dashboard runs, screenshots/videos, or agent-verifiable browser proof.
Obra superpowers agent skills.
See, Understand, Act on video and audio. See- ingest from local files, URLs, RTSP/live feeds, or live record desktop; return realtime context and playable stream links. Understand- extract frames, build visual/semantic/temporal indexes, and search moments with timestamps and auto-clips. Act- transcode and normalize (codec, fps, resolution, aspect ratio), perform timeline edits (subtitles, text/image overlays, branding, audio overlays, dubbing, translation), generate media assets (image, audio...
End-to-end marketing campaign planning and execution. Covers audience research, positioning, campaign angle definition, landing page copy, email sequences, social posts, ad copy, short-form video scripts, and content calendars. Use as the orchestration layer for multi-channel product launches. Use when planning or executing a multi-channel product launch, or producing landing page, email, social, or ad copy.