MemoryBench를 사용하여 여러 제공업체, 데이터셋, 평가 모델, 체크포인트에 걸쳐 반복 가능한 대화형 메모리 및 RAG 벤치마크를 실행하고 구조화된 보고서를 생성합니다.
이 스킬은 MemoryBench 도구를 활용하여 AI 에이전트의 메모리 및 RAG(Retrieval-Augmented Generation) 시스템에 대한 반복 가능하고 표준화된 벤치마크를 실행하는 방법을 제공합니다. 다양한 메모리/RAG 제공업체(예: Supabase, Pinecone, Weaviate 등)를 나란히 비교하고, 여러 데이터셋과 평가 모델(judge model)을 사용하여 성능을 측정할 수 있습니다. Bun 런타임 환경에서 실행되며, CLI를 통해 간단히 설정 및 실행할 수 있습니다. 주요 기능으로는 다중 제공업체 간 비교, 구조화된 보고서 생성(실행 상태, 실패 내역, 주요 메트릭 포함), 그리고 체크포인트 저장 및 복원이 포함되어 있어 에이전트 시스템의 메모리 성능을 체계적으로 평가하고 최적화하는 데 유용합니다. 이 스킬은 Claude Code, Cursor, Codex와 같은 AI 에이전트 플랫폼에서 사용할 수 있으며, 공식 GitHub 저장소와 문서를 기반으로 합니다.
npx skills add https://github.com/agentskillexchange/skills/tree/main/skills/benchmark-agent-memory-and-rag-systems-with-memorybenchMemoryBench를 사용하여 여러 제공업체, 데이터셋, 평가 모델, 체크포인트에 걸쳐 반복 가능한 대화형 메모리 및 RAG 벤치마크를 실행하고 구조화된 보고서를 생성합니다.
Bun, MemoryBench 저장소, 최소 하나의 메모리/RAG 제공업체 API 키, 최소 하나의 평가 모델 API 키, 벤치마크 데이터셋
기본 사용법 또는 시작하기 참고 사항:
🆚 다중 제공업체 비교: 동일한 벤치마크를 여러 제공업체에서 나란히 실행
📊 구조화된 보고서: 실행 상태, 실패 내역 및 메트릭을 분석 가능한 형식으로 내보내기
bun install
상위 문서에서 발췌: https://raw.githubusercontent.com/supermemoryai/memorybench/HEAD/README.md
This repo contains 20 individual skills — each has its own dedicated page.
Builds citation networks from Semantic Scholar API and CrossRef DOI metadata. Visualizes paper influence graphs using NetworkX, identifies seminal works, and tracks research lineage across fields.
Exposes Advanced Custom Fields data through the WordPress REST API using register_rest_field and acf_format_value. Handles repeater fields, flexible content layouts, and gallery fields with proper serialization.
An ASE skill built around ACF Extended, the WordPress enhancement suite for Advanced Custom Fields that adds field types, admin improvements, front-end forms, options pages, and developer tooling. It is a practical fit for agents working inside complex WordPress content models and custom field workflows.
Converts Advanced Custom Fields field groups into native Gutenberg blocks using the ACF Block API v2 and @wordpress/scripts build pipeline. Maps ACF repeaters, groups, and flexible content to InnerBlocks and block attributes with server-side rendering via acf_register_block_type().
Activepieces is an open-source, self-hostable workflow automation platform with 200+ integrations. It provides a visual builder for creating automated workflows and exposes all its connectors as MCP servers for AI agent use.
ActivityWatch is a privacy-first, open-source automated time tracker that records application usage, browser activity, and AFK status across Windows, macOS, and Linux. With 16k+ GitHub stars, it provides detailed productivity analytics without sending data to external servers.
act is an open-source CLI tool that runs GitHub Actions workflows locally using Docker, enabling fast feedback on workflow changes without pushing to GitHub. It is a standard tool for local Actions development and testing.
Use AgentClick when an agent should pause before risky commands, plans, drafts, or code changes so a human can inspect, edit, approve, or reject them in a purpose-built browser UI.
Use UX/UI Agent Skills when Claude should generate tokens, component specs, accessibility audits, and framework-specific UI code from a repeatable design workflow.
Use Bats-core when an agent needs to turn fragile shell scripts or command-line workflows into something it can verify repeatedly after edits. The agent writes focused Bash tests for success paths, failure paths, and output contracts, then runs them locally or in CI before a refactor, release, or incident fix goes out.
Use Cognee to ingest project knowledge into graph and vector memory so agents can retrieve durable context across sessions and workflows.
Give a coding agent symbol-aware lookup, cross-file rename, and structural edit tools before it starts making brittle text-only changes.
Give LangGraph agents memory management and search tools so they can store, retrieve, and update durable facts across sessions.
Use SimpleMem to store, compress, index, and retrieve text or multimodal memories for agents through MCP or Python integrations.
Keep Claude Code sessions grounded in prior decisions, project context, and daily handoff notes instead of starting from zero every time.
Store embeddings beside application data in Postgres, create vector indexes, and query nearest neighbors for semantic search, RAG, recommendations, or agent memory retrieval.
Find the open PR for the current branch, gather unresolved review comments, and drive a focused comment-resolution workflow with gh-authenticated context.
Use VoltAgent to intercept, validate, and enforce input/output policies in TypeScript agent workflows.
Use Zep as an external context layer for agents that need to store events, assemble temporal graph context, and retrieve relevant memory before model calls.
Calls Adobe Firefly
Extract frames or short clips from videos using ffmpeg.
Summarize or transcribe URLs, YouTube/videos, podcasts, articles, transcripts, PDFs, and local files.
Use when testing, fixing, or extending the OpenClaw Control UI GUI with Vitest + Playwright end-to-end checks, mocked Gateway WebSocket flows, mocked dashboard runs, screenshots/videos, or agent-verifiable browser proof.
Obra superpowers agent skills.
See, Understand, Act on video and audio. See- ingest from local files, URLs, RTSP/live feeds, or live record desktop; return realtime context and playable stream links. Understand- extract frames, build visual/semantic/temporal indexes, and search moments with timestamps and auto-clips. Act- transcode and normalize (codec, fps, resolution, aspect ratio), perform timeline edits (subtitles, text/image overlays, branding, audio overlays, dubbing, translation), generate media assets (image, audio...
End-to-end marketing campaign planning and execution. Covers audience research, positioning, campaign angle definition, landing page copy, email sequences, social posts, ad copy, short-form video scripts, and content calendars. Use as the orchestration layer for multi-channel product launches. Use when planning or executing a multi-channel product launch, or producing landing page, email, social, or ad copy.