대규모 웹 아카이브 연구 및 데이터 추출을 위해 Common Crawl Index API를 질의합니다. CDX 서버 API, warcio를 사용한 WARC 레코드 파싱, 대량 데이터 접근을 위한 Common Crawl S3 버킷을 활용합니다.
이 에이전트 스킬은 Common Crawl의 공개 웹 아카이브 인덱스에 접근하여 대규모 웹 데이터를 질의하고 추출할 수 있도록 설계되었습니다. CDX 서버 API를 통해 특정 URL, 호스트, 또는 패턴에 대한 인덱스 항목을 검색하고, warcio 라이브러리를 사용하여 WARC 레코드를 파싱하여 실제 웹 페이지 콘텐츠를 추출할 수 있습니다. 또한 Common Crawl S3 버킷을 직접 참조하여 대량 데이터 세트를 다운로드하거나 오프라인 분석을 수행할 수 있습니다. 이 스킬은 웹 아카이브 연구, 데이터 마이닝, SEO 분석, 히스토리컬 웹 데이터 수집이 필요한 개발자 및 연구자에게 유용하며, Claude Code, Cursor, Codex와 같은 AI 코딩 에이전트와 통합되어 사용될 수 있습니다.
npx skills add https://github.com/agentskillexchange/skills/tree/main/skills/common-crawl-index-query-agent대규모 웹 아카이브 연구 및 데이터 추출을 위해 Common Crawl Index API를 질의합니다. CDX 서버 API, warcio를 사용한 WARC 레코드 파싱, 대량 데이터 접근을 위한 Common Crawl S3 버킷을 활용합니다.
기본 사용법 또는 시작하기:
Common Crawl 데이터는 Amazon Web Services의 공개 데이터 세트에 저장되어 있습니다. 모든 데이터 및 인덱스 파일은 무료로 다운로드할 수 있습니다. 자체 인덱스 서버를 실행하거나 오프라인에서 인덱스를 분석할 수 있습니다.
URL 인덱스에 대한 자세한 내용은 원래 발표에서 확인할 수 있습니다. 도움이 필요하면 Common Crawl 사용자 포럼 또는 Discord 서버를 방문하세요. 시작하기 안내도 참조하세요.
This repo contains 20 individual skills — each has its own dedicated page.
Builds citation networks from Semantic Scholar API and CrossRef DOI metadata. Visualizes paper influence graphs using NetworkX, identifies seminal works, and tracks research lineage across fields.
Exposes Advanced Custom Fields data through the WordPress REST API using register_rest_field and acf_format_value. Handles repeater fields, flexible content layouts, and gallery fields with proper serialization.
An ASE skill built around ACF Extended, the WordPress enhancement suite for Advanced Custom Fields that adds field types, admin improvements, front-end forms, options pages, and developer tooling. It is a practical fit for agents working inside complex WordPress content models and custom field workflows.
Converts Advanced Custom Fields field groups into native Gutenberg blocks using the ACF Block API v2 and @wordpress/scripts build pipeline. Maps ACF repeaters, groups, and flexible content to InnerBlocks and block attributes with server-side rendering via acf_register_block_type().
Activepieces is an open-source, self-hostable workflow automation platform with 200+ integrations. It provides a visual builder for creating automated workflows and exposes all its connectors as MCP servers for AI agent use.
ActivityWatch is a privacy-first, open-source automated time tracker that records application usage, browser activity, and AFK status across Windows, macOS, and Linux. With 16k+ GitHub stars, it provides detailed productivity analytics without sending data to external servers.
act is an open-source CLI tool that runs GitHub Actions workflows locally using Docker, enabling fast feedback on workflow changes without pushing to GitHub. It is a standard tool for local Actions development and testing.
Use AgentClick when an agent should pause before risky commands, plans, drafts, or code changes so a human can inspect, edit, approve, or reject them in a purpose-built browser UI.
Use UX/UI Agent Skills when Claude should generate tokens, component specs, accessibility audits, and framework-specific UI code from a repeatable design workflow.
Use Bats-core when an agent needs to turn fragile shell scripts or command-line workflows into something it can verify repeatedly after edits. The agent writes focused Bash tests for success paths, failure paths, and output contracts, then runs them locally or in CI before a refactor, release, or incident fix goes out.
Use Cognee to ingest project knowledge into graph and vector memory so agents can retrieve durable context across sessions and workflows.
Give a coding agent symbol-aware lookup, cross-file rename, and structural edit tools before it starts making brittle text-only changes.
Give LangGraph agents memory management and search tools so they can store, retrieve, and update durable facts across sessions.
Use SimpleMem to store, compress, index, and retrieve text or multimodal memories for agents through MCP or Python integrations.
Keep Claude Code sessions grounded in prior decisions, project context, and daily handoff notes instead of starting from zero every time.
Store embeddings beside application data in Postgres, create vector indexes, and query nearest neighbors for semantic search, RAG, recommendations, or agent memory retrieval.
Find the open PR for the current branch, gather unresolved review comments, and drive a focused comment-resolution workflow with gh-authenticated context.
Use VoltAgent to intercept, validate, and enforce input/output policies in TypeScript agent workflows.
Use Zep as an external context layer for agents that need to store events, assemble temporal graph context, and retrieve relevant memory before model calls.
Calls Adobe Firefly
Extract frames or short clips from videos using ffmpeg.
Summarize or transcribe URLs, YouTube/videos, podcasts, articles, transcripts, PDFs, and local files.
Use when testing, fixing, or extending the OpenClaw Control UI GUI with Vitest + Playwright end-to-end checks, mocked Gateway WebSocket flows, mocked dashboard runs, screenshots/videos, or agent-verifiable browser proof.
Obra superpowers agent skills.
See, Understand, Act on video and audio. See- ingest from local files, URLs, RTSP/live feeds, or live record desktop; return realtime context and playable stream links. Understand- extract frames, build visual/semantic/temporal indexes, and search moments with timestamps and auto-clips. Act- transcode and normalize (codec, fps, resolution, aspect ratio), perform timeline edits (subtitles, text/image overlays, branding, audio overlays, dubbing, translation), generate media assets (image, audio...
End-to-end marketing campaign planning and execution. Covers audience research, positioning, campaign angle definition, landing page copy, email sequences, social posts, ad copy, short-form video scripts, and content calendars. Use as the orchestration layer for multi-channel product launches. Use when planning or executing a multi-channel product launch, or producing landing page, email, social, or ad copy.