Communitygithub.com

Apify SDK:网页抓取与Actor自动化

Apify SDK 是用于在 Apify 平台上构建 Actor、爬虫及数据提取工作流的官方 JavaScript SDK。它为智能体提供了执行抓取任务、存储输出、管理输入以及将爬虫逻辑与浏览器自动化相结合的结构化方式。

Apify SDK:网页抓取与Actor自动化 是什么?

Apify SDK 是 Apify 平台的官方 JavaScript 工具包,专为构建可扩展的网页抓取和数据提取工作流而设计。它为 AI 智能体(如 Claude Code、Cursor、Codex 等)提供了一种标准化的方式来创建“Actor”(Apify 中的可部署任务),从而高效地执行爬虫、抓取和自动化操作。该 SDK 支持使用无头浏览器(例如 Puppeteer 和 Playwright)进行 JavaScript 渲染的页面抓取,也支持通过 Cheerio 等库处理静态 HTML,使开发者能够灵活应对各种复杂的抓取场景。其核心优势在于深度集成 Apify 平台:智能体可以直接利用 Apify 的存储功能来保存抓取结果、管理输入数据,并利用平台的原生调度、监控和扩缩容能力。无论是运行一次性数据提取、构建周期性更新的数据集,还是将抓取逻辑集成到更大的 AI 工作流中,Apify SDK 都能显著简化开发过程,尤其适合需要处理动态内容或大规模网页数据抓取的开发者智能体。

兼容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/agentskillexchange/skills/tree/main/skills/apify-sdk-web-scraping-actor-automation

在你喜欢的 AI 中提问

打开一个已预加载此 Agent Skill 的新对话。

文档

Apify SDK:网页抓取与Actor自动化 是做什么的?

Apify SDK 是用于在 Apify 平台上构建 Actor、爬虫及数据提取工作流的官方 JavaScript SDK。它为智能体提供了一种结构化的方式来运行抓取任务、存储输出、管理输入以及将爬虫逻辑与浏览器自动化相结合。

安装

使用与你环境匹配的上游安装或设置路径:

  • npm install apify

上游的要求和注意事项:

  • Apify SDK 需要 Node.js 16 或更高版本。通过运行以下命令将 Apify SDK 添加到任何 Node.js 项目中:

基本用法或入门指南:

文档

来源

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

Academic Paper Citation Network Mapper

Builds citation networks from Semantic Scholar API and CrossRef DOI metadata. Visualizes paper influence graphs using NetworkX, identifies seminal works, and tracks research lineage across fields.

ACF Custom Fields REST Exposer

Exposes Advanced Custom Fields data through the WordPress REST API using register_rest_field and acf_format_value. Handles repeater fields, flexible content layouts, and gallery fields with proper serialization.

ACF Extended for Advanced Custom Fields Workflows

An ASE skill built around ACF Extended, the WordPress enhancement suite for Advanced Custom Fields that adds field types, admin improvements, front-end forms, options pages, and developer tooling. It is a practical fit for agents working inside complex WordPress content models and custom field workflows.

ACF to Gutenberg Block Migrator

Converts Advanced Custom Fields field groups into native Gutenberg blocks using the ACF Block API v2 and @wordpress/scripts build pipeline. Maps ACF repeaters, groups, and flexible content to InnerBlocks and block attributes with server-side rendering via acf_register_block_type().

Activepieces Open Source Workflow Automation

Activepieces is an open-source, self-hostable workflow automation platform with 200+ integrations. It provides a visual builder for creating automated workflows and exposes all its connectors as MCP servers for AI agent use.

ActivityWatch Cross-Platform Automated Time Tracker and Producti

ActivityWatch is a privacy-first, open-source automated time tracker that records application usage, browser activity, and AFK status across Windows, macOS, and Linux. With 16k+ GitHub stars, it provides detailed productivity analytics without sending data to external servers.

act Local GitHub Actions Runner

act is an open-source CLI tool that runs GitHub Actions workflows locally using Docker, enabling fast feedback on workflow changes without pushing to GitHub. It is a standard tool for local Actions development and testing.

Add a browser review checkpoint before risky agent actions with

Use AgentClick when an agent should pause before risky commands, plans, drafts, or code changes so a human can inspect, edit, approve, or reject them in a purpose-built browser UI.

Add Claude design-system and accessibility workflows with UX/UI

Use UX/UI Agent Skills when Claude should generate tokens, component specs, accessibility audits, and framework-specific UI code from a repeatable design workflow.

Add executable smoke tests for shell scripts and CLIs before ref

Use Bats-core when an agent needs to turn fragile shell scripts or command-line workflows into something it can verify repeatedly after edits. The agent writes focused Bash tests for success paths, failure paths, and output contracts, then runs them locally or in CI before a refactor, release, or incident fix goes out.

Add graph-backed memory and context retrieval to agent workflows

Use Cognee to ingest project knowledge into graph and vector memory so agents can retrieve durable context across sessions and workflows.

Add IDE-style semantic code navigation and symbol-safe refactors

Give a coding agent symbol-aware lookup, cross-file rename, and structural edit tools before it starts making brittle text-only changes.

Add managed long-term memory to LangGraph agents with LangMem

Give LangGraph agents memory management and search tools so they can store, retrieve, and update durable facts across sessions.

Add multimodal lifelong memory to MCP and Python agents with Sim

Use SimpleMem to store, compress, index, and retrieve text or multimodal memories for agents through MCP or Python integrations.

Add persistent project memory and hook-driven synthesis with Cla

Keep Claude Code sessions grounded in prior decisions, project context, and daily handoff notes instead of starting from zero every time.

Add Postgres-native vector retrieval to agent and RAG workflows

Store embeddings beside application data in Postgres, create vector indexes, and query nearest neighbors for semantic search, RAG, recommendations, or agent memory retrieval.

Address GitHub PR review comments from the current branch with g

Find the open PR for the current branch, gather unresolved review comments, and drive a focused comment-resolution workflow with gh-authenticated context.

Add runtime guardrails to TypeScript agents with VoltAgent

Use VoltAgent to intercept, validate, and enforce input/output policies in TypeScript agent workflows.

Add temporal context memory to agent workflows with Zep

Use Zep as an external context layer for agents that need to store events, assemble temporal graph context, and retrieve relevant memory before model calls.

Adobe Firefly API Batch Image Generator

Calls Adobe Firefly

相关技能