Community研究与数据分析github.com

brightdata/scrape

通过 Bright Data CLI (`bdata scrape`) 将网页内容抓取为干净的 Markdown、HTML 或 JSON 格式。适用于用户需要抓取单个页面、从 URL 列表中提取内容或爬取分页列表的场景。

scrape 是什么?

该技能通过 Bright Data CLI 的 `bdata scrape` 命令,将网页内容抓取并转换为干净的 Markdown、HTML 或 JSON 格式。它适合需要从单一页面提取数据、批量处理 URL 列表或爬取分页内容的场景。对于 Amazon、LinkedIn、TikTok、Instagram、YouTube、Reddit 等受支持的平台,该技能会转交给 `data-feeds` 处理;若需先发现 URL,则会转交给 `search`。使用前需要安装 Bright Data CLI 并完成登录,若缺少相应工具,技能会主动引导用户进行安装和登录操作。支持多种输出格式、分页爬取和自定义渲染选项,可灵活适配开发者或 AI Agent 的数据抓取需求。

兼容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/brightdata/skills/tree/main/skills/scrape

Installed? Explore more 研究与数据分析 skills: affaan-m/uspto-database, affaan-m/scholar-evaluation, affaan-m/literature-review · View all 6 →

在你喜欢的 AI 中提问

打开一个已预加载此 Agent Skill 的新对话。

文档

scrape 是做什么的?

通过 Bright Data CLI (bdata scrape) 将网页内容抓取为干净的 Markdown、HTML 或 JSON 格式。适用于用户需要抓取单个页面、从 URL 列表中提取内容或爬取分页列表的场景。受支持的平台(Amazon、LinkedIn、TikTok、Instagram、YouTube、Reddit 等)转交给 data-feeds 处理;若需先发现 URL,则转交给 search。使用前需要安装 Bright Data CLI 并完成登录;若缺少相应工具,技能会主动引导用户进行安装和登录操作。

Individual skills in this repo

This repo contains 3 individual skills — each has its own dedicated page.

brightdata/bright-data-best-practices

Build production-ready Bright Data integrations with best practices baked in. Reference documentation for developers using coding assistants (Claude Code, Cursor, etc.) to implement web scraping, search, browser automation, and structured data extraction. Covers Web Unlocker API, SERP API, Web Scraper API, and Browser API (Scraping Browser).

brightdata/brightdata-cli

Guide for using the Bright Data CLI (`brightdata` / `bdata`) to scrape websites, search the web, extract structured data from 40+ platforms, manage proxy zones, and check account budget. Use this skill whenever the user wants to scrape a URL, search Google/Bing/Yandex, extract data from Amazon/LinkedIn/Instagram/TikTok/YouTube/Reddit or any other platform, check their Bright Data balance or zones, or do anything involving web data collection from the terminal. Also trigger when the user mentions brightdata, bdata, web scraping CLI, SERP API, or wants to install Bright Data skills into their coding agent.

brightdata/seo-audit

When the user wants to audit, review, or diagnose SEO issues on their site. Uses live web data via the Bright Data CLI for accurate detection of JS-injected schema, hreflang, canonicals, and live SERP-based ranking checks. Also use when the user mentions "SEO audit," "technical SEO," "why am I not ranking," "SEO issues," "on-page SEO," "meta tags review," "SEO health check," "my traffic dropped," "lost rankings," "not showing up in Google," "site isn't ranking," "Google update hit me," "page speed," "core web vitals," "crawl errors," or "indexing issues." Use this even if the user just says something vague like "my SEO is bad" or "help with SEO" — start with an audit. For building pages at scale to target keywords, see programmatic-seo. For implementing structured data, see schema-markup. For AI search optimization, see ai-seo.

相关技能