Community研究與資料分析github.com

brightdata/scrape

透過 Bright Data CLI (`bdata scrape`) 將網頁內容擷取為乾淨的 Markdown、HTML 或 JSON。當使用者想要擷取頁面、從 URL 清單提取內容或爬取分頁列表時使用。會將支援的平台(Amazon、LinkedIn、TikTok、Instagram、YouTube、Reddit 等)交給 `data-feeds` 處理,並在需要先發現 URL 時交給 `search`。需要 Bright Data CLI;如果缺少則會主動引導安裝和登入。

scrape 是什麼?

brightdata/scrape 是一款 AI 代理技能,用於將網頁內容擷取為結構化格式(Markdown、HTML 或 JSON),並透過 Bright Data CLI(`bdata scrape`)執行。開發者可在需要時使用此技能:擷取單一頁面、從 URL 列表提取內容,或爬取分頁列表。對於已支援的平台(如 Amazon、LinkedIn、TikTok、Instagram、YouTube、Reddit 等),此技能會將請求轉交給 `data-feeds` 處理;若需要先發現 URL,則交由 `search` 處理。此技能要求安裝 Bright Data CLI;若缺少,它會主動引導使用者進行安裝和登入。它可與 Claude Code、Cursor、Codex 等 AI 代理工具整合,提供標準化的網頁擷取流程。

相容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/brightdata/skills/tree/main/skills/scrape

Installed? Explore more 研究與資料分析 skills: affaan-m/uspto-database, affaan-m/scholar-evaluation, affaan-m/literature-review · View all 6 →

在你喜歡的 AI 中提問

開啟一個已預先載入此 Agent Skill 的新對話。

說明文件

scrape 是做什麼的?

透過 Bright Data CLI (bdata scrape) 將網頁內容擷取為乾淨的 Markdown、HTML 或 JSON。當使用者想要擷取頁面、從 URL 清單提取內容或爬取分頁列表時使用。會將支援的平台(Amazon、LinkedIn、TikTok、Instagram、YouTube、Reddit 等)交給 data-feeds 處理,並在需要先發現 URL 時交給 search。需要 Bright Data CLI;如果缺少則會主動引導安裝和登入。

Individual skills in this repo

This repo contains 3 individual skills — each has its own dedicated page.

brightdata/bright-data-best-practices

Build production-ready Bright Data integrations with best practices baked in. Reference documentation for developers using coding assistants (Claude Code, Cursor, etc.) to implement web scraping, search, browser automation, and structured data extraction. Covers Web Unlocker API, SERP API, Web Scraper API, and Browser API (Scraping Browser).

brightdata/brightdata-cli

Guide for using the Bright Data CLI (`brightdata` / `bdata`) to scrape websites, search the web, extract structured data from 40+ platforms, manage proxy zones, and check account budget. Use this skill whenever the user wants to scrape a URL, search Google/Bing/Yandex, extract data from Amazon/LinkedIn/Instagram/TikTok/YouTube/Reddit or any other platform, check their Bright Data balance or zones, or do anything involving web data collection from the terminal. Also trigger when the user mentions brightdata, bdata, web scraping CLI, SERP API, or wants to install Bright Data skills into their coding agent.

brightdata/seo-audit

When the user wants to audit, review, or diagnose SEO issues on their site. Uses live web data via the Bright Data CLI for accurate detection of JS-injected schema, hreflang, canonicals, and live SERP-based ranking checks. Also use when the user mentions "SEO audit," "technical SEO," "why am I not ranking," "SEO issues," "on-page SEO," "meta tags review," "SEO health check," "my traffic dropped," "lost rankings," "not showing up in Google," "site isn't ranking," "Google update hit me," "page speed," "core web vitals," "crawl errors," or "indexing issues." Use this even if the user just says something vague like "my SEO is bad" or "help with SEO" — start with an audit. For building pages at scale to target keywords, see programmatic-seo. For implementing structured data, see schema-markup. For AI search optimization, see ai-seo.

相關技能