web-scraping 是做什麼的？
具備反機器人繞過、內容提取、非公開 API 及毒丸檢測的網頁爬取。適用於從網站提取內容、處理付費牆、實作爬取串聯或處理社交媒體。涵蓋 requests、trafilatura、Playwright 隱形模式、yt-dlp 和 instaloader 模式。
具備反機器人繞過、內容提取、非公開 API 及毒丸檢測的網頁爬取。適用於從網站提取內容、處理付費牆、實作爬取串聯或處理社交媒體。涵蓋 requests、trafilatura、Playwright 隱形模式、yt-dlp 和 instaloader 模式。
此技能旨在協助開發者或 AI 代理執行網頁爬取任務，特別針對現代網站常見的反爬蟲機制（如機器人偵測、付費牆）提供解決方案。它整合了多種工具與模式：利用 `requests` 進行基礎 HTTP 請求、`trafilatura` 高效提取網頁文字主體（適合新聞或文章）、`Playwright` 搭配隱形模式繞過進階反偵測，以及 `yt-dlp` 和 `instaloader` 處理影音平台與社交媒體。此外，還包含「毒丸檢測」邏輯，識別網站返回的垃圾或誤導性內容，確保提取資料的可靠性。涵蓋的平台包括一般網站、YouTube、Instagram 等，適合用於爬取串聯（fallback 策略）、內容歸檔或自主數據收集。
npx skills add https://github.com/jamditis/claude-skills-journalism/tree/main/skills/web-scrapingInstalled? Explore more 研究與資料分析 skills: affaan-m/uspto-database, affaan-m/scholar-evaluation, affaan-m/literature-review · View all 6 →
具備反機器人繞過、內容提取、非公開 API 及毒丸檢測的網頁爬取。適用於從網站提取內容、處理付費牆、實作爬取串聯或處理社交媒體。涵蓋 requests、trafilatura、Playwright 隱形模式、yt-dlp 和 instaloader 模式。
This repo contains 2 individual skills — each has its own dedicated page.
Academic writing, research methodology, and scholarly communication workflows. Use when writing papers, literature reviews, grant proposals, conducting research, managing citations, preparing for peer review, choosing OA routes under Plan S / 2026 OSTP Nelson Memo, posting preprints, working with persistent identifiers (ORCID, DOI, ROR), assigning CRediT contributor roles, preregistering analyses on OSF / AsPredicted, or disclosing LLM use to journals and funders. Essential for researchers, graduate students, and academics across disciplines.
Legal methods for paywalled and geo-blocked content. Use for paywalls, academic papers, or open access via Unpaywall.
USPTO patent and trademark data workflow for official record lookup, PatentSearch queries, TSDR checks, assignment data, and reproducible IP research logs.
Structured scholarly-work evaluation for papers, proposals, literature reviews, methods sections, evidence quality, citation support, and research-writing feedback.
Systematic literature-review workflow for academic, biomedical, technical, and scientific topics, including search planning, source screening, synthesis, citation checks, and evidence logging.
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
Agent skill repository discovered by 10x-chat research.
Review backend code for quality, security, maintainability, and best practices based on established checklist rules. Use when the user requests a review, analysis, or improvement of backend files (e.g., `.py`) under the `api/` directory. Do NOT use for frontend files (e.g., `.tsx`, `.ts`, `.js`). Supports pending-change review, code snippets review, and file-focused review.