web-scraping - 网页抓取专家 是做什么的？
精通使用 Python 工具进行网页抓取和数据提取。
精通使用 Python 工具进行网页抓取和数据提取。
该技能专为 AI 代理设计，使其成为使用 Python 工具进行网页抓取和数据提取的专家。它帮助用户从网站中高效地提取结构化数据，适用于数据采集、内容聚合、竞争分析等多种场景。该技能支持广泛使用的 Python 库，如 Requests、Beautiful Soup、Scrapy 和 Selenium，可处理静态和动态网页内容。通过提供清晰的指导和最佳实践，该技能能够解析 HTML、处理 JavaScript 渲染的页面、遵守 robots.txt 规则，并将提取的数据输出为 CSV、JSON 等格式。它适用于各类 AI 代理平台（如 Claude Code、Cursor、Codex），并内置了错误处理、反爬虫规避和请求限速等实用建议。
npx skills add https://github.com/mindrally/skills/tree/main/skills/web-scrapingInstalled? Explore more 研究与数据分析 skills: affaan-m/uspto-database, affaan-m/scholar-evaluation, affaan-m/literature-review · View all 6 →
精通使用 Python 工具进行网页抓取和数据提取。
This repo contains 20 individual skills — each has its own dedicated page.
Implement web accessibility (a11y) best practices following WCAG guidelines to create inclusive, accessible user interfaces.
Expert guidelines for Chrome extension development with Manifest V3, covering security, performance, and best practices. Use when building browser extensions, creating popup UIs, implementing content scripts, working with Chrome APIs, managing extension permissions, or publishing to Chrome Web Store.
Expert guidance for computer vision development using OpenCV, PyTorch, and modern deep learning techniques for image and video processing.
Expert guidance for data analysis, visualization, and Jupyter Notebook development with pandas, matplotlib, seaborn, and numpy.
Expert guidance for deep learning, transformers, diffusion models, and LLM development with PyTorch, Transformers, Diffusers, and Gradio.
Expert in Expo React Native TypeScript mobile development with best practices
Expert in FastAPI Python development with best practices for APIs and async operations
Expert guidelines for building performant animations with Framer Motion/Motion library in React applications
HTMX development guidelines for building dynamic web applications with minimal JavaScript using HTML attributes.
Guidelines for implementing JWT authentication with security best practices for token creation, validation, and storage
Machine learning development with JAX, functional programming patterns, and high-performance computing.
MySQL development best practices for schema design, query optimization, and database administration
Expert in TypeScript, Node.js, Next.js App Router, React, Shadcn UI, Radix UI and Tailwind
Full-stack Next.js 14 development with TypeScript, TailwindCSS, and Supabase for building production-ready web applications.
Expert guidance for Odoo ERP development including Python ORM, XML views, and module architecture
Expert guidance for browser automation using Puppeteer with best practices for web scraping, testing, screenshot capture, and JavaScript execution in headless Chrome.
Redis development best practices for caching, data structures, and high-performance key-value operations
Expert guidance for building web scrapers and crawlers using the Scrapy Python framework with best practices for spider development, data extraction, and pipeline management.
SCSS/Sassy CSS best practices and coding guidelines for maintainable, scalable stylesheets
Guidelines for developing with TypeORM, a full-featured ORM for TypeScript and JavaScript supporting multiple databases
USPTO patent and trademark data workflow for official record lookup, PatentSearch queries, TSDR checks, assignment data, and reproducible IP research logs.
Structured scholarly-work evaluation for papers, proposals, literature reviews, methods sections, evidence quality, citation support, and research-writing feedback.
Systematic literature-review workflow for academic, biomedical, technical, and scientific topics, including search planning, source screening, synthesis, citation checks, and evidence logging.
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
Agent skill repository discovered by 10x-chat research.
Review backend code for quality, security, maintainability, and best practices based on established checklist rules. Use when the user requests a review, analysis, or improvement of backend files (e.g., `.py`) under the `api/` directory. Do NOT use for frontend files (e.g., `.tsx`, `.ts`, `.js`). Supports pending-change review, code snippets review, and file-focused review.