Was macht scrapy-web-scraping?
Fachkundige Anleitung zum Erstellen von Web-Scrapern und Crawlern mit dem Scrapy-Python-Framework, einschließlich Best Practices für Spider-Entwicklung, Datenextraktion und Pipeline-Management.
Fachkundige Anleitung zum Erstellen von Web-Scrapern und Crawlern mit dem Scrapy-Python-Framework, einschließlich Best Practices für Spider-Entwicklung, Datenextraktion und Pipeline-Management.
Diese Fähigkeit bietet umfassende Anleitungen für Entwickler, die Web-Scraping- und Crawling-Projekte mit dem Scrapy-Framework in Python umsetzen möchten. Sie deckt bewährte Methoden für die Erstellung effizienter Spider, die Extraktion strukturierter Daten und das Management von Datenpipelines ab. Die Skill-Dokumentation erklärt, wie man Scrapy-Projekte initialisiert, XPath/CSS-Selektoren verwendet, Daten exportiert und Middleware sowie Pipelines für die Nachbearbeitung einsetzt. Sie unterstützt die gängigen AI-Agenten-Plattformen (Claude Code, Cursor, Codex) und ist ideal für Entwickler, die skalierbare und wartbare Web-Scraping-Lösungen benötigen. Der Fokus liegt auf praktischen Beispielen, Fehlerbehandlung und der Integration mit anderen Tools wie Datenbanken oder CSV-Export.
npx skills add https://github.com/mindrally/skills/tree/main/skills/scrapy-web-scrapingInstalled? Explore more Recherche & Datenanalyse skills: affaan-m/uspto-database, affaan-m/scholar-evaluation, affaan-m/literature-review · View all 6 →
Fachkundige Anleitung zum Erstellen von Web-Scrapern und Crawlern mit dem Scrapy-Python-Framework, einschließlich Best Practices für Spider-Entwicklung, Datenextraktion und Pipeline-Management.
This repo contains 20 individual skills — each has its own dedicated page.
Implement web accessibility (a11y) best practices following WCAG guidelines to create inclusive, accessible user interfaces.
Expert guidelines for Chrome extension development with Manifest V3, covering security, performance, and best practices. Use when building browser extensions, creating popup UIs, implementing content scripts, working with Chrome APIs, managing extension permissions, or publishing to Chrome Web Store.
Expert guidance for computer vision development using OpenCV, PyTorch, and modern deep learning techniques for image and video processing.
Expert guidance for data analysis, visualization, and Jupyter Notebook development with pandas, matplotlib, seaborn, and numpy.
Expert guidance for deep learning, transformers, diffusion models, and LLM development with PyTorch, Transformers, Diffusers, and Gradio.
Expert in Expo React Native TypeScript mobile development with best practices
Expert in FastAPI Python development with best practices for APIs and async operations
Expert guidelines for building performant animations with Framer Motion/Motion library in React applications
HTMX development guidelines for building dynamic web applications with minimal JavaScript using HTML attributes.
Guidelines for implementing JWT authentication with security best practices for token creation, validation, and storage
Machine learning development with JAX, functional programming patterns, and high-performance computing.
MySQL development best practices for schema design, query optimization, and database administration
Expert in TypeScript, Node.js, Next.js App Router, React, Shadcn UI, Radix UI and Tailwind
Full-stack Next.js 14 development with TypeScript, TailwindCSS, and Supabase for building production-ready web applications.
Expert guidance for Odoo ERP development including Python ORM, XML views, and module architecture
Expert guidance for browser automation using Puppeteer with best practices for web scraping, testing, screenshot capture, and JavaScript execution in headless Chrome.
Redis development best practices for caching, data structures, and high-performance key-value operations
SCSS/Sassy CSS best practices and coding guidelines for maintainable, scalable stylesheets
Guidelines for developing with TypeORM, a full-featured ORM for TypeScript and JavaScript supporting multiple databases
Expert in web scraping and data extraction with Python tools
USPTO patent and trademark data workflow for official record lookup, PatentSearch queries, TSDR checks, assignment data, and reproducible IP research logs.
Structured scholarly-work evaluation for papers, proposals, literature reviews, methods sections, evidence quality, citation support, and research-writing feedback.
Systematic literature-review workflow for academic, biomedical, technical, and scientific topics, including search planning, source screening, synthesis, citation checks, and evidence logging.
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
Agent skill repository discovered by 10x-chat research.
Review backend code for quality, security, maintainability, and best practices based on established checklist rules. Use when the user requests a review, analysis, or improvement of backend files (e.g., `.py`) under the `api/` directory. Do NOT use for frontend files (e.g., `.tsx`, `.ts`, `.js`). Supports pending-change review, code snippets review, and file-focused review.