scrapy-web-scraping은(는) 무엇을 하나요?
Scrapy Python 프레임워크를 사용한 웹 스크래퍼 및 크롤러 구축을 위한 전문 가이드로, 스파이더 개발, 데이터 추출 및 파이프라인 관리에 대한 모범 사례를 제공합니다.
Scrapy Python 프레임워크를 사용한 웹 스크래퍼 및 크롤러 구축을 위한 전문 가이드로, 스파이더 개발, 데이터 추출 및 파이프라인 관리에 대한 모범 사례를 제공합니다.
이 스킬은 Scrapy Python 프레임워크를 활용해 웹 스크래핑 및 크롤링 애플리케이션을 구축하는 개발자를 위한 전문 가이드입니다. 사용자는 스파이더 개발, 데이터 추출, 아이템 파이프라인 관리, 미들웨어 설정 등 Scrapy의 핵심 개념을 학습할 수 있습니다. 웹사이트에서 구조화된 데이터를 효율적으로 수집하고, 요청 처리, 응답 파싱, 데이터 저장을 위한 모범 사례를 제공합니다. 이 스킬은 CLI 도구, 에이전트 프레임워크와 상호작용하는 AI 어시스턴트(예: Claude Code, Cursor, Codex)와 함께 사용하도록 설계되었습니다. Scrapy 프로젝트 초기화, 스파이더 작성, XPath/CSS 선택자 사용, 내보내기 형식(JSON, CSV, XML) 설정, 설정 커스터마이징, 로그 및 오류 처리를 다루며, 실시간 웹 데이터가 필요한 AI 기반 워크플로우에 적합합니다.
npx skills add https://github.com/mindrally/skills/tree/main/skills/scrapy-web-scrapingInstalled? Explore more 연구 & 데이터 분석 skills: affaan-m/uspto-database, affaan-m/scholar-evaluation, affaan-m/literature-review · View all 6 →
Scrapy Python 프레임워크를 사용한 웹 스크래퍼 및 크롤러 구축을 위한 전문 가이드로, 스파이더 개발, 데이터 추출 및 파이프라인 관리에 대한 모범 사례를 제공합니다.
This repo contains 20 individual skills — each has its own dedicated page.
Implement web accessibility (a11y) best practices following WCAG guidelines to create inclusive, accessible user interfaces.
Expert guidelines for Chrome extension development with Manifest V3, covering security, performance, and best practices. Use when building browser extensions, creating popup UIs, implementing content scripts, working with Chrome APIs, managing extension permissions, or publishing to Chrome Web Store.
Expert guidance for computer vision development using OpenCV, PyTorch, and modern deep learning techniques for image and video processing.
Expert guidance for data analysis, visualization, and Jupyter Notebook development with pandas, matplotlib, seaborn, and numpy.
Expert guidance for deep learning, transformers, diffusion models, and LLM development with PyTorch, Transformers, Diffusers, and Gradio.
Expert in Expo React Native TypeScript mobile development with best practices
Expert in FastAPI Python development with best practices for APIs and async operations
Expert guidelines for building performant animations with Framer Motion/Motion library in React applications
HTMX development guidelines for building dynamic web applications with minimal JavaScript using HTML attributes.
Guidelines for implementing JWT authentication with security best practices for token creation, validation, and storage
Machine learning development with JAX, functional programming patterns, and high-performance computing.
MySQL development best practices for schema design, query optimization, and database administration
Expert in TypeScript, Node.js, Next.js App Router, React, Shadcn UI, Radix UI and Tailwind
Full-stack Next.js 14 development with TypeScript, TailwindCSS, and Supabase for building production-ready web applications.
Expert guidance for Odoo ERP development including Python ORM, XML views, and module architecture
Expert guidance for browser automation using Puppeteer with best practices for web scraping, testing, screenshot capture, and JavaScript execution in headless Chrome.
Redis development best practices for caching, data structures, and high-performance key-value operations
SCSS/Sassy CSS best practices and coding guidelines for maintainable, scalable stylesheets
Guidelines for developing with TypeORM, a full-featured ORM for TypeScript and JavaScript supporting multiple databases
Expert in web scraping and data extraction with Python tools
USPTO patent and trademark data workflow for official record lookup, PatentSearch queries, TSDR checks, assignment data, and reproducible IP research logs.
Structured scholarly-work evaluation for papers, proposals, literature reviews, methods sections, evidence quality, citation support, and research-writing feedback.
Systematic literature-review workflow for academic, biomedical, technical, and scientific topics, including search planning, source screening, synthesis, citation checks, and evidence logging.
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
Agent skill repository discovered by 10x-chat research.
Review backend code for quality, security, maintainability, and best practices based on established checklist rules. Use when the user requests a review, analysis, or improvement of backend files (e.g., `.py`) under the `api/` directory. Do NOT use for frontend files (e.g., `.tsx`, `.ts`, `.js`). Supports pending-change review, code snippets review, and file-focused review.