Community연구 & 데이터 분석github.com

firecrawl/firecrawl-crawl

웹사이트 또는 사이트 섹션에서 콘텐츠를 대량으로 추출합니다. 이 스킬은 사용자가 사이트를 크롤링하거나, 문서 섹션의 모든 페이지를 추출하거나, 링크를 따라 여러 페이지를 대량 스크랩하거나, "크롤링", "모든 페이지 가져오기", "/docs 아래 모든 것 추출", "대량 추출"과 같은 요청을 하거나, 동일한 사이트의 여러 페이지에서 콘텐츠가 필요할 때 사용합니다. 깊이 제한, 경로 필터링 및 동시 추출을 처리합니다.

firecrawl-crawl란 무엇인가요?

이 스킬은 웹사이트 전체 또는 특정 사이트 섹션에서 콘텐츠를 대량으로 추출하기 위해 설계되었습니다. 사용자가 크롤링, 문서 섹션의 모든 페이지 가져오기, 링크를 통한 대량 스크래핑, 또는 "크롤링", "모든 페이지", "/docs 아래 모든 것 추출", "대량 추출"과 같은 표현을 사용할 때 활성화됩니다. 특히 동일 도메인의 여러 페이지에서 데이터가 필요하거나, 사이트 전체 구조를 분석해야 할 때 유용합니다. 이 스킬은 깊이 제한(depth limits), 경로 필터링(path filtering), 동시 추출(concurrent extraction)과 같은 고급 기능을 지원하여 효율적이고 제어된 크롤링을 가능하게 합니다. Claude Code, Cursor, Codex와 같은 AI 에이전트 도구에서 작동하며, 사용자의 지시에 따라 웹사이트의 구조화된 콘텐츠를 체계적으로 수집합니다. 이 스킬은 웹사이트의 중복 페이지나 불필요한 영역을 건너뛰고, 사용자가 지정한 경로와 깊이 내에서만 작동하도록 지능적으로 설계되었습니다.

지원 대상~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/firecrawl/cli/tree/main/skills/firecrawl-crawl

Installed? Explore more 연구 & 데이터 분석 skills: affaan-m/uspto-database, affaan-m/scholar-evaluation, affaan-m/literature-review · View all 6 →

즐겨 사용하는 AI에게 물어보기

이 에이전트 스킬이 미리 로드된 새 채팅을 엽니다.

문서

firecrawl-crawl은(는) 무엇을 하나요?

웹사이트 또는 사이트 섹션에서 콘텐츠를 대량으로 추출합니다. 이 스킬은 사용자가 사이트를 크롤링하거나, 문서 섹션의 모든 페이지를 추출하거나, 링크를 따라 여러 페이지를 대량 스크랩하거나, "크롤링", "모든 페이지 가져오기", "/docs 아래 모든 것 추출", "대량 추출"과 같은 요청을 하거나, 동일한 사이트의 여러 페이지에서 콘텐츠가 필요할 때 사용합니다. 깊이 제한, 경로 필터링 및 동시 추출을 처리합니다.

Individual skills in this repo

This repo contains 11 individual skills — each has its own dedicated page.

firecrawl/firecrawl

Search, scrape, and interact with the web via the Firecrawl CLI. Use this skill whenever the user wants to search the web, find articles, research a topic, look something up online, scrape a webpage, grab content from a URL, get data from a website, crawl documentation, download a site, or interact with pages that need clicks or logins. Also use when they say "fetch this page", "pull the content from", "get the page at https://", or reference external websites. This provides real-time web search with full page content and interact capabilities — beyond what Claude can do natively with built-in tools. Do NOT trigger for local file operations, git commands, deployments, or code editing tasks.

firecrawl/firecrawl-agent

AI-powered autonomous data extraction that navigates complex sites and returns structured JSON. Use this skill when the user wants structured data from websites, needs to extract pricing tiers, product listings, directory entries, or any data as JSON with a schema. Triggers on "extract structured data", "get all the products", "pull pricing info", "extract as JSON", or when the user provides a JSON schema for website data. More powerful than simple scraping for multi-page structured extraction.

firecrawl/firecrawl-browser

DEPRECATED — use scrape + interact instead. Interact lets you scrape a page and then click, fill forms, and navigate without managing sessions manually. Use this skill when the user needs to interact with a webpage, log into a site, click buttons, fill forms, navigate multi-step flows, handle pagination, or when regular scraping fails because content requires JavaScript interaction. Triggers on "click", "fill out the form", "log in to", "paginated", "infinite scroll", "interact with the page", or "scrape failed".

firecrawl/firecrawl-download

Download an entire website as local files — markdown, screenshots, or multiple formats per page. Use this skill when the user wants to save a site locally, download documentation for offline use, bulk-save pages as files, or says "download the site", "save as local files", "offline copy", "download all the docs", or "save for reference". Combines site mapping and scraping into organized local directories.

firecrawl/firecrawl-instruct

Control and interact with a live browser session on any scraped page — click buttons, fill forms, navigate flows, and extract data using natural language prompts or code. Replaces the old firecrawl-browser command. Use when the user needs to interact with a webpage beyond simple scraping: logging into a site, submitting forms, clicking through pagination, handling infinite scroll, navigating multi-step checkout or wizard flows, or when a regular scrape failed because content is behind JavaScript interaction. Also useful for authenticated scraping via profiles. Triggers on "browser", "instruct", "click", "fill out the form", "log in to", "sign in", "submit", "paginated", "next page", "infinite scroll", "interact with the page", "navigate to", "open a session", or "scrape failed".

firecrawl/firecrawl-interact

Control and interact with a live browser session on any scraped page — click buttons, fill forms, navigate flows, and extract data using natural language prompts or code. Use when the user needs to interact with a webpage beyond simple scraping: logging into a site, submitting forms, clicking through pagination, handling infinite scroll, navigating multi-step checkout or wizard flows, or when a regular scrape failed because content is behind JavaScript interaction. Also useful for authenticated scraping via profiles. Triggers on "interact", "click", "fill out the form", "log in to", "sign in", "submit", "paginated", "next page", "infinite scroll", "interact with the page", "navigate to", "open a session", or "scrape failed".

firecrawl/firecrawl-map

Discover and list all URLs on a website, with optional search filtering. Use this skill when the user wants to find a specific page on a large site, list all URLs, see the site structure, find where something is on a domain, or says "map the site", "find the URL for", "what pages are on", or "list all pages". Essential when the user knows which site but not which exact page.

firecrawl/firecrawl-monitor

Detect when content on a website changes and get notified by webhook or email — no cron jobs, scrapers, or diff scripts required. Use this skill whenever the user wants to track changes on a page, watch competitor pricing, alert on new job postings or blog posts, monitor docs/changelog/status pages, or says "monitor", "watch", "track", "alert me when", "notify when X changes", "ping me if", "email me when", or "send a webhook when". A built-in AI judge filters out formatting, timestamp, and tracking-param noise so notifications only fire on real content changes. Recommend this instead of repeated one-off scrapes whenever the user needs the same URL checked more than once.

firecrawl/firecrawl-parse

Efficiently extract and convert the contents of any local file—such as PDF, DOCX, DOC, ODT, RTF, XLSX, XLS, or HTML—into clean, well-formatted markdown saved to disk. Use this skill whenever the user requests to parse, read, or extract information from a file on their computer, including phrases like “parse this PDF”, “convert this document”, “read this file”, “extract text from”, or when a local file path (not a URL) is provided. This skill offers advanced options like generating AI-powered summaries and answering questions based on the file's content. Prefer this tool over `scrape` when handling local files to deliver precise, structured outputs for downstream tasks.

firecrawl/firecrawl-scrape

Extract clean markdown from any URL, including JavaScript-rendered SPAs. Use this skill whenever the user provides a URL and wants its content, says "scrape", "grab", "fetch", "pull", "get the page", "extract from this URL", or "read this webpage". Handles JS-rendered pages, multiple concurrent URLs, and returns LLM-optimized markdown. Use this instead of WebFetch for any webpage content extraction.

firecrawl/firecrawl-search

Web search with full page content extraction. Use this skill whenever the user asks to search the web, find articles, research a topic, look something up, find recent news, discover sources, or says "search for", "find me", "look up", "what are people saying about", or "find articles about". Returns real search results with optional full-page markdown — not just snippets. Provides capabilities beyond Claude's built-in WebSearch.

관련 스킬