웹 크롤러은(는) 무엇을 하나요?
웹 스크래핑 및 소셜 데이터: YouTube, TikTok, Instagram, LinkedIn, Reddit, Threads. 일반 fetch로는 차단되는 JS 기반 페이지(예: YouTube 트랜스크립트 다운로드, TikTok 댓글 스크래핑)에서 공개 게시물, 트랜스크립트를 추출할 때 사용합니다.
웹 스크래핑 및 YouTube, TikTok, Instagram, LinkedIn, Reddit, Threads 등 소셜 데이터 추출. 일반 fetch로는 차단되는 JS 기반 페이지(예: YouTube 트랜스크립트 다운로드, TikTok 댓글 스크래핑)에서 공개 게시물, 트랜스크립트를 추출할 때 사용합니다.
이 스킬은 웹 스크래핑과 소셜 미디어 데이터 수집을 결합한 강력한 도구입니다. 일반 HTTP 요청으로는 접근이 어려운 JavaScript 기반 동적 페이지에서도 공개된 게시물, 댓글, 트랜스크립트 등의 데이터를 추출할 수 있습니다. 특히 YouTube 트랜스크립트 다운로드, TikTok 댓글 스크래핑, Instagram 게시물, LinkedIn 프로필, Reddit 커뮤니티 데이터, Threads 대화 등 다양한 소셜 플랫폼을 지원합니다. 주로 AI 에이전트(Claude Code 등) 환경에서 사용되며, plain fetch가 차단되는 페이지를 처리해야 할 때 유용합니다. 사용자는 이 스킬을 통해 손쉽게 공개 소셜 데이터를 수집하고 분석하여 더 풍부한 AI 응답을 생성할 수 있습니다.
npx skills add https://github.com/starchild-ai-agent/official-skills/tree/main/skills/web-crawlerInstalled? Explore more 연구 & 데이터 분석 skills: affaan-m/uspto-database, affaan-m/scholar-evaluation, affaan-m/literature-review · View all 6 →
웹 스크래핑 및 소셜 데이터: YouTube, TikTok, Instagram, LinkedIn, Reddit, Threads. 일반 fetch로는 차단되는 JS 기반 페이지(예: YouTube 트랜스크립트 다운로드, TikTok 댓글 스크래핑)에서 공개 게시물, 트랜스크립트를 추출할 때 사용합니다.
This repo contains 20 individual skills — each has its own dedicated page.
Preview panel and iframe diagnostics: registry, ports, paths, blank screens. Use when a preview tab is broken or missing (e.g. white screen, tab disappeared, 404 on assets, preview not loading, list running services).
Register a custom LLM endpoint with your own API key for chat in Starchild. Use when adding a personal Anthropic, OpenAI, Grok, Qwen, DeepSeek, NEAR AI, or Venice key as a chat model (e.g. add my Claude key, register DeepSeek).
Interactive web charts: line, bar, candle, scatter, with HTML and screenshot output. Use when visualizing data for analysis or BI (e.g. plot BTC vs gold last year, bar chart of revenue by quarter, compare two return series).
Generate TradingView-style candlestick charts with indicators. Use when the user wants a visual chart, price visualization, or technical analysis plot.
Connect a ChatGPT or Codex subscription via OAuth device-code login. Use when the user wants to sign in with their ChatGPT Plus, Pro, or Team account (e.g. "use my Codex subscription", "log in with ChatGPT").
Code specialist for writing, debugging, and technical implementation. Use when the user needs code written, bugs fixed, files edited, or features built.
Crypto spot prices, OHLC charts, market discovery, and global stats. Use when looking up coin prices, market caps, trending coins, sector rankings, or comparing tokens (e.g. BTC price, ETH chart, top gainers).
Crypto derivatives data: funding rates, open interest, liquidations, long/short ratios. Use when researching perp markets, tracking Hyperliquid whale positions, or comparing ETF flows (e.g. BTC funding, ETH OI, liquidation heatmap).
Share or open-source any project the user has built — a running preview/service, a project directory, a dashboard, or scripts. Use whenever the user wants to publish, share, make public, list, distribute, deploy publicly, or open-source something. Three independent actions — publish_preview (allocate a public URL for a running service), list_in_dashboard (show it on the public Project Dashboard for discovery), open_source (push project source to the community GitHub repo). Do NOT search the filesystem for publish-related code or write custom deploy/upload scripts — this skill is the single entry point.
Composio gateway: act on 1000+ connected apps like Gmail, Slack, GitHub, Calendar. Use when the user wants to act in a connected SaaS app (e.g. send Gmail, create Notion page, add Calendar event, open a GitHub issue).
Trade perp futures, spot, and RWA on Hyperliquid DEX with up to asset max leverage. Use when placing perp or spot orders, setting TP/SL, or moving funds on Hyperliquid (e.g. long BTC 5x, sell ETH, deposit USDC, set stop).
Agent onboarding for Orderly Network - omnichain perpetual futures infrastructure, MCP server, skills, and developer quickstart
Frontend & fullstack development with live preview. Use when the user wants to build a web page, frontend app, fullstack project, or any web UI — including React, Vue, Vite, static HTML, Express, FastAPI, or any framework that produces a browser-viewable result. Also use when the user wants to deploy, publish, or share a preview to the public internet (community publish).
End-to-end project engineering: design, incremental build, verify, debug systematically. Use when building software, dashboards, scheduled jobs, or web apps the user has asked for (e.g. build a price monitor, daily summary task, ship an API).
Scaffold new skills with valid frontmatter, directory layout, and a starter SKILL.md. Use when building a new reusable workflow or wrapping a new API (e.g. create a kalshi skill, scaffold an API helper, start a charting skill).
Search, install, and publish skills across official, community, and global registries. Use when finding or sharing skills (e.g. install a "funding rate" skill, list installed skills, publish my custom skill to the registry).
Build 16:9 slide decks as HTML, exported to PDF (not PowerPoint format). Use when making a deck, presentation, or pitch (e.g. 10-slide pitch deck for X, training course on Y, quarterly results presentation).
Telegram bot binding: create the bot, connect to Starchild, verify, troubleshoot. Use when setting up Telegram delivery (e.g. add my TG bot, bot binding code, fix "telegram not pushing", whitelist a TG username).
Stocks, forex, and commodities prices: real-time quotes and historical bars. Use when looking up traditional-market prices (e.g. AAPL quote, EUR/USD chart, gold price, SPY history). Not for crypto.
Twitter/X data: fetch tweets, search, user profiles, followers, replies, trends. Use for any x.com or twitter.com URL or lookup (e.g. summarize this tweet, recent posts by @vitalikbuterin, search $SOL min_faves:50).
USPTO patent and trademark data workflow for official record lookup, PatentSearch queries, TSDR checks, assignment data, and reproducible IP research logs.
Structured scholarly-work evaluation for papers, proposals, literature reviews, methods sections, evidence quality, citation support, and research-writing feedback.
Systematic literature-review workflow for academic, biomedical, technical, and scientific topics, including search planning, source screening, synthesis, citation checks, and evidence logging.
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
Agent skill repository discovered by 10x-chat research.
Review backend code for quality, security, maintainability, and best practices based on established checklist rules. Use when the user requests a review, analysis, or improvement of backend files (e.g., `.py`) under the `api/` directory. Do NOT use for frontend files (e.g., `.tsx`, `.ts`, `.js`). Supports pending-change review, code snippets review, and file-focused review.