CommunityResearch & Data Analysisgithub.com

shirenchuang/web-content-fetcher

Extract article content from any URL as clean Markdown. Uses Scrapling script as primary method (with auto fast→stealth fallback), Jina Reader as alternative for simple pages. Preserves headings, links, images, lists, and code blocks.

What is web-content-fetcher?

The shirenchuang/web-content-fetcher skill extracts readable article content from any URL and returns it as clean Markdown. It prioritizes a Scrapling-based script for robust extraction, automatically falling back from fast to stealth modes if needed, and offers Jina Reader as a lightweight alternative for simpler pages. The skill preserves the original structure including headings, links, images, lists, and code blocks, making it ideal for AI agents tasked with fetching, reading, summarizing, or scraping web content such as blog posts, news articles, WeChat articles (微信公众号), documentation, or general web pages. It triggers on user requests like 'fetch this URL', 'extract the main content', '帮我读一下这篇文章', or 'read this page for me', ensuring versatile support across platforms like Claude Code, Cursor, and Codex.

Works with~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/shirenchuang/web-content-fetcher/tree/main/skills/web-content-fetcher

Installed? Explore more Research & Data Analysis skills: affaan-m/uspto-database, affaan-m/scholar-evaluation, affaan-m/literature-review · View all 6 →

View original→Browse all skills

Ask in your favorite AI

Open a new chat with this agent skill pre-loaded.

OpenAIChatGPTClaudeClaudeGeminiGeminiGrokGrokPerplexityPerplexityDeepSeekDeepSeek

Documentation

What does web-content-fetcher do?

Extract article content from any URL as clean Markdown. Uses Scrapling script as primary method (with auto fast→stealth fallback), Jina Reader as alternative for simple pages. Preserves headings, links, images, lists, and code blocks. Use this skill whenever the user wants to fetch, read, extract, scrape, or summarize content from a URL — including blog posts, news articles, WeChat articles (微信公众号), documentation pages, or any web page. Also trigger when the user says things like "帮我读一下这篇文章", "抓取这个网页", "提取正文", or "read this page for me".

Related Skills

affaan-m/uspto-database

USPTO patent and trademark data workflow for official record lookup, PatentSearch queries, TSDR checks, assignment data, and reproducible IP research logs.

community

affaan-m/scholar-evaluation

Structured scholarly-work evaluation for papers, proposals, literature reviews, methods sections, evidence quality, citation support, and research-writing feedback.

community

affaan-m/literature-review

Systematic literature-review workflow for academic, biomedical, technical, and scientific topics, including search planning, source screening, synthesis, citation checks, and evidence logging.

community

affaan-m/everything-claude-code

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

community

forrestchang/andrej-karpathy-skills

Agent skill repository discovered by 10x-chat research.

community

langgenius/backend-code-review

Review backend code for quality, security, maintainability, and best practices based on established checklist rules. Use when the user requests a review, analysis, or improvement of backend files (e.g., `.py`) under the `api/` directory. Do NOT use for frontend files (e.g., `.tsx`, `.ts`, `.js`). Supports pending-change review, code snippets review, and file-focused review.

community
← More Research & Data Analysis skills