CommunityCoding & Developmentgithub.com

web-extractor

Extracts specific information (e.g., text, dates, lists) from a single webpage provided by the user via a URL. Does not handle queries without a URL (use multi-source-extractor) or GitHub repository interpretation (use github-repo-explainer).

What is web-extractor?

This skill, named web-extractor, is designed for AI agents to precisely extract targeted information from a single user-provided URL. It is ideal for tasks such as pulling specific paragraphs, lists, numbers, dates, or names from a webpage. The skill follows a structured four-step process: first, it verifies that the current environment has a web fetching tool (like web_fetch); second, it fetches the page content; third, it extracts the requested information according to strict guidelines (e.g., quoting original text for paragraphs, listing items in original order, providing context for dates and numbers); and finally, it formats the output clearly. It explicitly excludes summarizing entire pages, handling queries without a URL, or interpreting GitHub repositories, ensuring it is only used in its specific scope.

Works with~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/dji-sq/DSH-skill/tree/HEAD/web-extractor

Installed? Explore more Coding & Development skills: steipete/bluebubbles, steipete/eightctl, steipete/blucli · View all 6 →

Ask in your favorite AI

Open a new chat with this agent skill pre-loaded.

Documentation

Web Information Extraction Flow

When the user provides a URL and the type of information they want, follow these steps.

Step 1: Confirm Fetching Capability

First, check if the current session has a web fetching tool available (e.g., web_fetch). If not, directly tell the user "The current environment does not have web fetching capabilities enabled" and stop the flow. Do not pretend to have fetched content.

Step 2: Fetch the Page

Call the available fetching tool to obtain the body content of the URL. If fetching fails (timeout, 403, empty content), report the failure reason truthfully and do not fabricate content.

Step 3: Extract Information

Based on the type of information specified by the user, extract the relevant content from the body.

  • If the user wants "a specific paragraph", directly quote the original text without rewriting.
  • If the user wants a "list/items", list them one by one, preserving the original order.
  • If the user wants "numbers/dates/names", output only the found values, and annotate each with its context in the original text (one sentence before and after).
  • "Dates" refer to visible date text on the page, including format such as YYYY-MM-DD, YYYY/MM/DD, Chinese year-month-day, English month names, etc. Do not extract copyright years in footers or dates from HTML metadata.

Step 4: Output Format

Output in the following format:

Fetch Status: Success / Failure (with reason) Page Title: [Fill in if fetched, write "Unknown" if not] Extraction Results:

  • [Organized according to the information type requested by the user]

Boundaries

  • Do not summarize the full page; only extract the information the user wants.
  • If the page content is clearly a login page or an error page, include an explanatory note in "Extraction Results" and do not fabricate content.

Individual skills in this repo

This repo contains 2 individual skills — each has its own dedicated page.

Related Skills