jamditis/web-scraping

Web scraping with anti-bot bypass, content extraction, undocumented APIs and poison pill detection. Use when extracting content from websites, handling paywalls, implementing scraping cascades or processing social media. Covers requests, trafilatura, Playwright with stealth mode, yt-dlp and instaloader patterns.

Compatible con~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/jamditis/claude-skills-journalism/tree/main/skills/web-scraping

Ask in your favorite AI

Open a new chat with this agent skill pre-loaded.

Documentación

jamditis/web-scraping

Web scraping with anti-bot bypass, content extraction, undocumented APIs and poison pill detection. Use when extracting content from websites, handling paywalls, implementing scraping cascades or processing social media. Covers requests, trafilatura, Playwright with stealth mode, yt-dlp and instaloader patterns.

Individual skills in this repo

This repo contains 1 individual skill — each has its own dedicated page.

Skills relacionados

W-Moorer/academic-research-skills-cn

本项目为 Academic Research Skills 的简体中文翻译版本,仅供学习了解之用。如需使用该技能包,建议前往原项目获取最新版本。

community

directive-reticule640/codex-mcp-server

🚀 Connect your IDE or AI assistant to the Codex CLI with this open-source MCP server for efficient automation and robust code analysis.

community

muonuo/Super-ai-agent

基于 Spring Boot 3.5 + Java 21 + Spring AI + Vue 3,实现 AI 情感咨询、深度思考智能体、RAG 知识库检索、多工具调用等核心功能。支持恋爱报告生成、地图服务集成、PDF文档处理等实用场景。架构清晰、文档完善,非常适合作为 AI 应用学习和简历项目,学习门槛低

community

rrpofficial/market-sage

Claude Code Skill for Indian Market Analysis and Portfolio Analyser

community

erhwenkuo/stock_skills

An undervalued stock screening system. Screens for undervalued stocks across 60+ regions using the Yahoo Finance API (yfinance). Runs as Claude Code Skills — just speak in natural language and the right function executes automatically.

community

github/security-review

AI-powered codebase security scanner that reasons about code like a security researcher — tracing data flows, understanding component interactions, and catching vulnerabilities that pattern-matching tools miss. Use this skill when asked to scan code for security vulnerabilities, find bugs, check for SQL injection, XSS, command injection, exposed API keys, hardcoded secrets, insecure dependencies, access control issues, or any request like "is my code secure?", "review for security issues", "audit this codebase", or "check for vulnerabilities". Covers injection flaws, authentication and access control bugs, secrets exposure, weak cryptography, insecure dependencies, and business logic issues across JavaScript, TypeScript, Python, Java, PHP, Go, Ruby, and Rust.

community