robots-txt-checker 是做什么的?
一个用于通过 tamethebots MCP 实时检查 robots.txt 与相关爬虫(Google、Bing、AI 爬虫、SEO 工具、爬虫程序)兼容性的 Claude 技能。
一个用于通过 tamethebots MCP 实时检查 robots.txt 与相关爬虫(Google、Bing、AI 爬虫、SEO 工具、爬虫程序)兼容性的 Claude 技能。
这个技能允许 Claude 用户实时验证其网站的 robots.txt 文件是否与各种网络爬虫(包括 Google、Bing、AI 训练爬虫、SEO 工具和通用爬虫程序)正确交互。它通过 tamethebots MCP 协议进行操作,让开发者无需手动测试即可快速诊断爬虫访问问题。该技能支持在 Claude Code、Cursor 和 Codex 等平台上使用,利用 MCP 集成实现机器人模拟和规则解析。对于维护 SEO 健康、确保 AI 爬虫合规性以及防止意外阻止重要爬虫的开发者来说,它特别有用。在检查过程中,该技能获取指定的 robots.txt URL,针对预定义的机器人列表解析其规则,并呈现每个机器人的访问状态结果。
npx skills add tmnh83/robots-txt-checkerInstalled? Explore more 研究与数据分析 skills: affaan-m/uspto-database, affaan-m/scholar-evaluation, affaan-m/literature-review · View all 6 →
一个用于通过 tamethebots MCP 实时检查 robots.txt 与相关爬虫(Google、Bing、AI 爬虫、SEO 工具、爬虫程序)兼容性的 Claude 技能。
USPTO patent and trademark data workflow for official record lookup, PatentSearch queries, TSDR checks, assignment data, and reproducible IP research logs.
Structured scholarly-work evaluation for papers, proposals, literature reviews, methods sections, evidence quality, citation support, and research-writing feedback.
Systematic literature-review workflow for academic, biomedical, technical, and scientific topics, including search planning, source screening, synthesis, citation checks, and evidence logging.
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
Agent skill repository discovered by 10x-chat research.
Review backend code for quality, security, maintainability, and best practices based on established checklist rules. Use when the user requests a review, analysis, or improvement of backend files (e.g., `.py`) under the `api/` directory. Do NOT use for frontend files (e.g., `.tsx`, `.ts`, `.js`). Supports pending-change review, code snippets review, and file-focused review.