AI Skills for Web Scraping
Web scraping is essential for data collection, market research, and competitor monitoring. These AI skills write scrapers for static and JavaScript-heavy sites, handle pagination and rate limiting, parse complex HTML structures, and output clean structured data.
13 skills found
Webapp Testing
Test local web applications using Playwright for UI verification and debugging
Dev Browser
A Claude Skill to give your agent the ability to use a web browser
Playwright Skill
Browser automation and testing using Playwright for web application testing
DevDocs
Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code, Claude Desktop App
ClaudeKit Skills
Browser automation, screenshots, web scraping, performance monitoring, and form automation
Playwright Bot Bypass
Claude Code skill to bypass bot detection (Google CAPTCHA, etc.)
Web Scraper
Intelligent web scraping Claude Code skill with automatic strategy selection and TypeScript-first Apify Actor development
Crawl4AI Web Scraping
Web scraping with JavaScript support, CSS/LLM extraction, and automated data pipelines
EdgeKnowledge Skill
AI-powered edge knowledge mining from underground forums. Deep crawls Reddit, BlackHatWorld, GreyHatMafia with browser automation, visual analysis, and structured reporting.
Skill Evolve
演进式 Skill 改进 — A Claude Code Skill that improves other skills through observation, pattern extraction, and iterative refinement. Based on OTF + JIT + Bootstrap methodology.
Get Y2b Clips
YouTube nuggets extraction via Claude Code Skill
Rhetorical Analysis Skill
Claude Skill d'analyse rhétorique méthodique d'une source
Parseium Skill
Agent skill for extracting data from social media via Parseium APIs
Browse by Category
Frequently Asked Questions
Can these skills scrape JavaScript-rendered pages?
Yes. Many scraping skills use Playwright or Puppeteer under the hood to render JavaScript and interact with dynamic pages, including sites that require login or CAPTCHA solving.
How do scraping skills handle anti-bot measures?
Skills vary in their anti-bot capabilities. Basic skills handle rate limiting and rotating user agents. More advanced skills support proxy rotation, browser fingerprint evasion, and retry logic.