Summary
This is the official Scrapling skill from the library's author, and it's built for when websites fight back. It handles Cloudflare Turnstile and other anti-bot systems automatically, no API keys or external solvers needed. You get three escalation levels: basic HTTP requests for simple sites, headless browsing for JavaScript-heavy pages, and stealth mode for protected content. The CLI is surprisingly practical. You can pipe URLs directly to markdown or text files without writing Python, which makes it fast for one-off scrapes. When you need more control, the spider framework handles concurrent crawls with proxy rotation and pause/resume. Requires Python 3.10+ and a bit of setup, but it consolidates what usually takes three different tools.
Install to Claude Code
npx -y skills add d4vinci/scrapling --skill scrapling-official --agent claude-codeInstalls into .claude/skills of the current project.
Keep your Mac awake while Claude Code and 40+ AI agents run. Sleeps when they're idle.
One time payment $9 →
Integrate web data into your AI product. One API to scrape website & brand data.
Get API Key Now →
Agent, run crypto. Access onchain data & trade routes via 1inch.
Install now →
On Capafy, your Skill runs online 24/7 as an agent product, and you get paid every time someone uses it.
Start earning →
Files
SKILL.md
Select a file.
Featured
Keep your Mac awake while Claude Code and 40+ AI agents run. Sleeps when they're idle.
One time payment $9 →Integrate web data into your AI product. One API to scrape website & brand data.
Get API Key Now →Agent, run crypto. Access onchain data & trade routes via 1inch.
Install now →On Capafy, your Skill runs online 24/7 as an agent product, and you get paid every time someone uses it.
Start earning →
