Scrapling adds web scraping tools for AI agents
Scrapling is a Python web-scraping framework that combines HTTP requests, stealth browsers, parsing and concurrent crawling in one library. Its project documentation says it can render JavaScript, interact with websites and capture API calls, with features including spiders, proxy rotation, a CLI, an MCP server and an Agent Skill for AI agents. These capability and performance descriptions come from the project and have not been independently verified.
The documented MCP server and Agent Skill give AI-agent developers a concrete option for combining web browsing, interaction and data extraction with agent tooling.
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
https://scrapling.readthedocs.io/en/latest/
Effortless Web Scraping for the Modern Web
Selection methods · Fetchers · Spiders · Proxy Rotation · CLI · MCP