Summary:
Scrapfly launches Crawler API and MCP Server
Why It Matters:
The competitor is expanding its product line from simple scraping tools to more complex automation and AI-ready infrastructure. This makes it easier for their users to build AI agents and large-scale data pipelines.
What Changed:
- Added four new products: Crawler API, MCP Server, Proxy Saver, and Antibot Detector.
- Added a new "Solutions" section targeting specific websites like Amazon, Instagram, and Zillow.
- Added dedicated integrations for AI frameworks including LlamaIndex, LangChain, and CrewAI.
- Added a Golang SDK to their existing library of Python and TypeScript tools.
- Updated the homepage with a "We are hiring" announcement and a more detailed navigation menu.