Skip to main content
ScraperAPI enables data collection from any public website with its web scraping API, without worrying about proxies, browsers, or CAPTCHA handling. langchain-scraperapi wraps this service, making it easy for AI agents to browse the web and scrape data from it.

​
Installation and setup

pip install langchain-scraperapi
Get an API key from ScraperAPI and set it as an environment variable: 
import os

os.environ["SCRAPERAPI_API_KEY"] = "your-api-key"

​
Tools

The package offers 3 tools to scrape any website, get structured Google search results, and get structured Amazon search results respectively. See detailed documentation for each tool:
  • ScraperAPITool - Browse and scrape any website
  • ScraperAPIGoogleSearchTool - Get structured Google Search SERP data
  • ScraperAPIAmazonSearchTool - Get structured Amazon product search data
For a more detailed walkthrough, see the official repository.
Edit this page on GitHub or file an issue.
Connect these docs to Claude, VSCode, and more via MCP for real-time answers.