Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.langchain.com/llms.txt

Use this file to discover all available pages before exploring further.

ScraperAPI enables data collection from any public website with its web scraping API, without worrying about proxies, browsers, or CAPTCHA handling. langchain-scraperapi wraps this service, making it easy for AI agents to browse the web and scrape data from it.

​
Installation and setup

pip install langchain-scraperapi
Get an API key from ScraperAPI and set it as an environment variable: 
import os

os.environ["SCRAPERAPI_API_KEY"] = "your-api-key"

​
Tools

The package offers 3 tools to scrape any website, get structured Google search results, and get structured Amazon search results respectively. See detailed documentation for each tool:
  • ScraperAPITool - Browse and scrape any website
  • ScraperAPIGoogleSearchTool - Get structured Google Search SERP data
  • ScraperAPIAmazonSearchTool - Get structured Amazon product search data
For a more detailed walkthrough, see the official repository.
Connect these docs to Claude, VSCode, and more via MCP for real-time answers.
Edit this page on GitHub or file an issue.