Scrape Web Data with Bright Data, Google Gemini and MCP Automated AI Agent
Needs changesWhat this workflow does
This AI workflow has 15 nodes and runs manually, when you click “Execute workflow”. Along the way it connects Google Gemini Chat Model and Mcp (community).
How it runs
Trigger: Manually, when you click “Execute workflow”.
- Mcp Client: uses Mcp Client
- Set the URL with the Webhook URL and data format (Edit Fields (Set)): sets 3 fields: url, webhook_url, format
- Set the URLs (Edit Fields (Set)): sets 2 fields: url, webhook_url
- AI Agent: runs an AI agent, with model: Google Gemini Chat Model; 3 tools (MCP Client List all tools, MCP Client to Scrape as HTML, MCP Client to Scrape as Markdown); memory: Simple Memory
- Mcp Client: execute tool
- Webhook for Web Scraper AI Agent (HTTP Request): calls an HTTP API
- Create a binary data (Function): runs custom JavaScript (legacy Function node)
- Webhook for web scraper (HTTP Request): calls an HTTP API
- Write the scraped content to disk (Read/Write Files from Disk): writes a file to disk
Services it uses
Before you upgrade to n8n 3.0
2 things in this workflow are removed in n8n 3.0. Fix them before you upgrade:
- AI Agent v1 (old agent modes) in AI Agent (v1.8): replace with Latest AI Agent node (Tools Agent). For SQL Agent, use a Postgres or MySQL tool with a recent AI Agent.
- Function (legacy) in Create a binary data: replace with Code node, mode 'Run Once for All Items'.
Rather not rewrite it? Many of these flows can be rebuilt in Make (free plan).
| Removed in 3.0 | Replace with |
|---|---|
| AI Agent v1 (old agent modes) AI Agent (v1.8) | Latest AI Agent node (Tools Agent). For SQL Agent, use a Postgres or MySQL tool with a recent AI Agent. |
| Function (legacy) Create a binary data | Code node, mode 'Run Once for All Items' |
Nodes used (10)
- AI Agent
@n8n/n8n-nodes-langchain.agent - Manual Trigger
n8n-nodes-base.manualTrigger - Mcp Client
n8n-nodes-mcp.mcpClient - Mcp Client Tool
n8n-nodes-mcp.mcpClientTool - HTTP Request
n8n-nodes-base.httpRequest - Edit Fields (Set)
n8n-nodes-base.set - Google Gemini Chat Model
@n8n/n8n-nodes-langchain.lmChatGoogleGemini - Simple Memory
@n8n/n8n-nodes-langchain.memoryBufferWindow - Function
n8n-nodes-base.function - Read/Write Files from Disk
n8n-nodes-base.readWriteFile
From the author
Disclaimer This template is only available on n8n self-hosted as it's making use of the community node for MCP Client. Who this is for? The Scrape Web Data with Bright Data and MCP Automated AI Agent workflow is built for professionals who need to automate…