Templates / Scrape Web Data with Bright Data, Google Gemini and MCP Automated AI Agent

Scrape Web Data with Bright Data, Google Gemini and MCP Automated AI Agent

Needs changes

by Ranjan Dailata ✓ · 4,233 views · created 2025-04-28 · Market Research, AI Summarization

Needs changes. This template uses 2 thing(s) that n8n 3.0 removes: AI Agent v1 (old agent modes), Function (legacy). 2 breaking item(s) found. Static check, last run 2026-10-19.

What this workflow does

This AI workflow has 15 nodes and runs manually, when you click “Execute workflow”. Along the way it connects Google Gemini Chat Model and Mcp (community).

How it runs

Trigger: Manually, when you click “Execute workflow”.

  1. Mcp Client: uses Mcp Client
  2. Set the URL with the Webhook URL and data format (Edit Fields (Set)): sets 3 fields: url, webhook_url, format
  3. Set the URLs (Edit Fields (Set)): sets 2 fields: url, webhook_url
  4. AI Agent: runs an AI agent, with model: Google Gemini Chat Model; 3 tools (MCP Client List all tools, MCP Client to Scrape as HTML, MCP Client to Scrape as Markdown); memory: Simple Memory
  5. Mcp Client: execute tool
  6. Webhook for Web Scraper AI Agent (HTTP Request): calls an HTTP API
  7. Create a binary data (Function): runs custom JavaScript (legacy Function node)
  8. Webhook for web scraper (HTTP Request): calls an HTTP API
  9. Write the scraped content to disk (Read/Write Files from Disk): writes a file to disk

Services it uses

Google Gemini Chat ModelMcp (community)

Before you upgrade to n8n 3.0

2 things in this workflow are removed in n8n 3.0. Fix them before you upgrade:

  • AI Agent v1 (old agent modes) in AI Agent (v1.8): replace with Latest AI Agent node (Tools Agent). For SQL Agent, use a Postgres or MySQL tool with a recent AI Agent.
  • Function (legacy) in Create a binary data: replace with Code node, mode 'Run Once for All Items'.

Rather not rewrite it? Many of these flows can be rebuilt in Make (free plan).

Removed in 3.0Replace with
AI Agent v1 (old agent modes)
AI Agent (v1.8)
Latest AI Agent node (Tools Agent). For SQL Agent, use a Postgres or MySQL tool with a recent AI Agent.
Function (legacy)
Create a binary data
Code node, mode 'Run Once for All Items'

Nodes used (10)

From the author

Disclaimer This template is only available on n8n self-hosted as it's making use of the community node for MCP Client. Who this is for? The Scrape Web Data with Bright Data and MCP Automated AI Agent workflow is built for professionals who need to automate…

Excerpt from Ranjan Dailata's description on n8n.io.

View the original on n8n.io → Check your own copy

Get the weekly “what broke” email

New templates, newly broken ones, and n8n release changes. One short email a week.

Form not loading? Subscribe here.