Scrape and ingest web pages into a Pinecone RAG stack with Firecrawl and OpenAI
UnknownWhat this workflow does
This AI workflow has 15 nodes and runs when an HTTP POST request hits its webhook URL (plus 1 other trigger). Along the way it connects Pinecone Vector Store, Embeddings OpenAI, OpenRouter Chat Model and Reranker Cohere and 1 more.
How it runs
Trigger: When an HTTP POST request hits its webhook URL (plus 1 other trigger).
- Validate and normalize URL (Code): runs custom JavaScript code
- Answer query from knowledge base (AI Agent): runs an AI agent, with model: OpenRouter LLM; 1 tool (Retrieve documents from Pinecone); memory: Chat memory
- Scrape page with Firecrawl (Firecrawl): scrape
- Return URL validation error (Respond to Webhook): sends the response back to the webhook caller
- Store embeddings in Pinecone (Pinecone Vector Store): stores documents in the Pinecone vector store, with embeddings: Generate OpenAI embeddings; document loader: Load scraped content
- Return ingestion result (Respond to Webhook): sends the response back to the webhook caller
Services it uses
Uses Firecrawl. New users get 10% off with our link.
Before you upgrade to n8n 3.0
We can't fully verify this one: it relies on 1 community package, and n8n 3.0 turns unverified community packages off by default (N8N_UNVERIFIED_PACKAGES_ENABLED=false).
- Check that @mendable/n8n-nodes-firecrawl is verified or supports 3.0 (used in Scrape page with Firecrawl).
Nodes used (12)
- Webhook
n8n-nodes-base.webhook - Code
n8n-nodes-base.code - Firecrawl
@mendable/n8n-nodes-firecrawl.firecrawl - Respond to Webhook
n8n-nodes-base.respondToWebhook - Pinecone Vector Store
@n8n/n8n-nodes-langchain.vectorStorePinecone - Embeddings OpenAI
@n8n/n8n-nodes-langchain.embeddingsOpenAi - Default Data Loader
@n8n/n8n-nodes-langchain.documentDefaultDataLoader - Chat Trigger
@n8n/n8n-nodes-langchain.chatTrigger - AI Agent
@n8n/n8n-nodes-langchain.agent - OpenRouter Chat Model
@n8n/n8n-nodes-langchain.lmChatOpenRouter - Simple Memory
@n8n/n8n-nodes-langchain.memoryBufferWindow - Reranker Cohere
@n8n/n8n-nodes-langchain.rerankerCohere
From the author
What this does Receives a URL via webhook, uses Firecrawl to scrape the page into clean markdown, and stores it as vector embeddings in Pinecone. A visual, self-hosted ingestion pipeline for RAG knowledge bases. Adding a new source is as simple as sending a…