Templates / Local chatbot with retrieval augmented generation (RAG)

Local chatbot with retrieval augmented generation (RAG)

Ready for 3.0

by Thomas Janssen ✓ · 140,168 views · created 2025-06-23 · Internal Wiki, AI RAG

Ready for 3.0. This template uses no nodes that n8n 3.0 removes. No removed nodes, versions or helpers found. Static check, last run 2026-10-19.

Nodes used (9)

Qdrant Vector StoreEmbeddings OllamaDefault Data LoaderRecursive Character Text SplitterAI AgentOllama Chat ModelSimple Memory

What it does

Build a 100% local RAG with n8n, Ollama and Qdrant. This agent uses a semantic database (Qdrant) to answer questions about PDF files. Tutorial !thumbnail.png(fileId:1589) Click here to view the YouTube Tutorial How it works Build a chatbot that answers based on documents you provide it (Retrieval Augmented Generation). You can upload as many PDF files as you want to the Qdrant database. The chatbot will use its retrieval tool to fetch the chunks and use them to answer questions. Installation 1. Install n8n + Ollama + Qdrant using the Self-hosted AI starter kit 2. Make sure to install Llama 3.2 and mxbai-embed-large as embeddings model. How to use it 1. First run the "Data Ingestion" part and upload as many PDF files as you want 2. Run the Chatbot and start asking questions about the documents you uploaded

View the original on n8n.io → Check your own copy

Get the weekly “what broke” email

New templates, newly broken ones, and n8n release changes. One short email a week.

Form not loading? Subscribe here.