Evaluation metric: summarization
Ready for 3.0Ready for 3.0. This template uses no nodes that n8n 3.0 removes. No removed nodes, versions or helpers found. Static check, last run 2026-10-19.
What this workflow does
This AI workflow has 14 nodes and runs when an HTTP GET request hits its webhook URL (plus 1 other trigger). Along the way it connects OpenAI Chat Model, Evaluation, Google Gemini Chat Model and Google Drive.
How it runs
Trigger: When an HTTP GET request hits its webhook URL (plus 1 other trigger).
- Get Gdrive URL (Edit Fields (Set)): sets 1 field: input
- Download Transcript (Google Drive): download
- Extract from File: extracts data from a file (text)
- Summarise Agent (Basic LLM Chain): sends a prompt to an LLM, with model: OpenAI Chat Model
- Is Evaluating? (Evaluation): check if evaluating
- Evaluate Summarisation (Basic LLM Chain): sends a prompt to an LLM, with model: LLM; output parser: Output
- Set Outputs (Evaluation): uses Evaluation
- Set Metrics (Evaluation): set metrics
Services it uses
Before you upgrade to n8n 3.0
Nothing in this workflow is removed in n8n 3.0, so it should import and run after the upgrade.
Nodes used (11)
- Evaluation
n8n-nodes-base.evaluation - OpenAI Chat Model
@n8n/n8n-nodes-langchain.lmChatOpenAi - Evaluation Trigger
n8n-nodes-base.evaluationTrigger - No Operation, do nothing
n8n-nodes-base.noOp - Google Gemini Chat Model
@n8n/n8n-nodes-langchain.lmChatGoogleGemini - Structured Output Parser
@n8n/n8n-nodes-langchain.outputParserStructured - Google Drive
n8n-nodes-base.googleDrive - Basic LLM Chain
@n8n/n8n-nodes-langchain.chainLlm - Extract from File
n8n-nodes-base.extractFromFile - Webhook
n8n-nodes-base.webhook - Edit Fields (Set)
n8n-nodes-base.set
From the author
This n8n template demonstrates how to calculate the evaluation metric "Summarization" which in this scenario, measures the LLM's accuracy and faithfulness in producing summaries which are based on an incoming Youtube transcript. The scoring approach is…