Evaluation metric example: Check if tool was called
Needs changesWhat this workflow does
This AI workflow has 11 nodes and runs when a chat message arrives (plus 1 other trigger). Along the way it connects OpenAI Chat Model, HTTP Request and Evaluation.
How it runs
Trigger: When a chat message arrives (plus 1 other trigger).
- AI Agent: runs an AI agent, with model: OpenAI Chat Model; 2 tools (Calculator, Fetch a webpage)
- Match chat format (Edit Fields (Set)): sets 1 field: chatInput
- Evaluating? (Evaluation): check if evaluating
- Check if tool called (Edit Fields (Set)): sets 1 field: tool_called
- Evaluation: set metrics
Services it uses
Before you upgrade to n8n 3.0
1 thing in this workflow is removed in n8n 3.0. Fix it before you upgrade:
- AI Agent v1 (old agent modes) in AI Agent (v1.9): replace with Latest AI Agent node (Tools Agent). For SQL Agent, use a Postgres or MySQL tool with a recent AI Agent.
Rather not rewrite it? Many of these flows can be rebuilt in Make (free plan).
| Removed in 3.0 | Replace with |
|---|---|
| AI Agent v1 (old agent modes) AI Agent (v1.9) | Latest AI Agent node (Tools Agent). For SQL Agent, use a Postgres or MySQL tool with a recent AI Agent. |
Nodes used (9)
- AI Agent
@n8n/n8n-nodes-langchain.agent - OpenAI Chat Model
@n8n/n8n-nodes-langchain.lmChatOpenAi - Calculator
@n8n/n8n-nodes-langchain.toolCalculator - Edit Fields (Set)
n8n-nodes-base.set - Http Request Tool
n8n-nodes-base.httpRequestTool - Chat Trigger
@n8n/n8n-nodes-langchain.chatTrigger - No Operation, do nothing
n8n-nodes-base.noOp - Evaluation Trigger
n8n-nodes-base.evaluationTrigger - Evaluation
n8n-nodes-base.evaluation
From the author
AI evaluation in n8n This is a template for n8n's evaluation feature. Evaluation is a technique for getting confidence that your AI workflow performs reliably, by running a test dataset containing different inputs through the workflow. By calculating a metric…