Templates / Simple eval for legal benchmarking

Simple eval for legal benchmarking

Ready for 3.0

by Adam Janes ✓ · 814 views · created 2025-06-06 · Engineering, AI Summarization

Ready for 3.0. This template uses no nodes that n8n 3.0 removes. No removed nodes, versions or helpers found. Static check, last run 2026-10-19.

What this workflow does

This AI workflow has 12 nodes and runs manually, when you click “Execute workflow”. Along the way it connects OpenRouter Chat Model, Google Drive and Google Sheets.

How it runs

Trigger: Manually, when you click “Execute workflow”.

  1. Get Tests (Google Sheets): uses Google Sheets
  2. Is PDF? (If): checks a condition and branches into true / false
  3. Loop Over Items (Loop Over Items (Split in Batches)): loops over the items in batches
  4. Google Drive: download
  5. Is a file? (If): checks a condition and branches into true / false
  6. Extract from File: extracts data from a file (pdf)
  7. LLM Judge (Basic LLM Chain): sends a prompt to an LLM, with model: OpenRouter Chat Model; output parser: Structured Output Parser
  8. Update Results (Google Sheets): append
  9. Wait: waits 0.5 seconds

Services it uses

OpenRouter Chat ModelGoogle DriveGoogle Sheets

Before you upgrade to n8n 3.0

Nothing in this workflow is removed in n8n 3.0, so it should import and run after the upgrade.

Nodes used (10)

From the author

This workflow demonstrates a simple way to run evals on a set of test cases stored in a Google Sheet. The example we are using comes from an info extraction task dataset, where we tested 6 different LLMs on 18 different test cases. You can see our sample data…

Excerpt from Adam Janes's description on n8n.io.

View the original on n8n.io → Check your own copy

Get the weekly “what broke” email

New templates, newly broken ones, and n8n release changes. One short email a week.

Form not loading? Subscribe here.