Process multiple prompts in parallel with Azure OpenAI Batch API

by Greg Evseev ✓ · 751 views · created 2025-04-13 · Engineering, Multimodal AI

What this workflow does

This AI workflow has 38 nodes and runs when another workflow calls it (plus 1 other trigger). It uses only n8n's built-in nodes.

How it runs

Trigger: When another workflow calls it (plus 1 other trigger).

1. Setup defaults (Edit Fields (Set)): sets or maps fields
2. One query example (Edit Fields (Set)): sets or maps fields
3. Truncate Chat Memory (Chat Memory Manager): uses Chat Memory Manager, with memory: Simple Memory
4. Set defaults if not set already (Code): runs custom JavaScript code
5. Append custom_id for single query example (Edit Fields (Set)): sets or maps fields
6. Fill Chat Memory with example data (Chat Memory Manager): uses Chat Memory Manager, with memory: Simple Memory
7. JSON requests to JSONL (Code): runs custom JavaScript code
8. Build batch 'request' object for single query (Code): runs custom JavaScript code
9. Load Chat Memory Data (Chat Memory Manager): uses Chat Memory Manager, with memory: Simple Memory
10. Remove original requests (Edit Fields (Set)): sets or maps fields

…plus 25 more steps. See the full node list below.

Before you upgrade to n8n 3.0

Nodes used (16)

• Execute Workflow Triggern8n-nodes-base.executeWorkflowTrigger
• Coden8n-nodes-base.code
• Ifn8n-nodes-base.if
• Waitn8n-nodes-base.wait
• Manual Triggern8n-nodes-base.manualTrigger
• Edit Fields (Set)n8n-nodes-base.set
• Aggregaten8n-nodes-base.aggregate
• Simple Memory@n8n/n8n-nodes-langchain.memoryBufferWindow
• Chat Memory Manager@n8n/n8n-nodes-langchain.memoryManager
• Execution Datan8n-nodes-base.executionData
• Split Outn8n-nodes-base.splitOut
• Filtern8n-nodes-base.filter
• Mergen8n-nodes-base.merge
• HTTP Requestn8n-nodes-base.httpRequest
• Convert to Filen8n-nodes-base.convertToFile
• Execute Sub-workflown8n-nodes-base.executeWorkflow

From the author

Process Multiple Prompts in Parallel with Azure OpenAI Batch API Who is this for? This workflow is designed for developers and data scientists who want to efficiently send multiple prompts to the Azure OpenAI Batch API and retrieve responses in a single batch…

View the original on n8n.io → Check your own copy