Narrating over a video using multimodal AI
Ready for 3.0What this workflow does
This AI workflow has 14 nodes and runs manually, when you click “Execute workflow”. Along the way it connects OpenAI Chat Model, Google Drive and OpenAI.
How it runs
Trigger: Manually, when you click “Execute workflow”.
- Download Video (HTTP Request): calls an HTTP API
- Capture Frames (Code): runs custom Python code
- Split Out: splits a list into separate items
- For Every 15 Frames (Loop Over Items (Split in Batches)): loops over the items in batches
- Combine Script (Aggregate): combines items into one
- Convert to Binary (Convert to File): converts data to a file (to binary)
- Use Text-to-Speech (OpenAI): work with audio
- Resize Frame (Edit Image): resize
- Upload to GDrive (Google Drive): uses Google Drive
- Aggregate: combines items into one
…plus 2 more steps. See the full node list below.
Services it uses
Before you upgrade to n8n 3.0
Nothing in this workflow is removed in n8n 3.0, so it should import and run after the upgrade.
Nodes used (13)
- OpenAI Chat Model
@n8n/n8n-nodes-langchain.lmChatOpenAi - Code
n8n-nodes-base.code - Split Out
n8n-nodes-base.splitOut - HTTP Request
n8n-nodes-base.httpRequest - Convert to File
n8n-nodes-base.convertToFile - Manual Trigger
n8n-nodes-base.manualTrigger - Aggregate
n8n-nodes-base.aggregate - Google Drive
n8n-nodes-base.googleDrive - Wait
n8n-nodes-base.wait - Loop Over Items (Split in Batches)
n8n-nodes-base.splitInBatches - Edit Image
n8n-nodes-base.editImage - OpenAI
@n8n/n8n-nodes-langchain.openAi - Basic LLM Chain
@n8n/n8n-nodes-langchain.chainLlm
From the author
This n8n template takes a video and extracts frames from it which are used with a multimodal LLM to generate a script. The script is then passed to the same multimodal LLM to generate a voiceover clip. This template was inspired by Processing and narrating a…