Hacker news job listing scraper and parser

by Julian Kaiser ✓ · 5,184 views · created 2025-02-17 · Personal Productivity

What this workflow does

This AI workflow has 15 nodes and runs manually, when you click “Execute workflow”. Along the way it connects OpenAI Chat Model and Airtable. It also calls uj5wyc0l7x-dsn.algolia.net over HTTP.

How it runs

Trigger: Manually, when you click “Execute workflow”.

1. Search for Who is hiring posts (HTTP Request): calls uj5wyc0l7x-dsn.algolia.net (POST)
2. Split Out: splits a list into separate items
3. Get relevant data (Edit Fields (Set)): sets 4 fields: title, createdAt, updatedAt…
4. Get latest post (Filter): keeps only the items that match a condition
5. HN API: Get Main Post (HTTP Request): calls an HTTP API
6. Split Out: splits a list into separate items
7. HI API: Get the individual job post (HTTP Request): calls an HTTP API
8. Extract text (Edit Fields (Set)): sets 1 field: text
9. Clean text (Code): runs custom JavaScript code
10. Limit: keeps the first few items

…plus 2 more steps. See the full node list below.

Services it uses

OpenAI Chat ModelAirtable

HTTP calls to: uj5wyc0l7x-dsn.algolia.net

Before you upgrade to n8n 3.0

Nodes used (11)

• Manual Triggern8n-nodes-base.manualTrigger
• Split Outn8n-nodes-base.splitOut
• OpenAI Chat Model@n8n/n8n-nodes-langchain.lmChatOpenAi
• Structured Output Parser@n8n/n8n-nodes-langchain.outputParserStructured
• HTTP Requestn8n-nodes-base.httpRequest
• Edit Fields (Set)n8n-nodes-base.set
• Filtern8n-nodes-base.filter
• Basic LLM Chain@n8n/n8n-nodes-langchain.chainLlm
• Coden8n-nodes-base.code
• Limitn8n-nodes-base.limit
• Airtablen8n-nodes-base.airtable

From the author

This automated workflow scrapes and processes the monthly "Who is Hiring" thread from Hacker News, transforming raw job listings into structured data for analysis or integration with other systems. Perfect for job seekers, recruiters, or anyone looking to…

View the original on n8n.io → Check your own copy