Track certification requirements with ScrapeGraphAI, GitLab and Rocket.Chat

Certification Requirement Tracker with Rocket.Chat and GitLab ⚠️ COMMUNITY TEMPLATE DISCLAIMER: This is a community-contributed template that uses ScrapeGraphAI (a community node). Please ensure you have the ScrapeGraphAI community node installed in your n8n instance before using this template. This workflow automatically monitors websites of certification bodies and industry associations, detects changes in certification requirements, commits the updated information to a GitLab repository, and notifies a Rocket.Chat channel. Ideal for professionals and compliance teams who must stay ahead of annual updates and renewal deadlines. Pre-conditions/Requirements Prerequisites - Running n8n instance (self-hosted or n8n.cloud) - ScrapeGraphAI community node installed and active - Rocket.Chat workspace (self-hosted or cloud) - GitLab account and repository for documentation - Publicly reachable URL for incoming webhooks (use n8n tunnel, Ngrok, or a reverse proxy) Required Credentials - ScrapeGraphAI API Key – Enables scraping of certification pages - Rocket.Chat Access Token & Server URL – To post update messages - GitLab Personal Access Token – With api and writerepository scopes Specific Setup Requirements | Item | Example Value | Notes | | ------------------------------ | ------------------------------------------ | ----- | | GitLab Repo | gitlab.com/company/cert-tracker | Markdown files will be committed here | | Rocket.Chat Channel | certification-updates | Receives update alerts | | Certification Source URLs file | /data/sourceList.json in the repository | List of URLs to scrape | How it works This workflow automatically monitors websites of certification bodies and industry associations, detects changes in certification requirements, commits the updated information to a GitLab repository, and notifies a Rocket.Chat channel. Ideal for professionals and compliance teams who must stay ahead of annual updates and renewal deadlines. Key Steps: - Webhook Trigger: Fires on a scheduled HTTP call (e.g., via cron) or manual trigger. - Code (Prepare Source List): Reads/constructs a list of certification URLs to scrape. - ScrapeGraphAI: Fetches HTML content and extracts requirement sections. - Merge: Combines newly scraped data with the last committed snapshot. - IF Node: Determines if a change occurred (hash/length comparison). - GitLab: Creates a branch, commits updated Markdown/JSON files, and opens an MR (optional). - Rocket.Chat: Posts a message summarizing changes and linking to the GitLab diff. - Respond to Webhook: Returns a JSON summary to the requester (useful for monitoring or chained automations). Set up steps Setup Time: 20-30 minutes 1. Install Community Node: In n8n UI, go to Settings → Community Nodes and install @n8n/community-node-scrapegraphai. 2. Create Credentials: a. ScrapeGraphAI – paste your API key. b. Rocket.Chat – create a personal access token (Personal Access Tokens → New Token) and configure credentials. c. GitLab – create PAT with api + writerepository scopes and add to n8n. 3. Clone the Template: Import this workflow JSON into your n8n instance. 4. Edit StickyNote: Replace placeholder URLs with actual certification-source URLs or point to a repo file. 5. Configure GitLab Node: Set your repository, default branch, and commit message template. 6. Configure Rocket.Chat Node: Select credential, channel, and message template (markdown supported). 7. Expose Webhook: If self-hosting, enable n8n tunnel or configure reverse proxy to make the webhook public. 8. Test Run: Trigger the workflow manually; verify GitLab commit/MR and Rocket.Chat notification. 9. Automate: Schedule an external cron (or n8n Cron node) to POST to the webhook yearly, quarterly, or monthly as needed. Node Descriptions Core Workflow Nodes: - stickyNote – Human-readable instructions/documentation embedded in the flow. - webhook – Entry point; accepts POST /cert-tracker requests. - code (Prepare Source List) – Generates an array of URLs; can pull