Back to projects
2023 - 2026 Built

CloudFleetExtract

@ Coordinadora de Tanques S.A.S

CloudFleetExtract

Automated Node.js ETL pipeline that syncs 51,000+ work orders from the CloudFleet API into SQL Server, powering Power BI dashboards used by operations and management. Replaced manual export workflows.

Features:

  • Processes 51,000+ work orders in production, powering real-time dashboards
  • Orchestrator with three modes: incremental sync, open-order updates, and full run
  • Idempotent by design: detects existing orders and updates instead of duplicating
  • Incremental sync reads the last date in the DB to avoid reprocessing
  • Handles pagination via x-nextpage header, rate-limiting (2s delay) and batches of 30 with 3s pauses
  • Cascading logic for maintenance classification: labor → header → "UNCLASSIFIED" fallback
  • Captures four distinct closure dates for time-based analysis in Power BI
  • Scheduled with PM2 and Windows Task Scheduler for unattended continuous execution

Technologies

  • Node.js
  • SQL Server
  • REST API
  • Power BI