Challenge

Vlaams Verkeerscentrum manages extensive data from road sensors, ANPR cameras, and third-party services, often processing tens of terabytes. Their legacy Pentaho Data Integration (Kettle) system was increasingly hard to scale and maintain amid growing data volumes.

Solution

They migrated to Apache Hop, leveraging its low-code, metadata-driven design to modernize workflows. The team also adopted Docker for containerization, Jenkins for CI/CD automation, and Git for version control, improving deployment consistency and collaboration. Hop runs on-premise, integrating with Microsoft SQL Server, PostgreSQL, and various streaming data sources.

Impact

The new platform delivers a scalable, reliable data infrastructure supporting real-time traffic updates, advanced analytics, and machine learning. Automation and modular workflows enable faster adaptation to changing data needs, enhancing operational efficiency and insight delivery.

Outcomes

• Migrated two decades of ETL workflows to a modern, containerized environment
• Unified data integration from sensors, cameras, and web services
• Improved maintainability, scalability, and performance handling tens of terabytes
• Established a strong foundation for smart mobility innovation in Flanders