- C and C++
- Architecture, Design Patterns and Refactoring
- Skills & Tools
- Agile Software Development and Scrum
- Operating Systems and Networking
- Embedded Systems and Computer Architecture
- Version Control
- Robotics
- Mechanical Engineering
In this article, we describe how we orchestrate Kafka, Dataflow and BigQuery together to ingest and transform a large stream of events. When adding scale and latency constraints, reconciling and reordering them becomes a challenge, here is how we tackle it.