We are seeking a highly skilled Data Engineer with deep expertise in real-time data streaming, cloud data platforms (Google Cloud Platform), and Apache Beam. In this role, you will design, build, and optimize streaming data pipelines that enable scalable, reliable, and high-quality data flows. You’ll collaborate closely with data scientists, analysts, and software engineers to ensure data is efficiently stitched, transformed, and delivered to power analytics, AI, and business intelligence initiatives.
Key Responsibilities:
Design, implement, and maintain real-time streaming pipelines using Apache Beam and GCP services (e.g., Dataflow, Pub/Sub, BigQuery, Cloud Storage).
Develop scalable ETL/ELT solutions for both streaming and batch processing.
Implement data stitching strategies to integrate multiple data sources into unified, high-quality datasets.
Ensure data quality, reliability, and observability across pipelines.
Optimize data workflows for performance and cost-efficiency in cloud environments.
Apply best practices in CI/CD, infrastructure-as-code, and monitoring for data pipelines.
Contribute to data governance, security, and compliance efforts.
Key Requirements:
4+ years of experience in Data Engineering with a focus on real-time/streaming pipelines.
Strong expertise with Google Cloud Platform (GCP): Dataflow, Pub/Sub, BigQuery, Cloud Storage, Cloud Composer, etc.
Proficiency in Apache Beam (or equivalent frameworks such as Spark Structured Streaming, Flink).
Solid programming skills in Python.
Experience with data modeling, schema design, and data stitching across multiple sources.
Knowledge of cloud-native DevOps practices (Terraform, Cloud Deployment Manager, CI/CD pipelines).
Strong problem-solving skills and ability to work in fast-paced environments.
Hands-on knowledge of data observability tools (e.g., Datadog, Prometheus, OpenLineage).
Strong understanding of event-driven architectures and message queues.
Prior experience in high-volume, mission-critical data environments.
Benefits
- 30 days of paid vacation plus the option of up to 15 days of unpaid leave
- 25 days of workation within the EU
- Flexible working hours
- Sofa Concerts and employee events
- Discounts on ticket purchases & opportunities for clearing assignments
- Corporate benefits and discounts at KESS
- Central location & subsidy for a Job Ticket or Germany Ticket
- Bike leasing
- Mental health program & company pension scheme
- “GoFluent” language learning platform as well as Lunch & Learn sessions
We value diversity and treat all applications equally – regardless of gender, background, age, religion, disability, or sexual orientation. Different perspectives enrich our team and make EVENTIM stronger.
