As a Lead Data Engineer, you will shape the future of online car markets, leading complex data projects, organizing teams, and designing new data solutions while working closely with engineers and management in a collaborative environment.
About the project:
Our customer is the European online car market with over 30 million monthly users, with a market presence in 18 countries. The company is now merging with a similar company in Canada and needs support on this way. As a Lead Data Engineer, you will play a pivotal role in shaping the future of online car markets and enhancing the user experience for millions of car buyers and sellers.
Requirements:
- 8+ years of experience in software engineering
- English - Upper-Intermediate+
- Proven experience leading complex data projects, organizing teams, and architecting and designing new solutions
- Extensive expertise in AWS services, especially Glue, Athena
- Proficiency in Python, PySpark, GCP
- SQL, Airflow, data streaming frameworks (Kafka or Firehose)
- Experience in building and maintaining data pipelines
- Experience in building data platforms, not just using them
- Proficiency in data modeling techniques and best practices
Responsibilities:
- Simplify existing tools, make them more modular, work with technical debt
- Propose improvements, be actively involved in team discussions and decision-making, drive initiatives
- Work closely with a team of Senior Engineers, Product Manager and Engineering Manager
We offer:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
Top Skills
Pyspark
Python
SQL
Similar Jobs
The Data Engineer will architect and lead the transition from on-premises batch architecture to a cloud-based streaming data platform, focusing on data warehousing, ETL pipelines, and data governance. The role involves collaboration with cross-functional teams and fostering a culture of technical excellence.
As a Data Engineer at Vaayu, you will transform customer data into standardized formats, contribute to improving transformation pipelines, and assist the team with customer data inquiries. Your role will be crucial in supporting the mission of reducing environmental impact through effective data handling.
.png)
Be an Early Applicant
The Principal Data Engineer will build data foundations for an AI-powered architecture design product, creating optimized data systems and robust data pipelines that support rapid experimentation and decision-making processes, and collaborating with cross-functional teams to meet data needs.
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
