The Data Engineer will develop and optimize data solutions, improve pipelines, collaborate with teams, and enhance data system architecture.
We are looking for a Data Engineer to help us build structured, high-quality data solutions for our Content Understanding teams. Our teams process petabytes of data using tools such as BigQuery and Dataflow, and where needed we develop our own data tooling to support and evolve our music catalog.
What You'll Do
- Take ownership over, maintain and improve data pipelines that are integral to our success
- Evaluate and optimize our offerings for efficiency and reliability at scale
- Identify areas of architectural improvement to remove the potential for human error
- Collaborate with product and engineering teams to understand data requirements and create innovative solutions to challenging problems
- Understand the analytics data we collect from our systems and how it relates to the business value being produced
Who You Are
- Proven experience in data engineering, including creating reliable, efficient and scalable data pipelines for large data sets (especially in Python or Scala)
- Experience in building and maintaining scalable backend systems
- Knowledge of cloud-based data platforms (AWS, GCP or Azure)
- Strong collaboration and communication skills with technical and non-technical stakeholders
- Seek to participate in continuous improvement efforts such as software development, planning, estimating, developing and testing
Where You'll Be
- This role is based in London (UK)
- We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home
Top Skills
AWS
Azure
BigQuery
Dataflow
GCP
Python
Scala
Similar Jobs
Healthtech • Software • Biotech • Pharmaceutical
The Senior Machine Learning Engineer will lead model development, collaborate with stakeholders, manage engineers, and enhance machine learning strategies for clinical data extraction in cancer research.
Top Skills:
Deep LearningGenerative AiLlmsMachine LearningNlpPythonSQL
Artificial Intelligence • Information Technology • Natural Language Processing • Software • Business Intelligence • Generative AI
The role involves driving global partner programs to enhance partner experience and generate revenue, requiring collaboration and strategic program management.
Top Skills:
Salesforce
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
The Lead Data Scientist will develop recommendation and personalization models, collaborating with data scientists and integrating solutions into streaming services.
Top Skills:
AirflowGoogle Ai PlatformGoogle Cloud PlatformJavaKubeflowPysparkPythonScalaSQLTensorFlowVertex Ai
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.