Top Data Engineer Jobs in London

Build, optimise and stabilise AWS-based data pipelines (S3, Glue, Redshift, Lake Formation). Resolve technical debt, support the Architect on target-state design, collaborate with client engineering teams to transfer knowledge, and deliver production-ready platforms in regulated, high-volume gaming environments.

Design and build a greenfield marketing data foundation: tracking/tagging, identity strategy, data pipelines, integrations (GA4, Salesforce, Databricks, COGNOS), data modeling and QA, dashboards, attribution/MMM, governance and compliance. Serve as primary contact for marketing data issues, enforce standards, prioritize analytics backlog, and enable stakeholders.

Lead design and evolution of a company-wide data platform spanning streaming, batch, warehousing, orchestration, governance, and ML enablement. Deliver core platform capabilities, reliable real-time pipelines, shared tooling, and scalable infrastructure. Drive cross-team initiatives, champion golden paths, improve reliability/cost/observability, ensure regulatory compliance, and mentor senior engineers while influencing technical strategy and standards.

Lead design and delivery of a Snowflake-based cloud reporting and data analytics platform for SwapClear & Listed Rates. Own migration from Oracle/Informatica, ensure availability, performance, governance and lineage, drive technical standards, mentor engineers, partner with architecture, governance and business stakeholders, and support quality, observability and multi-year roadmap delivery.

The Senior Data Platform Engineer will lead the development of scalable Snowflake services, automation, CI/CD pipeline design, and security controls to optimize data-driven healthcare projects.

Triage and resolve Master Data Management (Party, Risk, Reference) issues in Stibo STEP, run targeted data-cleansing sprints, monitor data quality dashboards, support releases/UAT, and maintain documentation and playbooks to prevent recurring data issues.

Design, build, and maintain cloud-native backend services for index data processing. Write production-ready Python, deploy and operate services on AWS, use Infrastructure as Code, and monitor/debug systems with observability tools like Prometheus and Loki. Collaborate with product, research, and engineering teams.

Design and implement cutting-edge data solutions for AI-driven transformations, collaborating with clients, developing scalable architectures, and supporting AI integration.

The Senior Data Engineer will design, develop, and maintain data pipelines, ensuring data quality and reliability while collaborating with cross-functional teams to meet business needs.

Design, build and optimize scalable AWS-based data pipelines and ETL processes (batch and near-real-time) using Python, SQL, Airflow, Glue and Redshift. Improve performance, reliability and cost efficiency, implement monitoring/alerting, support governance, security and compliance, collaborate with architecture and analytics teams, and mentor colleagues.

The Senior Data Engineer will design and build an internal data platform, integrate data from multiple systems, and enable non-technical users to access and use data effectively, championing best practices in data engineering.

The Senior Software Engineer will lead the Core Data team to improve APIs, systems, and data pipelines, focusing on backend engineering and team mentoring.

As a Python and Kubernetes Software Engineer, you will develop data analytics solutions using open source tools, collaborating with a distributed team.

Build and maintain production data pipelines and features in Python; own project lifecycle from design to reliable production; set technical direction for the Insights platform; improve engineering standards (testing, observability, data quality); apply AI across products and pipelines; help establish semantic/AI-ready data layers.

Lead design, build, and operation of Rightmove's GCP-based data platform. Own ingestion, processing, storage, and tooling; develop reusable batch and real-time pipelines, infrastructure as code with Terraform, CI/CD, and promote engineering best practices across teams.

Lead design and evolution of a scalable data platform, build shared ingestion/transformation/orchestration capabilities for batch and real-time, integrate tools (dbt, Spark, Beam), implement data quality/observability/security/testing, enable AI-assisted data engineering, mentor engineers, and influence the data platform roadmap to support analytics and ML at scale.

Design and build scalable pipelines to ingest, transform and harmonise large healthcare datasets into research-ready formats (OMOP/FHIR). Lead technical direction, implement data quality and governance, collaborate with data scientists and epidemiologists, and deliver reusable data products using cloud and big-data technologies.

As a Senior Data Engineer, you'll build and manage data pipelines, ensure data quality, and collaborate across teams, contributing to the Data Platform's growth.

Design, build, test and document secure batch and real-time data pipelines, perform logical/physical database design and data modelling, expand platform capabilities, analyse and resolve data processing issues, and ensure alignment with data architecture for downstream consumers.

Build, test, and document secure batch and real-time data pipelines for a government client; design logical and physical databases; extend platform capabilities; ensure data models align with architecture; perform data analysis and root-cause investigations to improve processing and availability for downstream consumers.

Build and operate shared AI platform infrastructure for LLM applications, agents, RAG, tool calling, and AI workflows. Develop data and knowledge pipelines, secure enterprise integrations, reusable frameworks, deployment and observability standards, and developer tooling. Take AI systems from experimentation to reliable production while ensuring security, privacy, governance, scalability, quality, and cost efficiency. Collaborate across Engineering, Product, and IT to establish practical AI platform patterns and guardrails.

Build and maintain scalable ETL/ELT pipelines, integrate ServiceNow and Salesforce data, implement Microsoft Fabric medallion architecture, and develop Power BI reports and semantic models to deliver reliable insights and support stakeholders.

As a Lead Data Engineer, you will design and develop software for data processing, lead a team, ensure quality, and manage technical proposals.

As a Senior Data Platform Engineer, you will design and operate a scalable data platform, support analytics, mentor junior engineers, and drive technical excellence.

The Senior Data Engineer will enhance backend systems for a social media app by managing databases, optimizing recommendation algorithms, and ensuring accurate recommendations.