Top Data Engineer Jobs in London

Build end-to-end testing, evaluation, and feedback systems for a global GenAI assistant. Design data pipelines, APIs, and dashboards; own features from design to production; ensure safety, compliance, and quality; provide technical leadership and mentor peers.

The Senior Data Engineer will design and build data pipelines on GCP, ensuring high data quality and reliability for analytics and ML products. Responsibilities include mastering ETL processes, managing workflows with Airflow, and collaborating closely with ML engineers.

Build and operate a cloud-native data platform for biological and clinical data: design data lake/medallion architectures, ingest/validate/transform data, enable reproducible pipelines, implement IaC and CI/CD, improve discoverability, lineage, governance, and support scientists and data teams.

Design, build, and operate scalable, secure data pipelines, warehouses, and streaming systems. Collaborate with Engineering, Data Science, Analytics, and Product to model data, evolve platform architecture, optimize tools, and support delivery while mentoring junior engineers and promoting best practices (CI/CD, testing, observability, IaC).

Design, build and maintain ingestion pipelines and Databricks transformations; implement metadata-driven engineering, CI/CD, data testing and observability; evolve semantic models for reporting; lead and mentor a small engineering team and engage stakeholders to translate business needs into production-grade data products.

Lead design and development of core data storage, streaming, caching, and indexing platforms. Collaborate with cross-functional teams to deliver features, improve practices, mentor engineers, and present technical guidance to stakeholders while ensuring platform reliability and scalability.

Build, optimise and stabilise AWS-based data pipelines (S3, Glue, Redshift, Lake Formation). Resolve technical debt, support the Architect on target-state design, collaborate with client engineering teams to transfer knowledge, and deliver production-ready platforms in regulated, high-volume gaming environments.

As a Senior Data Engineer, you will design and manage data ingestion pipelines, ensuring scalability, reliability, and quality of data for analytics and machine learning purposes. You'll collaborate with cross-functional teams to define data standards and governance while promoting self-service and standardization across the organization.

Architect and build multi-petabyte streaming data platform processing billions of datapoints daily. Design and optimise distributed systems using Java/Python, Kafka, ArcticDB and databases. Collaborate with stakeholders, adopt AI-assisted development tools, troubleshoot performance issues, and drive delivery in a market-data environment.

Design, build, and maintain large-scale distributed data systems and pipelines for blockchain analytics. Ship production code, drive technical direction, mentor engineers, improve reliability, observability, and cost efficiency, and collaborate with product, data science, and intelligence teams.

Own and scale the ingestion pipeline and backend abstractions for high-throughput AI tracing data. Optimize ClickHouse schemas and queries, operate Langfuse Cloud and self-hosted deployments, and build infrastructure-heavy features that enable product engineers to ship data-heavy capabilities.

Design and deliver scalable Customer Data Platform solutions (Oracle Unity), build and operate data pipelines and Customer 360 models, integrate CDP with data lake/CRM/marketing systems, lead architecture and data modelling workshops, ensure data quality, governance, security, and support CDP operations, and partner with Oracle implementation teams.

Design, implement and maintain large-scale, secure data systems and pipelines across hybrid cloud environments. Optimize and troubleshoot big data platforms and orchestration tools, support ML/AI workloads, ensure GDPR/privacy compliance, perform integration testing, and support mission-critical cyber and intelligence programmes.

Design and build a greenfield marketing data foundation: tracking/tagging, identity strategy, data pipelines, integrations (GA4, Salesforce, Databricks, COGNOS), data modeling and QA, dashboards, attribution/MMM, governance and compliance. Serve as primary contact for marketing data issues, enforce standards, prioritize analytics backlog, and enable stakeholders.

As a Data Software Engineer, you will enhance reference data products, establish technical direction, and ensure data quality and compliance within trading systems.

The Senior Data Platform Engineer will lead the development of scalable Snowflake services, automation, CI/CD pipeline design, and security controls to optimize data-driven healthcare projects.

The Cloud Engineer will manage and enhance Azure Databricks environments, focusing on production readiness, pipeline reliability, automation, and collaboration with data teams to ensure robust AI and data capabilities.

Lead design and delivery of production-grade data pipelines, models and analytics on cloud platforms. Translate ambiguous problems into technical solutions, build/operate ETL/streaming, embed governance, integrate ML, apply software engineering practices, and communicate insights with visualisations and consultancy-grade materials.

As a Principal Engineer, you'll lead the design and development of high-performance data systems, mentor engineers, tackle complex challenges, and ensure operational resilience in a dynamic environment.

The Senior Software Engineer will lead the Core Data team to improve APIs, systems, and data pipelines, focusing on backend engineering and team mentoring.

The Senior Data Engineer will develop, maintain, and support data pipelines and artefacts for SCOR's data ecosystem, ensuring high-quality data management and promoting best practices across teams.

The Senior Data Engineer will design and build an internal data platform, integrate data from multiple systems, and enable non-technical users to access and use data effectively, championing best practices in data engineering.

The Senior Data Engineer will design and build a scalable real-time data backbone, focusing on data pipelines, integration, and collaboration with teams to support analytics and business objectives.

Drive the development of Ravio's data platform by building and maintaining data pipelines, ensuring data quality, and collaborating with the team. Oversee cloud infrastructure and shape the data roadmap while fostering a positive team culture.

Design and implement cutting-edge data solutions for AI-driven transformations, collaborating with clients, developing scalable architectures, and supporting AI integration.