Top Data Engineer Jobs in London

Reposted YesterdaySaved
Hybrid
London, UK
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Senior Azure Data Engineer, you'll design and deploy data engineering pipelines using Databricks on Azure, collaborate with clients, and implement best practices in a consulting environment.
Top Skills: AzureAzure DevopsAzure Event HubsClouderaDatabricksDeltalakeGithub ActionsHadoopHiveJenkinsKafkaPysparkPythonSpark Structured StreamingSQLUnity Catalog
Reposted YesterdaySaved
Hybrid
London, UK
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead architecture and delivery of data solutions on Databricks within Azure, ensuring best practices in data pipeline design and implementation.
Top Skills: Azure DevopsCi/CdDatabricksDeltalakeGithub ActionsJenkinsPysparkPythonSpark Structured StreamingUnity Catalog
Reposted YesterdaySaved
Hybrid
London, UK
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The role involves designing and building data pipelines using AWS technologies, leading projects, and mentoring junior engineers in a data engineering context for financial services.
Top Skills: AWSAws Well-Architected PrinciplesHadoopJavaKafkaKinesisPythonScalaSparkSpark Streaming
Reposted 18 Days AgoSaved
In-Office
London, UK
Senior level
Senior level
Fintech • Information Technology • Financial Services
Design, build, and operate enterprise-grade, cloud-native data platforms and pipelines for Preqin's Company Intelligence. Provide technical architecture, end-to-end delivery, data governance, observability, and reliability while leading and mentoring a small team and partnering with product and analytics to deliver measurable business value.
Top Skills: Apache AirflowAWSAzureCi/CdDbtGitKubernetesPythonSnowflakeSQLTerraform
Reposted 5 Hours AgoSaved
Hybrid
London, UK
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The role involves designing and maintaining a data platform, enhancing system efficiency, implementing data query solutions, and technical reviews within a data engineering team.
Top Skills: Apache HadoopApache PrestoCassandraDelta LakeDynamoDBFlinkGoGrpcHiveIcebergJavaJenkinsKafkaKubernetesMySQLParquetPostgresProtocol BuffersPythonScalaSparkTrino
Reposted 5 Hours AgoSaved
Hybrid
London, UK
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design, build, and operate highly scalable real-time streaming microservices and data pipelines (Java/Python/Go) using Kafka, Flink/Spark on Kubernetes across multi-cloud and on-prem. Own design, deployment, monitoring, observability, and on-call support while improving platform reliability and developer experience.
Top Skills: Apache FlinkApache KafkaSparkApache StormAvroAWSCi/CdDatadogDistributed TracingGCPGitopsGoGrafanaJavaKubernetesOciParquetPrometheusProtobufPulsarPythonRabbitMQRestful ApisSplunk
Reposted YesterdaySaved
Hybrid
London, UK
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design and build cloud-based data pipelines using AWS tools, collaborate with clients, ensure data governance, and mentor junior engineers.
Top Skills: AWSCi/CdDevOpsHadoopJavaKafkaKinesisPythonScalaSparkSpark Streaming
Reposted 24 Days AgoSaved
Hybrid
London, UK
Senior level
Senior level
Artificial Intelligence • Semiconductor
The Lead Data Engineer will design and oversee data pipelines and platforms, ensuring reliability, scalability, and governance while collaborating with various stakeholders.
Top Skills: AthenaAurora PostgresqlAWSCi/CdDbtFlaskGlueLambdaPrefectPythonRedshiftS3Streamlit
Reposted 2 Days AgoSaved
Hybrid
London, UK
Senior level
Senior level
Artificial Intelligence • Big Data • Enterprise Web • Fintech • Software • Financial Services
The role involves designing and developing high-performance, real-time data processing systems using Apache Flink and Kafka, ensuring reliability and scalability while collaborating with various teams.
Top Skills: .NetApache FlinkAWSCi/CdHarnessJavaKafkaTerraform
Reposted 3 Days AgoSaved
Hybrid
London, UK
Senior level
Senior level
Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
The Senior Data Platform Engineer will manage Databricks infrastructure, develop cloud systems, collaborate with teams, and enhance machine learning workflows.
Top Skills: AWSDatabricksDockerKubernetesMlflowPandasPulumiPythonScikit-LearnTerraform
Reposted 5 Days AgoSaved
Hybrid
London, UK
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Join CrowdStrike's data engineering team to build a hyper-scale data lake for cybersecurity, using Java and Spark to develop data platforms and pipelines.
Top Skills: AWSCassandraDynamoDBFlinkGoGrpcIcebergJavaJenkinsKubernetesLinuxMySQLNoSQLParquetPinotPostgresProtocol BuffersScalaSparkSQL
Reposted 6 Days AgoSaved
Hybrid
London, UK
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Build and maintain ultra-high-scale data platforms and pipelines (petabyte scale). Write fault-tolerant Java/Spark code, design low-latency query capabilities, improve performance and stability, participate in technical reviews, and enable customers/internal teams to query and extract analytics from event data.
Top Skills: SparkAWSCassandraDynamoDBFlinkIcebergJavaKotlinKubernetesLinuxMySQLPostgresScala
New

Track Smarter, Apply Better.

Ditch the spreadsheets. Organize your job search with our freeApplication Tracker.

Use For Free
Application Tracker Preview
Reposted 5 Hours AgoSaved
In-Office or Remote
London, UK
Senior level
Senior level
Artificial Intelligence • Software • Automation
Build and maintain the data foundation (pipelines, warehouse) and develop AI-native agents and internal workflows on top of it. Enable product and cross-functional teams to make faster, data-driven decisions. Measure success by improving organizational speed and intelligence.
Reposted 5 Hours AgoSaved
In-Office
London, UK
Mid level
Mid level
AdTech • Marketing Tech
This role involves building and maintaining a global data warehouse and automated reports while supporting campaign reporting and improving existing data solutions.
Top Skills: AdverityDbtGoogle Cloud PlatformGoogle Data StudioMicrosoft PowerbiSQL
Reposted 5 Hours AgoSaved
In-Office
London, UK
Mid level
Mid level
Financial Services
Develop and enhance low latency market data systems using high-performance C++ in a collaborative team environment, contributing to architecture and project leadership.
Top Skills: BashC++23LinuxPython
YesterdaySaved
In-Office
London, UK
Senior level
Senior level
Information Technology • Consulting
Design and implement a shared GCP-native data pipeline architecture for HR and Finance, build Workday and Oracle connectors, maintain a unified Cloud SQL data model and lineage graph, enable real-time event capture via Firebase, and ensure pipeline observability and Power BI DirectQuery support.
Top Skills: Cloud ComposerCloud DataflowCloud LoggingCloud MonitoringCloud RunCloud SqlDirectqueryFirebase Realtime DatabaseInformaticaOracle Fusion Cloud Rest ApisPower Bi EmbeddedSoapWorkday RaasWorkday Rest Apis
Reposted 6 Days AgoSaved
Hybrid
London, UK
Senior level
Senior level
eCommerce • Information Technology • Marketing Tech • Software
The Senior Software Engineer will scale the Supplier Data Manager for enterprise customers, enhance AI-driven data pipelines, and improve collaboration features while ensuring operational excellence and customer-driven product development.
Top Skills: AWSAzureGCPKubernetesPHPPythonReactTypescript
Reposted 6 Days AgoSaved
Hybrid
London, UK
Senior level
Senior level
Fintech • Information Technology • Insurance • Software
The Senior Data Scientist will unify technical vision, develop and deploy ML models, and enhance AI strategy across teams. Responsibilities include collaboration, ownership of projects, and maximizing value through AI and data science techniques.
Top Skills: AWSDatabricksDbxGCPMlflowPython
Reposted YesterdaySaved
In-Office
London, UK
Mid level
Mid level
Fintech • HR Tech • Insurance • Consulting
Build and maintain ETL/data pipelines into the Data Lakehouse, develop Power BI dashboards, support AWS infrastructure (S3, Glue, Lambda, Step Functions, LakeFormation), ensure data quality using dbt, write complex SQL and Python for data processing, use Git for version control, document workflows, and collaborate with analysts and data scientists.
Top Skills: Aws CloudwatchAws GlueAws IamAws LakeformationAws LambdaAws S3Aws Step FunctionsData LakehouseDbtGitPower BIPythonSQL
Reposted 3 Days AgoSaved
In-Office or Remote
London, UK
Junior
Junior
Fintech • Software • Financial Services
Build and operate distributed ingestion and processing pipelines, ensure reliability and performance, define data contracts, add observability and testing, improve platform reliability and CI/CD, and participate in design/code reviews and incident retrospectives.
Top Skills: AirflowAnsibleArgo CdConfluenceDagsterGitGithub ActionsHadoopHbaseHdfsHelmJIRAKubernetesMongoDBNifiNode.jsOpensearchPysparkPythonRundeckSparkTerraform
Reposted 3 Days AgoSaved
In-Office or Remote
London, UK
Mid level
Mid level
Information Technology • Software
Design, build, and maintain scalable data pipelines and storage for fraud detection. Support fraud analytics, feature engineering, model integration and serving, pipeline monitoring, and documentation. Collaborate with data, product, and engineering teams to enable detection, reporting, and operationalisation of fraud models.
Top Skills: Apache AirflowApache SupersetCi/CdClickhouseDbtFastapiFlaskGitMetabaseMlflowMySQLPythonSQLTableau
4 Days AgoSaved
Hybrid
London, UK
Mid level
Mid level
Real Estate • Energy • Agriculture • Renewable Energy
Build, deploy and operate Azure and on-prem platforms and scalable data pipelines. Maintain applications, design integrations and event-driven architectures, implement CI/CD and IaC, embed security/governance, and lead troubleshooting and continuous improvement across platform and data engineering.
Top Skills: APIsArmAzureAzure Data FactoryAzure DevopsAzure FunctionsAzure SqlBicepC#Cosmos DbDatabricksGitLogic AppsMicrosoft PurviewOauth2PysparkPythonRbacSynapseTerraform
Reposted 4 Days AgoSaved
Hybrid
London, UK
Mid level
Mid level
Artificial Intelligence • Software • Industrial • Generative AI
The Data Engineer will build data pipelines for materials science, ensuring data quality and collaborating with ML researchers while managing large datasets.
Top Skills: AirflowDagsterDockerFlyteKubernetesPrefectPython
Reposted 4 Days AgoSaved
In-Office
London, UK
Junior
Junior
Information Technology • Financial Services • Cryptocurrency
As a Junior Data Engineer, you will build data processing pipelines, support decision-making, visualize finance indicators, and monitor improvements.
Top Skills: PythonSQL
Reposted 4 Days AgoSaved
In-Office
London, UK
Senior level
Senior level
Artificial Intelligence • Information Technology • Machine Learning • Natural Language Processing • Software
Design, build, and maintain production data pipelines and warehouse/lakehouse architecture. Implement version-controlled transformations (dbt), orchestration, IaC, monitoring, and data quality. Enable secure, auditable data access for analysts and product teams, and define long-term platform strategy while partnering across engineering, analytics, and product.
Top Skills: AirflowAWSBigQueryCdkCloudFormationDagsterData WarehouseDatabricksDbtLakehousePythonRedshiftSnowflakeSQLStep FunctionsTerraform
All Filters
JobType
New Jobs
Job Category
Experience
Industry
Company Name
Company Size

Sign up now Access later

Create Free Account