Data Engineer | London, UK

Role Summary 

We are looking for experienced Data Engineers / Data Analysts to support a ledger migration and data clean-up initiative across the data lake, reporting and downstream feeds. The role will involve working on large-scale batch processing, data validation, regression testing and migration readiness activities within a financial services environment. 

Key Responsibilities 

• Support ledger migration activities, including data extraction, transformation, reconciliation and validation. 

• Work on data lake clean-up, data quality checks, reporting pipelines and downstream feeds. 

• Develop, enhance and validate SQL queries, batch jobs and data processing logic. 

• Perform regression testing on batch processes to ensure data accuracy and completeness before and after migration. 

• Collaborate with engineering, product and business teams to understand migration requirements and resolve data issues. 

• Document data mapping, validation rules, test results and migration exceptions clearly. 

• Support production readiness, defect triage and post-migration validation activities. 

Required Skills and Experience 

• Strong hands-on experience with SQL and data analysis across large datasets. 

• Experience with batch processing, batch regression testing and data reconciliation. 

• Working knowledge of Spark or similar distributed data processing technologies. 

• Experience working with data lakes, reporting platforms, feeds and data migration programmes. 

• Ability to identify data inconsistencies, investigate root causes and support remediation. 

• Strong understanding of data quality, controls, validation and auditability in enterprise environments. 

• Good communication skills with the ability to work across engineering, business and product stakeholders. 

Preferred Experience 

• Prior experience in financial services, banking, ledger systems or regulatory data environments. 

• Experience supporting enterprise-scale migration, modernisation or platform transformation programmes. 

• Exposure to reporting, dashboards, data views and operational data feeds. 

• Ability to work in distributed teams across London, Bangalore and Singapore.