NewDay Logo

NewDay

Lead Data Engineer

Posted 5 Days Ago
Be an Early Applicant
Hybrid
London, Greater London, England, GBR
Expert/Leader
Hybrid
London, Greater London, England, GBR
Expert/Leader
Lead and develop a pod of Data Engineers while remaining hands-on in designing scalable data platforms, pipelines, transformations, and data products. Guide data modelling, warehousing, ETL/ELT, testing, observability, automation, and engineering quality. Collaborate with technology and business teams to solve complex data challenges and explore AI-enabled improvements. The role may involve AWS, Snowflake, Spark, Scala, Airflow, Git, and CI/CD.
The summary above was generated by AI

As a Lead Data Engineer, you’ll lead a pod of Data Engineers to build reliable, scalable data products and platforms that continue to help NewDay make better decisions and get more value from our data.


This is a hands-on management role where you’ll combine technical expertise with people leadership. You’ll role-model our engineering approach, standards for quality and support your team to solve complex data challenges at scale. We also want to keep evolving how we use AI and automation within data engineering, giving you the opportunity to bring your ideas and curiosity to help us explore smarter, more efficient ways of working.


How you'll contribute

  • You’ll lead and develop a pod of Data Engineers, creating an environment where people can learn, collaborate and deliver high-quality engineering.
  • You’ll shape the technical direction for data within your area, providing guidance across data modelling, data warehousing, ETL/ELT and scalable data platforms.
  • You’ll remain hands-on, designing and developing complex data pipelines and solutions using dbt, Python, SQL and modern cloud data technologies.
  • You’ll champion engineering quality, improving testing, data quality, observability and automation to make our data products more reliable and easier to operate.
  • You’ll collaborate across technology and the business, turning complex requirements into practical data solutions and exploring how AI and emerging technologies could improve the way your team engineers and delivers.

We're looking for these essential skills

  • Hands-on experience using dbt to design, build and improve data transformations within a complex data environment.
  • Engineering experience using Python and SQL, with the ability to solve complex data problems at scale.
  • The ability to design and guide modern data engineering solutions, with knowledge of data modelling, ETL/ELT, data warehousing and scalable data pipelines.
  • The ability to lead and develop Data Engineers, combining hands-on technical contribution with coaching, technical direction and ownership of delivery.
  • An interest in AI and automation, with the technical curiosity to explore how emerging technologies could improve engineering quality, productivity and ways of working.

It's a plus if you also have these skills

  • Experience using AWS or another major cloud platform. Our environment includes EMR, Athena, Lambda, S3, Glue and Step Functions, but we're open to transferable experience solving similar problems.
  • Experience with Snowflake, Spark, Scala or Airflow, or transferable experience with comparable technologies and solving similar data engineering challenges.
  • Experience with Git, GitHub and CI/CD practices, including tools such as GitHub Actions.
  • Knowledge of real-time data processing, data governance, data quality or observability.
  • Experience using AI-enabled engineering tools or automation to improve data engineering productivity, quality or reliability.


We know great candidates don't always meet every requirement. If you have strong data engineering foundations, hands-on DBT experience and experience solving complex problems at scale, we'd encourage you to apply even if you haven't worked with every technology listed above.


Externally this job title might also be known as Data Engineering Lead, Data Platform Lead or Principal Data Engineer.


#LI-Hybrid

#LI-TM1

At NewDay, we value all types of diversity. We’re an equal opportunity employer and believe that our differences create a vibrant, authentic working culture. We want all our colleagues to feel able to bring their whole selves to work. We don’t discriminate on the basis of protected characteristics or identities. We make sure that every job is crafted to be inclusive and that people with disabilities or caring responsibilities can take part in the application and interview process.

Tell us if you need accommodations: We’ll put reasonable adjustments in place to support you.

We work with Textio to make our job design and hiring inclusive.

Permanent
HQ

NewDay London, England Office

7 Handyside Street​, London, United Kingdom, N1C 4DA

Similar Jobs

6 Days Ago
In-Office
London, Greater London, England, GBR
Expert/Leader
Expert/Leader
Fintech • Financial Services
Lead the design and delivery of governed data products and pipelines on a Snowflake-centric platform. Provide hands-on technical leadership to distributed data engineering teams, establish engineering standards, build AI-ready semantic data products, embed quality and observability controls, and migrate legacy platforms. The role requires strong financial services data knowledge, cloud and modern data architecture expertise, mentorship capabilities, and experience optimizing scalable, production-ready data solutions.
Top Skills: APIsAzureCdcCi/CdData CataloguingData LineageData ObservabilityData QualityData SharingDatabricksDataopsDbtDimensional Data ModelingDynamic TablesEltFinopsGitLakehouse ArchitectureMedallion ArchitecturePythonSnowflakeSnowparkSnowpipeSQLStreamingStreamsTasks
12 Days Ago
In-Office
London, Greater London, England, GBR
Senior level
Senior level
Insurance
Lead the design and delivery of scalable, metadata-driven data engineering solutions using Databricks and Azure services. Develop ingestion frameworks, orchestration processes, ETL pipelines, and CI/CD practices while improving performance, reliability, governance, and security. Collaborate with stakeholders, data scientists, and analysts to translate business needs into effective solutions. Lead technical design discussions, make architectural decisions, manage multiple deliverables, and mentor junior engineers.
Top Skills: AirflowArm TemplatesAzureAzure Data FactoryAzure Data Lake StorageAzure FunctionsBicepCi/CdData GovernanceDatabricksDatabricks AutoloaderDbtDevOpsETLPysparkSpark Declarative PipelinesSQLTerraform
12 Days Ago
In-Office
London, Greater London, England, GBR
Senior level
Senior level
Professional Services • Real Estate • Financial Services
Leads complex data engineering initiatives, designing metadata-driven ingestion frameworks, orchestration processes, scalable Databricks and Azure data solutions, and robust ETL pipelines. Establishes CI/CD, DevOps, governance, security, and data engineering best practices; optimizes pipeline performance and reliability; collaborates with stakeholders, analysts, and data scientists; leads technical architecture decisions; and mentors junior engineers.
Top Skills: Apache AirflowArm TemplatesAutoloaderAzure Data FactoryAzure Data Lake StorageAzure FunctionsBicepCi/CdDatabricksDbtDevOpsETLAzurePysparkSpark Declarative PipelinesSQLTerraform

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account