AND Digital Logo

AND Digital

Lead Data Engineer

Reposted 12 Days Ago
Be an Early Applicant
In-Office
Birmingham, West Midlands, England
Senior level
In-Office
Birmingham, West Midlands, England
Senior level
The Lead Data Engineer is responsible for developing and maintaining data pipelines, ensuring data quality, and working within multi-disciplinary teams to deliver data platforms in an agile environment.
The summary above was generated by AI

Who We Are:
We’re on a mission to close the world’s tech skills gap. 

We help organisations navigate the future of technology, combining human expertise, emerging tech and AI to deliver better outcomes, faster.

Since 2014, we’ve worked side-by-side with clients to solve complex challenges, build high-performing teams, and create lasting capability. As technology continues to evolve, we believe the most successful organisations will be those that combine the best of both: human ingenuity AND intelligent technology.

That belief is embedded in everything we do. We call it the genius of the AND: deep expertise AND practical delivery, innovation AND responsibility, ambitious work AND sustainable careers.

Through our Guide, Build and Equip approach, we help organisations embrace change, deliver meaningful impact, and develop the skills they need to thrive in an increasingly agentic world.

About you:

  • You care deeply about producing high-quality work that delivers real value
  • You’re comfortable navigating ambiguity and solving complex problems collaboratively
  • You bring strong expertise in your craft, alongside a willingness to keep learning
  • You communicate clearly and build trust quickly with clients and teammates
  • You’re pragmatic, adaptable and outcome-focused
  • You enjoy sharing knowledge and helping others grow
  • You value low-ego collaboration and enjoy working as part of multidisciplinary teams

What you’ll bring to the table:

As a Lead Data Engineer, you’ll help our clients deploy and maintain data pipelines in a production-safe manner, using the latest technologies and with a DataOps culture. You’ll work in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations.

Your responsibilities:

  • Develop pipelines that brings data to life for decision making, either delivering insight or for more sophisticated data science applications
  • Experience in being hands on with data, applying the practicalities of quality, flow, and organisation of information, and an understanding of data modelling approaches.
  • Be comfortable working in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations.
  • Previous practical experience of using both SQL and task orchestration software (eg. dbt, Airflow/Prefect/Dagster or equivalent) to develop production-grade pipelines that bring data to life
  • Strong Snowflake experience is preferred, and Databricks experience would be a bonus
  • Practical hands-on experience of at least one cloud platform (AWS, Azure or GCP) and experience of associated technologies (for example with AWS: DynamoDB, Redshift, Kinesis Pipelines, Glue, Lambda, QuickSight, etc)
  • Hands-on dataops experience (eg. CI/CD, version control, IaC, etc.)
  • Have experience adopting a Data Product mindset, ensuring datasets are discoverable, addressable, trustworthy, and self-describing for downstream consumers.
  • Ability to bridge the gap between technical engineering and business value, translating stakeholder needs into robust data product specifications.

Why join AND Digital?

We’re building a culture where talented people can do meaningful work, continue growing, AND enjoy the journey along the way.

Our model is designed to build belonging and connection: we’re organised into regional ‘Clubs’ of no more than 80 people, so you (and our clients) get the benefits of that small company feel while also being connected to a larger whole.

Our Practice Areas act as a ‘second home’ for our ANDis - a place where you can innovate and learn with like-minded experts who care deeply about their craft, support each other generously, and believe the best ideas come from collaboration, not hierarchy.

Our culture is rooted in our values of Wonder, Share and Delight, and shows up through five traits that we celebrate and nurture in all our ANDis: we value curiosity, ambition and a growth-mindset. We are deeply client-centric. Most important of all we are human - we create an inclusive environment where people feel trusted, supported and able to be themselves.

By joining AND, we’ll provide:

  • 25 days bookable holiday + flexible Bank Holidays 
  • Pension: 6% of salary paid by AND Digital with a further 2% paid by you (can be increased by choice).
  • Aviva healthcare cover (including pre-existing condition cover) for you.
  • Flexibenefit: £1000 assigned to you via our benefits portal to select or upgrade the benefits that suit you the most. Any unused allowance from the £1000 can be taken as cash. 
  • Life Assurance.
  • Income Protection.
  • Eye test + first pair of glasses.
  • Parental Benefits: Generous Enhanced Maternity and Enhanced Partner (Paternity) Leave.

Equal Opportunities Statement

Diversity and inclusion are hugely important to us, and we’re committed to providing equal opportunities for all. We’re actively recruiting for a diverse and inclusive workforce so want to ensure we do everything we can to support your application.

We want you to feel safe and empowered to let us know if you need any adjustments to be made to your application or interview process, so please speak to our recruitment team.

AND Digital London, England Office

18 Henrietta St, London, United Kingdom, WC2E 8QH

AND Digital Maidenhead, England Office

1 Bell Street, , England , Maidenhead, United Kingdom, SL6 1

Similar Jobs

11 Hours Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
As a Lead Data Platform Engineer, you will design and operate machine learning platforms using Databricks, manage AWS infrastructure, and enhance data workflow capabilities while mentoring teammates.
Top Skills: Amazon Web ServicesDatabricksDockerKubernetesMlflowPandasPulumiPythonScikit-LearnTerraform
3 Days Ago
Hybrid
London, England, GBR
Senior level
Senior level
Insurance • Cybersecurity
The Lead Data Engineer will develop and maintain a data platform, create data pipelines, ensure infrastructure support, and provide governance for stakeholders' data needs.
Top Skills: AWSAzureGCPPythonSparkSQL
16 Days Ago
In-Office or Remote
London, Greater London, England, GBR
Senior level
Senior level
Blockchain • Fintech • Financial Services • Cryptocurrency
The role involves leading the Data Platform, designing scalable pipelines, enhancing data quality, collaborating with AI teams, and mentoring engineers.
Top Skills: Apache AirflowBigQueryDbtGCPKubernetesPythonSQL

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account