Willis Towers Watson Logo

Willis Towers Watson

Principal Data Engineer – Enterprise Data Products

Posted 5 Hours Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in United Kingdom
Expert/Leader
In-Office or Remote
Hiring Remotely in United Kingdom
Expert/Leader
Principal Data Engineer responsible for designing and building scalable enterprise data products using Databricks, Spark, Python, SQL, and lakehouse technologies. The role covers architecture, data ingestion and transformation, cloud integration, testing, CI/CD, observability, data quality, AI-assisted engineering, troubleshooting, prototyping, and modernization. It also requires technical influence through design reviews, coaching, estimation, and collaboration across a distributed engineering team.
The summary above was generated by AI

We are seeking an experienced, hands-on Principal Data Engineer to play a key technical role within our Enterprise Data Products team.
Enterprise Data Products is progressing through a significant technology transformation and rearchitecture. You will join that journey in progress, quickly understand the existing landscape and agreed direction, and get hands-on in helping turn it into effective engineering solutions. We are looking for someone who can add value quickly: bringing deep engineering experience, modern AI-native engineering practices, solving difficult problems, introducing new ideas and constructively challenging approaches where there is a better way. You will be technically curious, pragmatic and comfortable working with evolving or high-level requirements.
 

The Role

This is a senior individual contributor role with no direct people-management responsibility, reporting to the Technical Lead.

You will bring deep technical expertise and hands-on engineering experience across complex delivery, solution design, prototyping and problem solving. Working closely with the Technical Lead and wider engineering team, you will help evaluate technical options, develop pragmatic implementation approaches and turn agreed architectural direction into working solutions.

You will also act as a trusted technical sounding board, supporting engineers through practical collaboration, review, coaching and knowledge sharing across our geographically distributed team.

Key Responsibilities

Solution Architecture & Technical Design

  • Quickly understand the existing platform, architectural direction and transformation roadmap.
  • Contribute hands-on expertise to the implementation and evolution of the target architecture.
  • Develop solution designs and engineering approaches aligned with the agreed technical direction.
  • Evaluate implementation options, balancing scalability, maintainability, performance, cost and delivery.
  • Constructively challenge existing approaches and prototype alternatives where appropriate.
  • Identify technical risks, dependencies and unknowns early and propose pragmatic solutions.

Data Engineering

  • Design and build scalable, resilient and maintainable enterprise data solutions.
  • Apply strong engineering practices using Databricks, Apache Spark/PySpark, Python, SQL and modern lakehouse technologies.
  • Develop reusable patterns for data ingestion, transformation, integration and delivery.
  • Design for incremental processing, schema evolution, reprocessing, performance and cost optimisation.
  • Apply automated testing, CI/CD, observability, data quality, lineage and appropriate engineering controls.
  • Investigate and resolve complex data, integration and platform problems.

AI-Native Engineering

  • Apply AI-native engineering practices across design, coding, testing and troubleshooting to materially improve engineering productivity and effectiveness.
  • Use AI to accelerate the development and maintenance of data solutions, including pipelines, transformations, data models, tests and operational automation.
  • Apply appropriate engineering practices and controls to ensure AI-assisted development is used safely, consistently and effectively.
  • Share practical approaches and learning to help strengthen AI-native engineering capability across the wider team.

Innovation & Continuous Improvement

  • Explore technologies and engineering approaches that could improve Enterprise Data Products.
  • Prototype promising ideas to validate their value and resolve technical unknowns.
  • Identify opportunities to simplify solutions, automate activity and improve engineering effectiveness.
  • Promote technical curiosity, experimentation and continuous improvement while maintaining engineering rigour.

Application & Integration Engineering

  • Apply strong knowledge of modern application, API, authentication and cloud integration patterns.
  • Work across data, application and platform technologies to develop coherent end-to-end solutions.
  • Collaborate with product and engineering teams to translate business needs into practical technical solutions.

Technical Influence & Engineering Support

  • Use technical expertise and hands-on experience to influence engineering decisions and approaches.
  • Act as a technical sounding board for complex or unfamiliar problems.
  • Support engineers through pairing, working examples, code and design reviews, coaching and knowledge sharing.
  • Contribute to pragmatic engineering standards and reusable patterns.
  • Help strengthen capability across a geographically distributed engineering team.
  • Communicate technical options, trade-offs and recommendations clearly.

Estimation & Delivery

  • Turn high-level requirements into technical approaches, identifying dependencies, risks and unknowns.
  • Break complex problems into pragmatic, deliverable increments.
  • Provide credible initial estimates, clearly identifying assumptions and uncertainty.
  • Balance engineering quality, delivery speed, technical risk and long-term maintainability.
Qualifications

What you'll bring

Essential

  • Proven and extensive experience in data engineering 
  • Deep hands-on experience with Databricks across implementation, development, production support and long-term maintenance.
  • Significant experience delivering complex enterprise data engineering solutions.
  • Strong hands-on experience developing production-quality Databricks notebooks using Python and SQL.
  • Demonstrable experience using AI as an integral part of software or data engineering, including design, coding, testing and troubleshooting, with an understanding of the practices and controls required to use it safely and effectively.
  • Strong knowledge of modern data engineering, distributed processing and Lakehouse concepts.
  • Experience with Apache Spark or comparable large-scale data technologies.
  • Experience designing and implementing cloud-based data platforms and products.
  • Strong knowledge of data modelling, ingestion, transformation and integration patterns.
  • Experience with automated testing, source control and CI/CD.
  • Strong troubleshooting and technical problem-solving capability.
  • Experience contributing to technology modernisation, migration or architectural transformation.
  • Ability to turn high-level or evolving requirements into pragmatic solutions and initial estimates.
  • Experience influencing and supporting engineers without direct line-management responsibility.

Desirable

  • Hands-on experience designing and delivering solutions using other lakehouse platforms, such as Microsoft Fabric.
  • Experience with Azure data platforms and cloud services.
  • Experience modernising established enterprise data estates.
  • Experience with data governance, metadata, lineage, observability and data quality.
  • Experience building reusable engineering frameworks or platform capabilities.
  • Experience with modern APIs, integrations and web application technologies.

What we offer
Enjoy a benefits package designed to help you thrive, both professionally and personally. You'll receive 25 days of annual leave plus an extra WTW day to relax and recharge. Our comprehensive health and wellbeing offering includes private healthcare, life insurance, group income protection, and regular health assessments, all giving you peace of mind. Secure your future with our defined contribution pension scheme, featuring matched contributions up to 10% from the company.

We support your growth and balance with hybrid working options, access to an employee assistance programme, and a fully paid volunteer day to make a difference in your community. On top of these, you can opt into a variety of additional perks including an electric vehicle car scheme, share scheme, cycle-to-work programme, dental and optical cover, critical illness protection, and much more. Start making the most of your career and wellbeing with a range of benefits tailored for you.

Equal Opportunity Employer 
We’re committed to equal employment opportunity and provide application, interview and workplace adjustments and accommodations to all applicants. If you foresee any barriers, from the application process through to joining WTW, please email [email protected]
 

HQ

Willis Towers Watson London, England Office

London, United Kingdom

Willis Towers Watson City of London, England Office

City of London, United Kingdom

Willis Towers Watson Holborn, England Office

Holborn, United Kingdom

Willis Towers Watson Reigate and Banstead, England Office

Reigate and Banstead, United Kingdom

Willis Towers Watson Reigate and Banstead, England Office

Reigate and Banstead, United Kingdom

Similar Jobs

Senior level
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Leads Financial Crime Compliance Level 3 analysts and independently reviews complex KYC, enhanced due diligence, name-screening, transaction-monitoring, AML, and fraud cases. Assesses customer profiles, ownership structures, business activities, transaction patterns, and supporting evidence to reach documented, risk-based conclusions. Oversees team quality, SLAs, governance, escalations, process improvements, and regulatory alignment while collaborating with Operations and Compliance stakeholders.
7 Hours Ago
In-Office or Remote
EC1V 1, London, England, GBR
Expert/Leader
Expert/Leader
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Leads Atlassian’s partner services programs, including subcontracting, joint solutions, partner certification, assurance services, engagement governance, and co-delivery quality. Works cross-functionally with Partner & Alliances, Sales, Finance, Legal, Procurement, and delivery teams. Builds scalable playbooks, standards, and enablement; manages executive relationships, resolves escalations, and mentors peers. The role requires up to 30% regional travel.
Top Skills: Ai AgentsConfluenceJIRAJira Service ManagementRovoSaaS
7 Hours Ago
In-Office or Remote
EC1V 1, London, England, GBR
Entry level
Entry level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Conduct outbound prospecting, qualify leads, convert meetings into pipeline, and engage decision-makers through cold calls, personalized emails, and other outreach. Partner with account executives, sales operations, marketing, and partners to develop lead-generation strategies, handle objections, communicate product value, and build pipeline for mid-market customers. The role requires fluent English and German and is remote within the UK.
Top Skills: GongLinkedin NavigatorOutreachSalesforce

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account