Client-facing Principal Data Engineer leading design and delivery of enterprise Databricks-based data platforms. Provide architecture leadership, mentor engineering teams, drive platform optimisation, define standards, support technical governance, and deliver across multiple consultancy engagements.
We are looking for an experienced Principal Data Engineer to join us on a contract
basis, supporting complex client engagements across Data & AI transformation
programmes.
This is a highly client-facing consultancy role, suited to someone who is comfortable
operating at both strategic and hands-on technical levels. You will work directly with
senior client stakeholders, delivery teams and architects to design and deliver
scalable modern data platforms.
We are specifically looking for someone with deep expertise in Databricks, either
operating at Architect level or leading high-performing engineering teams within
enterprise environments.
The successful candidate will bring strong consulting capability, commercial
awareness and stakeholder management skills alongside exceptional technical depth.
basis, supporting complex client engagements across Data & AI transformation
programmes.
This is a highly client-facing consultancy role, suited to someone who is comfortable
operating at both strategic and hands-on technical levels. You will work directly with
senior client stakeholders, delivery teams and architects to design and deliver
scalable modern data platforms.
We are specifically looking for someone with deep expertise in Databricks, either
operating at Architect level or leading high-performing engineering teams within
enterprise environments.
The successful candidate will bring strong consulting capability, commercial
awareness and stakeholder management skills alongside exceptional technical depth.
Key Responsibilities
Client Engagement & Stakeholder Management
- Act as a trusted technical advisor across client engagements.
- Build strong relationships with senior stakeholders, delivery leads and
engineering teams. - Translate complex technical concepts into clear business value and delivery
outcomes. - Support clients through technical decision-making, platform strategy and
roadmap planning.
Databricks Leadership & Solution Architecture
- Lead the design and implementation of enterprise-scale Databricks solutions and modern data platforms.
- Provide architectural leadership across cloud-native data engineering
initiatives. - Define engineering standards, best practices and scalable delivery approaches.
- Drive platform optimisation, resilience and performance improvements.
Delivery & Consultancy
- Lead technical delivery across multiple client engagements within a consultancy environment.
- Work closely with cross-functional teams including Data Engineers, Architects, Product Owners and client stakeholders.
- Support project planning, technical governance and delivery execution.
- Ensure high-quality, scalable and maintainable engineering solutions.
Technical Leadership
- Mentor and guide engineering teams across modern data engineering practices.
- Lead technical problem-solving and incident resolution where required.
- Drive adoption of engineering best practices, automation and DevOps
principles.
Skills, Knowledge and Expertise
- Proven experience operating as a Principal Data Engineer, Lead Data Engineer or Data Architect within enterprise environments.
- Strong consultancy and client-facing experience, ideally across multiple customer engagements.
- Deep expertise in Databricks, including architecture, optimisation and leading delivery teams.
- Strong experience designing and delivering cloud-native data platforms within
Azure and/or AWS environments. - Advanced experience with PySpark, SparkSQL and large-scale distributed data processing.
- Strong understanding of modern data architecture, ETL/ELT frameworks and
data modelling. - Excellent SQL skills and experience working with large-scale datasets.
- Strong understanding of data governance, security and platform reliability
principles. - Excellent communication, stakeholder management and consulting skills.
- Ability to operate confidently in fast-paced, delivery-focused environments
Benefits
- Opportunity to work on complex, high-impact client programmes.
- Exposure to enterprise-scale Data & AI transformation initiatives.
- Flexible remote-first working model aligned to client requirements.
- Access to AWS & Databricks partner training and certifications.
- Collaborative culture focused on technical excellence and innovation.
- Opportunity to influence engineering standards, delivery capability and client success across Colibri Digital.
About
We are passionate about helping businesses navigate the rapidly changing and complex world of emerging technologies. We create well-structured, secure, scalable solutions at speed to provide the foundation for groundbreaking change.
Similar Jobs
.png)
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Lead financial crimes compliance audits from planning through reporting and remediation validation. Responsibilities include audit scoping, stakeholder management, fieldwork, data analysis, process mapping, control assessments, audit reporting, and mentoring junior team members. The role requires regulatory knowledge across US, EU, and APAC AML, sanctions, and terrorist financing frameworks, plus independent audit leadership and responsible use of generative AI.
Top Skills:
Data AnalysisGenerative Ai
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead go-to-market execution for Connected Equipment as an overlay specialist, partnering with Account Executives to generate pipeline, architect high-value enterprise deals, drive pilots/trials, inform product roadmap, build scalable sales frameworks, and travel to customer sites to advance solutions and close complex transactions.
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Senior Software Engineer II will enhance operational excellence by designing automated reliability systems, incident management tooling, and observability infrastructure while mentoring teams and implementing AI-driven solutions.
Top Skills:
AWSDatadogGCPGoGrafanaNew RelicPythonTerraform
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
