IG Group Logo

IG Group

Principal Data Engineer

Posted 21 Days Ago
Be an Early Applicant
In-Office
City of London, City and County of the City of London, England, GBR
Expert/Leader
In-Office
City of London, City and County of the City of London, England, GBR
Expert/Leader
Owns the end-to-end architecture of IG’s GCP data platform, including BigQuery, Kafka ingestion, transformation, integration services, data quality, observability, and self-service patterns. Leads complex migrations from AWS and on-premises systems, establishes engineering standards, mentors data engineers, reviews designs and code, manages third-party delivery quality, and partners with cross-functional stakeholders in a regulated financial services environment.
The summary above was generated by AI

Job Title

Principal Data Engineer

Job Description

So, who are we? 

IG Group is a FTSE 100 fintech operating across five continents, serving over 1.3m customers and handling billions of dollars in transactions – built on scale, trust, and proof. We didn’t pivot to innovation; it’s how we’ve always operated. What that means for the people who work here is real: genuinely complex problems to solve, the technology and resources to tackle them properly, and the kind of scope that’s rare in established businesses. The bar is high – bring a curious and forward-thinking mindset and we’ll give you the platform to define what comes next. Join us at IG – the future gets built here. 

Your team 

IG’s Data function is a central capability serving both central and divisional business lines across the entire IG estate. The Data Engineering team is responsible for the platforms that underpin analytics, reporting, compliance, and client-facing data products, and that will increasingly power AI and machine-learning use cases across the firm. 

The current data landscape reflects IG’s growth: a combination of GCP-native capabilities, on-premises systems, and a legacy AWS data platform. The strategic direction — endorsed by the CDO and Executive — is clear: consolidate onto GCP, raise the bar on data quality, and enable self-service access to trusted data for teams across the business.

What you’ll do 

  • Own the technical architecture of IG’s GCP data platform end-to-end — Core Lake (BigQuery), batch and real-time (Kafka) ingestion, transformation in the Medallion architecture, and Data-Engineering-owned integration services — setting the reference designs and patterns squads build against. 

  • Lead delivery of the most complex, high-risk work within the GCP consolidation programme, including migration off the legacy AWS platform and on-premises systems onto GCP-native capabilities. 

  • Define the platform contracts, interfaces, and self-service patterns that let mature divisions build and own their own models safely against trusted Core Lake data, and ensure fully-managed builds for less-mature functions follow the identical pattern so they are handover-ready by design. 

  • Drive data quality as a first-class, firm-wide concern: establish data contracts, observability, SLA/SLO monitoring, and automated alerting and remediation across ingestion and transformation layers, and hold squads to those standards. 

  • Act as the senior technical point of contact for stakeholders across Compliance, Marketing, Finance, Data Science, and the self-serving divisions (UK, APAC, tastytrade/US, Quants, Risk), translating requirements into well-scoped, well-architected engineering deliverables. 

  • Set and uphold engineering standards through code and design reviews, technical mentoring, and reusable frameworks that raise the bar across squads in London, India, and Poland — growing the technical capability of the whole function. 

  • Provide technical direction and quality assurance for third-party staff augmentation, ensuring augmented capacity engaged for time-boxed projects works to IG’s patterns and leaves behind maintainable, standards-compliant assets. 

  • Maintain delivery rigour: shape sprint cadences, escalate technical risk early, and report on pipeline SLOs, data freshness, and DORA-style engineering metrics to the Head of Data Engineering and CDO. 

What you’ll need for this role 

  • Hands-on experience designing and operating large-scale data pipelines on GCP (BigQuery, Cloud Composer/Airflow, GCS), with proven knowledge of Apache Kafka and real-time streaming architectures 

  • Demonstrated experience leading or technically mentoring a team of data engineers, with the ability to set standards, conduct code and design reviews, and grow engineers’ capabilities 

  • Strong grasp of data quality practices: data contracts, pipeline observability, SLA/SLO definition, and automated alerting and remediation 

  • Solid understanding of SQL transformation patterns and modern tooling such as dbt, alongside experience managing ingestion estates with third-party connectors and in-house integrations 

  • Clear and confident communicator able to work cross-functionally with non-technical stakeholders; comfortable in a regulated financial services environment with structured delivery disciplines (sprint cadences, change control, escalation) 

How we work 

We try to take a thoughtful approach to our ways of working as a company. We follow a hybrid working model with 3 days in the office – which we think balances the need to collaborate effectively and connect with each other. When it comes to how we deliver, there are 5 things we want everyone to do to drive high performance, better learning and career satisfaction: 

  • Lead and Inspire: Drives trust, alignment, and enthusiasm 

  • Think Big: Focus on the problems that most impact commercial outcomes 

  • Champion the client: Understand and prioritise client’s needs 

  • Deliver at pace: Push for fast, sustainable growth 

  • Raise the bar: Take ownership, be accountable and share feedback 

We believe that diversity is vital to success, it fuels creativity, drives innovation and sets us up for global success. We’re committed to building teams with a variety of perspectives and skills to help us realise our vision and strategy, that’s why we encourage applications from people with diverse backgrounds and experiences to join us on this journey. Learn more about our D&I approach here. 

The Perks 

Your growth fuels our success! Thrive with tailored development programs, mentoring opportunities with leaders, and clear career progression. Expand your network through committees, sports and social clubs. Enjoy extra time off for volunteering and community work. 

Learn more about the Perks here! 

Join us for this exciting journey. 

Number of openings

1
HQ

IG Group London, England Office

Cannon Bridge House, 25 Dowgate Hill, London, United Kingdom, EC4R 2YA

Similar Jobs

3 Days Ago
In-Office
London, Greater London, England, GBR
Expert/Leader
Expert/Leader
Fintech • Financial Services
Lead the design and development of a strategic, scalable data platform for high-volume trading data. Build data lakehouse, streaming, warehouse, metadata, lineage, and self-service capabilities using modern distributed technologies. Drive platform performance, reliability, security, regulatory compliance, cloud-native engineering, and infrastructure automation. Influence technology strategy across trading, data, and platform engineering while providing technical leadership and enabling teams to deliver data-intensive solutions efficiently.
Top Skills: AnsibleApache AtlasApache FlinkApache IcebergApache KafkaSparkBambooChefCi/CdDatahubDockerDollar UniverseGitopsJavaKotlinKubernetesOpenmetadataOpenshiftPostgresPuppetS3ScalaSQL ServerTerraformTrino
14 Days Ago
Hybrid
Expert/Leader
Expert/Leader
Energy • Industrial • Manufacturing
Provide hands-on technical leadership for Breedon's enterprise data platform. Design and deliver secure, scalable Azure and Microsoft Fabric data platforms, pipelines, standards, architectures, testing, monitoring, governance, and CI/CD practices. Lead modernization and technical strategy, improve reliability and costs, support AI retrieval workflows, and mentor data engineers while collaborating with senior stakeholders across the business.
Top Skills: Azure Data FactoryAzure Data Lake StorageAzure DatabricksAzure DevopsCi/CdDelta LakeEmbedding PipelinesAzureMicrosoft FabricPysparkPythonRag SystemsSemantic IndexingSQLUnity CatalogVector Databases
21 Days Ago
In-Office
Expert/Leader
Expert/Leader
Business Intelligence • Financial Services
Lead the design and implementation of a scalable Snowflake-based data platform, establishing enterprise data governance, ingestion, transformation, and democratization standards. Optimize ELT pipelines, enable advanced analytics and AI, evolve infrastructure-as-code, and ensure compliance with privacy and security policies. Collaborate with cloud engineering, stakeholders, and Agile teams while guiding data strategy, technical design, and adoption of emerging technologies.
Top Skills: Apache ArrowApache IcebergArtifactoryAzure Event HubsCollibraDaskDbtDockerGithub ActionsJavaJinjaKafkaLangchainLlamaindexPineconePolarsPulsarPysparkPythonScalaSnowflakeSnowflake AiSnowparkSQLTeamcity

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account