Quantum (quantum.media) Logo

Quantum (quantum.media)

Senior Data Engineer

Posted 5 Days Ago
Be an Early Applicant
In-Office
London, Greater London, England, GBR
Senior level
In-Office
London, Greater London, England, GBR
Senior level
Designs and maintains scalable, high-performance data pipelines and infrastructure for real-time analytics. Owns the Cube.js semantic layer, integrates Salesforce and customer data sources, leads dbt transformation workflows, and manages Apache Airflow orchestration. The role focuses on low-latency processing, data quality, observability, and effective data modeling. It also involves collaborating with architects and business stakeholders, mentoring junior engineers, and delivering complex data initiatives end to end.
The summary above was generated by AI

Our Company
At Quantum, we connect global brands with high-intent consumers. We turn intent into action and complexity into clarity.

Our Mission is clear, to help smarter, faster buying decisions. Our vision, to be the world’s most used digital comparison service, delivering value and simplicity to millions.

We drive growth through data-driven affiliate marketing built for performance from day one. Every campaign is measurable, optimised in real time, and designed to scale.

With in-house tech, full-stack analytics, and a compliance-first mindset, we give our partners an edge. We drive confident decisions and growth in regulated and high-growth sectors. We’ve helped ambitious brands grow faster, smarter, and globally.

The Role

Our Technology team is growing and we'd love you to grow with us. We're looking for a skilled and experienced Senior Data Engineer to help design and build a robust, scalable, and high-performance real-time data backbone.

In this role, you'll take a leading hand in the design, development, and implementation of a real-time data backbone. Your focus will be on building and maintaining scalable, high-performance data pipelines that support real-time data processing and analytics. You'll work closely with teams across the business to ensure our infrastructure meets growing data needs, leveraging modern technologies for efficient data ingestion, storage, and analysis.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and infrastructure that power real-time analytics and reporting.

  • Take ownership of our semantic layer using Cube.js, enabling reliable, self-serve analytics across the organisation.

  • Integrate and unify data from Salesforce, CDP, and SCV sources, ensuring clean, consistent data flow across marketing and customer data platforms.

  • Lead the development of transformation workflows using dbt, with a strong emphasis on testing, documentation, and data quality.

  • Architect and manage pipeline orchestration via Apache Airflow, ensuring reliability and observability at every stage.

  • Monitor and optimise pipeline performance for low-latency, high-throughput use cases.

  • Collaborate closely with Data Architect, marketing analysts, and business stakeholders to ensure data infrastructure directly supports business objectives.

  • Mentor and support more junior engineers, helping to raise the bar across the team.

About You

  • Significant hands-on experience in data engineering, with a proven track record of leading and delivering complex data initiatives end to end.

  • Great understanding of semantic layers such as Cube.js you've built and maintained semantic layers and understand pre-aggregations, caching strategies, and multi-tenancy.

  • Strong experience integrating Salesforce Marketing Cloud, CDP, and Single Customer View (SCV) data you understand the nuances of customer and marketing data at scale.

  • Expert-level SQL and proven experience building robust transformation pipelines with dbt.

  • Solid experience orchestrating workflows with Apache Airflow in production environments.

  • Comfortable working across cloud platforms (AWS, GCP, or Azure) for data ingestion, storage, and processing.

  • Proficiency in Python or a similar language for pipeline development and automation.

  • Strong data modelling instincts you think carefully about how data is structured, named, and consumed downstream.

  • You're as comfortable whiteboarding architecture with engineers as you are explaining data concepts to non-technical stakeholders.

  • Calm and focused in a fast-moving environment you can prioritise well and bring others along with you.

  • Excellent written and verbal English communication skills.

  • You lead by example, care about the team's success, and leave things better than you found them.

What You’ll Get

  • Private Health Care (Bupa)

  • Hybrid Working (3 days in office)

  • Travel Insurance

  • Competitive Base Salary

  • Company Bonus Scheme

  • Paid for AI Subscription (Claude / ChatGPT / Gemini)

  • Market-Leading Training Programme

  • Recognition & Reward Scheme

  • Annual Company Conference

  • Regular Happy Hours & Team Lunches

  • Free Coffee, Drinks & Snacks

What’s the next step?
Our hiring process ensures we're recruiting the right people for the role. We ensure that people are as suitable for us as we are for them.
If you like the sound of what we're all about at Quantum and want to join a team where you can make an impact, please apply or contact us at [email protected].

Similar Jobs

11 Days Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Information Technology
Leads the design, development, and support of enterprise data platforms and pipelines. Ingests, cleanses, models, and documents data from diverse sources into governed Kimball datasets for BI, machine learning, and AI. Oversees data engineers, ensures pipeline reliability and quality, applies DevOps and CI/CD practices, performs data analysis, and collaborates with stakeholders on requirements, governance, GDPR compliance, and continuous process improvement.
Top Skills: Apache KafkaArmAzure CliAzure Data Factory V2Azure Data Lake Storage V2Azure DatabricksAzure DevopsAzure FunctionsAzure Logic AppsAzure PortalAzure PowershellAzure Resource ManagerAzure Stream AnalyticsBicepC#Ci/CdDelta LakeGitMicrosoft PurviewPower BIPowershellPysparkPytestPythonRest ApisSpark Structured StreamingSQLTerraformUnittestUnity CatalogYaml
3 Days Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design, implement, operate, and troubleshoot CrowdStrike’s global multi-vendor, multi-cloud, hybrid data center networks. Build cloud connectivity and network constructs, develop infrastructure-as-code and automation using Ansible, Terraform, Python, and Go, improve resilience and deployment efficiency, support incident analysis and on-call rotations, and ensure compliance with regional data sovereignty and security requirements.
Top Skills: AnsibleAnycastAWSAzureBashChefCi/CdClosEvpn/VxlanFrrGCPGoInfinibandIpsecIpv4Ipv6Is-IsJinjaJSONL3VpnLoad BalancingMacsecMp-BgpMplsOciOpenstackOspfPrivatelinkPythonQosRdmaRoceSonicTerraformVpcYaml
2 Days Ago
In-Office
Senior level
Senior level
Pharmaceutical • Manufacturing
Lead development and improvement of eClinical systems and processes supporting clinical trials. Manage Medidata configurations, access, data outputs, reporting, coding dictionaries, validation, and regulatory compliance. Program in SAS, R, and Python; create Spotfire visualizations; apply CDISC standards; and provide technical guidance and training. Collaborate with clinical, statistical, quality, and vendor teams to improve automation, data quality, and AI-enabled solutions across the clinical development lifecycle.
Top Skills: CdiscGxpMeddraMedidataPythonRSASSpotfireWhodrug

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account