Simple Machines Logo

Simple Machines

Principal Data Engineer

Reposted 2 Months Ago
Be an Early Applicant
In-Office
London, Greater London, England, GBR
Senior level
In-Office
London, Greater London, England, GBR
Senior level
Lead the design and implementation of modern data platforms and pipelines, ensuring high performance and compliance while consulting directly with clients to drive effective data solutions.
The summary above was generated by AI
Principal Data EngineerWho We Are

Simple Machines is a global, independent technology consultancy operating across Sydney, New Zealand, London, and Poland. We design and build modern data platforms, intelligent systems, and bespoke software at the intersection of Data Engineering, Software Engineering and AI.

We work with enterprises, scale-ups, and government to turn messy, high-value data into products, platforms, and decisions that actually move the needle.

We don’t do generic. We build things that matter - We engineer data to life™.


RequirementsThe Role

This is a hands-on principal engineering role, not an architecture-only seat and not a support function. You’ll be responsible for technical direction, platform design and architectural decision-making.

You'll design and build greenfield data platforms, real-time pipelines, and data products for clients who are serious about using data properly. You’ll work in small, high-calibre teams and operate close to both the problem and the client.

If you enjoy solving hard data problems, shaping modern architectures (data mesh, data products, contracts), and delivering real outcomes — this is your lane.

What You’ll Be Doing

Lead Platform & Architecture Design

  • Own the end-to-end architecture of modern, cloud-native data platforms
  • Design scalable data ecosystems using data mesh, data products, and data contracts
  • Make high-impact architectural decisions across ingestion, storage, processing, and access layers
  • Ensure platforms are secure, compliant, and production-grade by design

Build Modern Data Platforms

  • Design and deliver cloud-native data platforms using Databricks, Snowflake, AWS, and GCP
  • Apply modern architectural patterns: data mesh, data products, and data contracts
  • Integrate deeply with client systems to enable scalable, consumer-oriented data access

Develop High-Performance Pipelines

  • Build and optimise batch and real-time pipelines
  • Work with streaming and event-driven tech such as Kafka, Flink, Kinesis, Pub/Sub
  • Orchestrate workflows using Airflow, Dataflow, Glue

Work at Scale

  • Process and transform large datasets using Spark and Flink
  • Design systems that perform in production - not just on paper

Own Data Storage & Performance

  • Work across relational, NoSQL, and analytical stores (Postgres, BigQuery, Snowflake, Cassandra, MongoDB)
  • Optimise storage formats and access patterns (Parquet, Delta, ORC, Avro)

Cloud, Security & Governance

  • Implement secure, compliant data solutions with security by design
  • Embed governance without killing developer velocity

Consult and Influence

  • Work directly with clients to understand problems and shape solutions
  • Translate business needs into pragmatic engineering decisions
  • Act as a trusted technical advisor, not just an order taker

Technical Leadership & Quality

  • Set engineering standards, patterns, and best practices across teams
  • Review designs and code, providing clear technical direction and mentorship
  • Raise the bar on data quality, testing, observability, and operational excellence
What We’re Looking For

Core Engineering Strength

  • Strong Python and SQL
  • Deep experience with Spark and modern data platforms (Databricks / Snowflake)
  • Solid grasp of cloud data services (AWS or GCP)

Architecture & Design Judgement

  • Demonstrated ownership of large-scale data platform architectures
  • Strong data modelling skills and architectural decision-making ability
  • Comfortable balancing trade-offs between performance, cost, and complexity

Data Platform Experience

  • Built and operated large-scale data pipelines in production
  • Strong data modelling capability and architectural judgement
  • Comfortable with multiple storage technologies and formats

Engineering Discipline

  • Infrastructure-as-code experience (Terraform, Pulumi)
  • CI/CD pipelines using tools like GitHub Actions, ArgoCD
  • Data testing and quality frameworks (dbt, Great Expectations, Soda)

Delivery & Consulting Mindset

  • Experience in consulting or professional services environments
  • Strong consulting instincts — able to challenge assumptions and guide clients toward better outcomes
  • Comfortable mentoring senior engineers and influencing technical culture

BenefitsWhy Simple Machines
  • You’ll work on interesting, high-impact problems
  • You’ll build modern platforms, not maintain legacy mess
  • You’ll be surrounded by senior engineers who actually know their craft
  • You’ll have autonomy, influence, and room to grow

If you’re a senior data engineer who wants to build properly, think clearly, and deliver real outcomes - we should talk.

Simple Machines London, England Office

London, London, United Kingdom

Similar Jobs

6 Days Ago
Hybrid
London, Greater London, England, GBR
Entry level
Entry level
Other • Consulting • Energy
Lead mechanical engineering design and delivery for complex data centre projects. Design resilient cooling, ventilation, automation, controls, and ancillary systems; coordinate with electrical and multidisciplinary teams; manage technical delivery, resources, timelines, and client relationships; produce and review detailed designs; supervise engineers; and apply building physics, CFD, sustainable design, CAD, Bluebeam, and BIM tools.
Top Skills: Automation And ControlsBimBluebeamCadCfd
6 Days Ago
In-Office
Entry level
Entry level
eCommerce • Fashion • Payments • Retail
Leads the architecture, development, and evolution of scalable cloud-native data platforms and production data solutions. Provides technical leadership across initiatives, establishes engineering standards, mentors engineers, resolves complex production issues, and improves platform performance, reliability, security, and cost efficiency. Works with Product, Platform, Architecture, and engineering teams to shape technical direction and roadmap priorities.
Top Skills: Amazon EksAmazon EventbridgeAmazon S3Amazon SnsApache IcebergAWSAws IamAws LambdaChange Data CaptureCi/CdData LakesData WarehousesHvrJavaLakehousePythonScalaSQLStarburstTeradata
8 Days Ago
Hybrid
London, England, GBR
Expert/Leader
Expert/Leader
Healthtech • Biotech
Provides principal-level technical leadership for enterprise data engineering across secure clinical and research platforms. Designs scalable cloud and hybrid data solutions, establishes standards for data modelling, governance, interoperability, resilience and security, and contributes hands-on to delivery. The role also guides architectural decisions, develops DataOps and DevOps practices, evaluates technologies, mentors engineers and collaborates with engineering, architecture, bioinformatics, product and governance teams.
Top Skills: AirflowAutomationAws GlueBamCi/CdCloud InfrastructureData EngineeringData ModellingData ProvenanceDataopsDevOpsDistributed SystemsEvent-Driven ArchitecturesFastqFhirGa4GhInfrastructure As CodeJavaLakehouseMetadataObservabilityOmopPrefectScalaShell/BashVcf

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account