Refractal Logo

Refractal

Senior Data Engineer

Posted 23 Days Ago
Be an Early Applicant
In-Office
London, Greater London, England, GBR
Senior level
In-Office
London, Greater London, England, GBR
Senior level
Build and own Refractal’s data foundation, including a cryptographically signed evidence store, streaming and batch pipelines, data quality and retention controls, compliance reporting datasets, and training and evaluation data. Partner with integrations, data science, and security teams to support regulated customers, ensuring strong provenance, auditability, multi-tenant isolation, data residency, and deletion controls.
The summary above was generated by AI
About Refractal

Refractal is an AI security company building the infrastructure organisations need to defend against autonomous AI threats. 2026 has shown that generally capable intelligence is here. The challenge now is modernising security to stop AI-enabled threats, whether they come from internal agents going rogue or from attackers using AI to become more dangerous.

Refractal was founded on cybersecurity and AI expertise from MIT, Microsoft, NASA and the U.S. Navy. Our product lets organisations detect AI-enabled threats at low cost without sacrificing detection quality. We take a practical approach to AI risk, combining proven cybersecurity methods with frontier AI security research.

Today, we work with governments and organisations that can't afford to get security wrong. We're backed by leading deep-tech and cybersecurity investors and are growing the team to deliver on this mission.

The role

You'll build Refractal's data foundation, including the evidence store that customers' auditors rely on, the analytics behind compliance reporting and the datasets our models are trained on.

What you'll do
  • Design the data model for our append-only, cryptographically signed evidence store.

  • Build the streaming and batch layer that turns ingested activity and detections into queryable data, working with our integrations engineers on schemas.

  • Own data quality, retention, residency and deletion controls for regulated customers.

  • Build training and evaluation datasets with our data scientists and security engineers.

  • Make compliance reporting against the EU AI Act, NIST AI RMF and ISO/IEC 42001 quick to produce from our data.

Success in your first six months
  • The evidence store is in production, documented and trusted by customers' auditors.

  • Colleagues answer compliance and detection questions from data you own, without ad hoc work.

  • Training and evaluation data has clear provenance and separation.

About you: essential
  • 6+ years in data engineering, owning production pipelines.

  • Strong Python and SQL, with Postgres plus a warehouse or analytics store such as BigQuery or ClickHouse.

  • Experience with streaming (Kafka, Pub/Sub or similar) and orchestration (Airflow, Dagster or similar).

  • Data modelling for audit trails, lineage and multi-tenant isolation.

  • Security-minded handling of sensitive data.

Nice to have
  • Data work in banking, insurance or other regulated industries.

  • Experience with UK GDPR and data residency.

Our values

Radical transparency. We believe the best work happens when everyone feels able to give and receive honest, constructive feedback.

Public service. We see AI security as a form of public service. Getting the AI transition right means putting the right infrastructure in place to manage the threats that come with it, and our work helps protect the institutions and services society depends on.

Fail fast. We test ideas early, seek feedback and learn quickly. We experiment rapidly and change course when something isn't working, without compromising on security.

Pragmatism, not dogmatism. We choose approaches based on how well they solve the problem. That means combining established cybersecurity methods with frontier AI research, questioning our assumptions, and changing our minds when the evidence changes.

Compensation and benefits
  • Salary: £80,000–£135,000

  • Competitive equity to share in Refractal's growth

  • Pension contribution

  • Private medical and dental cover

  • Visa and relocation support

Similar Jobs

4 Days Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Fintech • Mobile • Payments • Software • Financial Services
Design and maintain high-volume data pipelines, analytical stores, and data models supporting global KYC and customer onboarding. Modernize legacy verification data infrastructure using Python and Airflow, optimize queries and workflows, and ensure data quality, observability, auditability, and regulatory transparency. Collaborate with software engineers, data scientists, product analysts, and compliance stakeholders to define data contracts, schemas, monitoring standards, and automated testing frameworks.
Top Skills: Apache AirflowDbtKafkaPrestoPythonSnowflakeSparkSQLTrino
23 Days Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Fintech • Mobile • Payments • Software • Financial Services
Design and build low-latency, real-time liquidity observability systems and streaming data pipelines for global financial operations. Architect Kafka and Flink pipelines, develop real-time aggregation and event-driven architectures, model streaming and analytical data, and ensure reliability through idempotency, exactly-once processing, failure recovery, and schema evolution. Collaborate with product, data science, quantitative analysis, and treasury teams to support liquidity positioning, forecasting, and operational visibility.
Top Skills: Apache FlinkApache KafkaApache Spark StreamingAvroKafka StreamsProtobuf
Yesterday
Hybrid
Senior level
Senior level
Fashion • Retail
Designs and optimizes scalable data pipelines, ETL/ELT workflows, lakehouse architectures, and data models on Databricks. Leads Teradata-to-Databricks migration efforts, improves performance and data quality, establishes engineering standards, supports CI/CD, and delivers trusted data products for analytics, reporting, AI, and data science. Provides technical leadership, conducts code reviews, mentors engineers, and collaborates with business, analytics, governance, and architecture stakeholders.
Top Skills: SparkCi/CdDatabricksDbt CloudDbt CoreAzurePysparkSQLTeradata

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account