Genesis Logo

Genesis

Data Infrastructure

Posted Yesterday
Be an Early Applicant
Hybrid
London, Greater London, England, GBR
Senior level
Hybrid
London, Greater London, England, GBR
Senior level
Design, build, and maintain petabyte-scale batch and streaming data pipelines for robotics foundation model training and evaluation. Own data models, storage, ingestion, transformation, and orchestration. Standardize data models and unify processing across teleoperation and simulation datasets. Collaborate with a team building general-purpose Physical AI.
The summary above was generated by AI

What You’ll Do

  • Design, build, and maintain large-scale data pipelines (batch and streaming) for robotics foundation model training and evaluation at petabyte scale

  • Own core data infrastructure: data model, storage systems, ingestion pipelines, transformation frameworks, and orchestration layers

  • Standardize data models and unify processing pipelines across real-world teleoperation and synthetic simulation datasets

  • Collaborate with a team of driven individuals committed to building general-purpose Physical AI

What You’ll Bring

  • Excellent software engineering skills (Python, Go, or similar)

  • Extensive experience designing, building, and maintaining large-scale data pipelines (8+ years)

  • Deep understanding of distributed systems (Spark, Kafka, or similar)

  • Extensive experience with data storage technologies (data lakes, warehouses, object stores like S3)

  • Experience running and maintaining production-grade infrastructure (Kubernetes, Terraform)

  • Bonus: Experience supporting AI systems, in particular embodied AI like self-driving

Similar Jobs

4 Days Ago
Easy Apply
Hybrid
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Manage and coach an engineering team for Datadog's Observability Pipelines product, driving execution, roadmap partnership with Product, on-call and incident response, reliability, scalability, and integrations across sources and destinations.
Top Skills: Data InfrastructureData PipelinesDistributed SystemsObservabilityOn-Premise SoftwareRustStreaming
8 Days Ago
Hybrid
Senior level
Senior level
AdTech • Marketing Tech • Design
Design, build, and operate data infrastructure to process massive event volumes into reliable, low-latency analytics and data products. Own real-time and batch services, platform tooling, observability, cost and performance optimization, on-call incident response, and cross-team stakeholder collaboration to enable analytics, ML, and reporting at scale.
Top Skills: AWSCi/CdClickhouseClickhouse CloudCubeDagsterDuckdbIcebergInfrastructure-As-CodeKafkaKubernetesObject StoragePythonRustSpark
Senior level
Energy
Lead design, implementation, and operation of hybrid cloud and on‑prem hosting (primarily Azure and VMware). Ensure scalability, security, high availability, disaster recovery, IaC automation, and compliance (SOC2, ISO27001, GDPR). Manage and mentor infrastructure teams, coordinate with DevOps, security, and vendors, and support incident response and platform migrations.
Top Skills: AnsibleChefFirewallsHyper-VKubernetesLoad BalancingAzurePuppetTerraformVMwareVpcVpn

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account