Sparta Commodities SA Logo

Sparta Commodities SA

Staff Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Hybrid
London, Greater London, England, GBR
Senior level
Hybrid
London, Greater London, England, GBR
Senior level
Lead design and evolution of scalable real-time and batch ETL pipelines and data platform. Own performance, reliability, and data quality; drive architecture and tooling choices; collaborate with product and backend teams; mentor engineers and shape target architecture to support trader-facing analytics and low-latency data needs.
The summary above was generated by AI

We Are Sparta
Sparta is the next-generation commodity trading platform.
We give trading desks the clarity, control, and collaboration they need to move faster and trade smarter.
In February 2025, we secured $42 million in Series B funding. Now we’re scaling up across the business, and it’s an exciting time to join.

Our people are the driving force behind everything we do. At Sparta, you’ll be trusted to take ownership, backed by a team who wants you to succeed. You’ll be challenged, supported, and given room to grow. Because building something this ambitious takes everyone at their best.

At Sparta, your work has reach. From improving our platform, to powering smarter decisions for our customers, to changing how commodity trading is done around the world.

And because we’re growing fast, you won’t just build your career. You’ll accelerate it, with a level of ownership and impact you simply don’t get at bigger, more bureaucratic companies.

Staff Data Engineer

At Sparta, we're on a mission to build the next generation of commodity trading platforms - replacing the fragmented tools traders depend on with a single, powerful dashboard. Our product is a data-driven platform that aggregates real-time feeds from across the commodities domain, transforming them into intuitive, actionable visualisations within one unified interface. Users can explore pre-built data views or build their own custom formulas - turning raw market data into decisions.

At the heart of Sparta is a serious data engineering challenge. We're building a platform that enables the rapid development of reliable, scalable ETL pipelines - the foundation everything else depends on. As our data volumes grow and our product ambitions expand, the demands on that infrastructure grow with them. We're looking for experienced data engineers who are familiar with these challenges at scale — people who understand what it takes to keep a data platform performing as complexity increases.

We want people who thrive with ownership. At Sparta, you'll be handed problems, not solutions - and we expect you to run with them. Speed matters, autonomy is real, and we'd rather you move fast and course-correct than wait for permission. As a Staff engineer, you'll also be shaping the direction of the platform itself: engaging directly with stakeholders, contributing to product thinking, and investing meaningfully in the engineers around you.

Core Responsibilities
  • Play a leading role in the design, build, and ongoing evolution of scalable data pipelines and ETL frameworks that power both real-time and analytical data processing.

  • Take shared ownership of the health and performance of our data platform - optimising for latency, throughput, and reliability at scale.

  • Collaborate closely with engineering and cross-functional stakeholders to ensure data infrastructure aligns with product goals and trader-facing outcomes - acting as the connective tissue between data and backend engineering.

  • Drive architectural decisions across our data platform, with a focus on pipeline reliability, data quality, and scalability.

  • Contribute to the definition of our target architecture - shaping how we ingest, transform, store, and serve data as the platform evolves.

  • Mentor and support other engineers through design reviews, technical discussions, and hands-on knowledge sharing.

Skills & Experience
  • 7+ years of experience as a data or software engineer, with a strong track record of delivering production-quality data systems.

  • 2+ years working within a product-focused organisation, collaborating closely with cross-functional teams.

  • Proven experience building and scaling data-intensive pipelines and platforms in production environments.

  • Deep understanding of stream and batch processing frameworks - hands-on experience with Flink or Spark is essential.

  • Comfortable working across multiple programming languages - we primarily work with Kotlin, Python, and TypeScript.

  • Equally comfortable designing high-level architecture as diving deep into low-level implementation details.

  • Experienced in designing and deploying data infrastructure in cloud environments such as AWS or GCP.

  • Hands-on experience with core data infrastructure tooling such as Kafka, Redis, and/or clustered Postgres.

Nice to have experience
  • Familiarity with open lakehouse technologies, such as Apache Iceberg and dbt.

  • Experience building data infrastructure to support AI agents - including low-latency retrieval and analytical interfaces.

  • Experience leading teams or managing engineers, driving both delivery and technical excellence.

  • Exposure to complex distributed environments with demanding constraints such as high throughput, low latency, or large-scale datasets.

Working style

Whereas Sparta is a remote-first company, for this role we’re looking for someone who values a hybrid working style, which in a typical week could involve spending a couple of days in the office - with flexibility built in.

Sparta Commodities is proud to be an equal opportunity employer and promotes diversity within its workforce. We are determined that no-one will ever receive less favourable treatment on the grounds of gender, age, disability, religion, belief, sexual orientation, marital status, race, veteran status or any basis covered by appropriate law.

Similar Jobs

14 Days Ago
Remote or Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Fintech
The Senior Data Engineer will design and build an internal data platform, integrate data from multiple systems, and enable non-technical users to access and use data effectively, championing best practices in data engineering.
Top Skills: AirbyteBigQueryDbtFivetranGCPK8SPostgresPythonScalaSnowflakeSQLTerraform
21 Days Ago
In-Office
London, Greater London, England, GBR
Senior level
Senior level
Artificial Intelligence • Transportation
Lead the design and delivery of the Data Transfer Hub, managing large-scale data transfer pipelines and working directly with partners like Uber and Nissan.
Top Skills: AzureFlyteKafkaPythonTerraform
27 Days Ago
In-Office or Remote
London, Greater London, England, GBR
Senior level
Senior level
Payments
The Staff Engineer will define architecture, lead data pipeline design, ensure platform reliability, and mentor engineers, driving data initiatives and technical standards.
Top Skills: AirflowAWSAzureDbtFlinkGCPKafkaPythonSparkSQLStarrocks

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account