EDF Trading Logo

EDF Trading

Senior Data Engineer

Posted 23 Days Ago
Be an Early Applicant
In-Office
London, Greater London, England, GBR
Senior level
In-Office
London, Greater London, England, GBR
Senior level
Build and maintain batch and real-time data pipelines, data models, dashboards, and data products supporting front-office trading. Responsibilities include orchestration, schema and ORM design, SQL optimization, data quality controls, streaming architectures, Python visualization, DevOps, monitoring, testing, security, and stakeholder collaboration. The role owns delivery end to end and contributes to architecture and engineering standards.
The summary above was generated by AI

When you join EDF Trading, you’ll become part of a diverse international team of experts who challenge conventional ideas, test new approaches, and think outside the box.


Energy markets evolve rapidly, so our team needs to remain agile, flexible, and ready to spot opportunities across all the markets we trade in power, gas, LNG, LPG, oil, and environmental products.


EDF Group and our customers all over the world trust that their assets are managed by us in the most effective and efficient manner and are protected through expert risk management. Trading for over 20 years, it’s experience that makes us leaders in the field. Energy is what we do.


Become part of the team and you will be offered a great range of benefits, which include (location dependent) hybrid working, a personal pension plan, private medical and dental insurance, bi-annual health assessments, corporate gym memberships, an electric car lease programme, childcare vouchers, a cycle-to-work scheme, season ticket loans, volunteering opportunities, and much more.


Gender balance and inclusion are very high on the agenda at EDF Trading, so you will become part of an ever-diversifying family of around 750 colleagues based in London, Paris, Singapore, and Houston. Regular social and networking events, both physical and virtual, will ensure that you always feel connected to your colleagues and the business.


Who are we? We are EDF Trading, part of the EDF Group - a world leader in low-carbon, sustainable electricity generation.


Join us, make a difference, and help shape the future of energy.


Job Description:

Department: Front Office Data Products


The Front Office Data Products team serves a variety of stakeholders across the Front Office, including traders, risk and senior management. We work with lots of different internal and external data sources, building and maintaining data pipelines, data models, and data products to support trading decisions and critical business processes. The team is currently expanding its capabilities to support real-time use cases alongside existing batch processing workflows, and is also expanding its Python data visualisation capabilities.


Position purpose

We are looking for a hands-on Senior Data Engineer to join our team to accelerate the delivery of high-value data products to the business. This person will be someone with strong Python fundamentals, experience with orchestration tools and Python data visualisation/UI tooling (ideally Plotly Dash) and will be someone who can communicate effectively with both business stakeholders and technical colleagues.


Main responsibilities

  • Build and maintain data pipelines that integrate with existing trading workflows and business processes, including operational ownership (monitoring, alerting, incident support) and embedding data quality controls (validation, anomaly detection).
  • Collaborate with stakeholders across different teams within the front office to understand requirements, translate business needs into technical tasks, and deliver high-quality data products. Explain trade-offs clearly and align on practical delivery plans.
  • Contribute to architectural decisions on how to implement pipelines and systems
  • Design database schemas and SQLAlchemy ORM models to support our data needs and cater for data quality and data governance requirements.
  • Utilise streaming technologies and event driven architecture to build real time visualisations
  • Develop dashboards and data products using Python UI tools (Plotly Dash, Streamlit or similar)
  • Participate in peer reviews and uphold engineering standards across the team (coding conventions, testing, CI/CD, observability, security-by-design).
  • Tune and optimise SQL queries for performance
  • Work with DevOps processes (Azure DevOps, CI/CD pipelines, Docker, Kubernetes)
  • Take ownership of work end-to-end: prioritise effectively, communicate with stakeholders, plan out the work, manage risks and dependencies, and drive tasks through to completion.
  • Be a role model for Python (and data engineering) best practices in the team

Experience and technical requirements

Essential

  • Strong Python and SQL experience
  • Data orchestration tools (Airflow, Dagster, Prefect)
  • Designing database schemas and ORM models (e.g. SQLAlchemy)
  • SQL query performance tuning and optimisation
  • Python UI/dashboard tools (Plotly Dash, Streamlit or similar)
  • DevOps experience (CI/CD pipelines, Azure DevOps or similar)
  • Strong communication skills – ability to work with both technical colleagues and business stakeholders.

Strongly Preferred

  • Kafka or other streaming technologies (e.g. Azure Event Hubs)
  • Kubernetes
  • Docker and containerisation
  • Azure Cloud services (Blob Storage, Application Insights, KeyVault, Azure DevOps)
  • Commodities trading or financial services background

Nice to have

  • Dagster
  • Tableau experience

Hours of work:

40 hours per week (Mon-Fri 08:30 - 17:30)

Hybrid (min 3 days per week at the office)

HQ

EDF Trading London, England Office

London, United Kingdom

Similar Jobs

2 Days Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Fintech • Mobile • Payments • Software • Financial Services
Design and maintain high-volume data pipelines, analytical data models, and storage infrastructure for global KYC and customer onboarding. Modernize legacy verification data architecture using Python and Airflow, optimize data-intensive workflows, and establish data contracts, monitoring, testing, observability, and auditability standards. Collaborate with software engineers, data scientists, product analysts, and compliance stakeholders to deliver reliable metrics and reporting for onboarding funnels and financial crime controls.
Top Skills: Apache AirflowDbtKafkaPrestoPythonSnowflakeSparkSQLTrino
4 Days Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Fintech • Mobile • Payments • Software • Financial Services
Design and build real-time liquidity observability infrastructure and high-throughput streaming data pipelines for global financial operations. Architect Kafka and Flink systems, implement reliable event processing, real-time aggregation, streaming data models, and sub-second analytical querying. Partner with product, data science, quantitative analysis, and treasury teams while addressing latency, resilience, regulatory, and financial trade-offs. Develop well-tested systems supporting liquidity attribution, cash positioning, transaction routing, and ML forecasting.
Top Skills: Apache FlinkApache KafkaApache Spark StreamingAvroEvent-Driven ArchitectureJavaKafka StreamsMachine LearningMedallion ArchitectureOlapProtobufScala
2 Days Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Healthtech • Software • Biotech • Pharmaceutical
Build and own scalable healthcare data applications, including Snowflake data pipelines, data-sharing solutions, and customer-facing retrieval interfaces. Develop Python backends and React frontends, modernize infrastructure with Terraform and Docker, and implement CI/CD and observability. Collaborate with oncologists, product leaders, and data scientists to translate clinical and regulatory requirements into reliable, compliant systems. Mentor engineers and help transform oncology data into actionable insights.
Top Skills: AirflowAmazon Ec2Amazon EmrAmazon S3AWSClaude CodeCursorDatadogDockerGitlab Ci/CdMetaplaneParquetPrefectPysparkPythonReactSnowflakeSpaceliftTerraform

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account