Senior Data Engineer – Short Term Power Markets

Castleton Commodities International (https://www.cci.com) is a global leader in energy commodity trading and asset investment. Our Data Science & Technology team is central to our success, engineering the high-performance data, systems and innovative tools that power our commercial decision-making. We build platforms and forecasts that help our front-office teams understand market behavior, forecast price movements, and manage risk.
Our team solves complex, high-impact challenges using a modern technology stack, including the latest in GenAI and the latest technologies. We develop everything in cloud-native infrastructure from structured data and real-time analytics to back testing engines, third party integrations, and internal libraries, all designed to give CCI a competitive edge in global commodities markets. This role is an opportunity to build solutions that have a direct commercial impact from day one.
Castleton Commodities International is seeking a skilled Senior Data Engineer to join our DS&T team in London, supporting the Intraday Short-Term Power business. The Data Engineer will play a critical role in engineering the availability, quality, and performance of real-time data feeds that drive execution strategies, analytics, and decision-making. This is an exciting opportunity to work within a fast-paced, data-driven trading environment, contributing directly to systematic trading and risk management efforts.

Responsibilities:

• Design, build, and maintain scalable data pipelines to deliver real-time and historical data for back-testing, modeling, and execution of trading strategies.

• Integrate and manage data feeds from multiple sources, including fundamental market data, grid operations, weather providers, and internal trading systems.

• Collaborate closely with Technology and Trading teams to ensure the timely availability and reliability of data across all systems supporting the Intraday Power desk.

• Organize and structure Power data, including both reference and transactional data.

• Monitor, troubleshoot, and optimize streaming data infrastructure, proactively resolving issues to minimize downtime and ensure data integrity.

• Partner with Technology & Commercial teams to enhance the back-testing and signal generation frameworks that support systematic trading models.

• Implement best practices in data governance, versioning, and lineage, ensuring compliance and traceability across the data stack.

• Develop internal tools, APIs, and dashboards that improve data accessibility, transparency, and usability for Traders & Analysts.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, Mathematics, or related field of study.

• 5 -10 years of professional experience as a Senior Data Engineer, preferably supporting Intraday Short-Term Power trading or similar real-time energy market environments.

• Experience working with energy commodity time-series datasets is required; familiarity with short-term power market data sources such as EPEX, ENTSO-E, or Nord Pool is strongly preferred but not required.

• Understanding of systematic trading workflows, including signal generation, back-testing, and model validation.

• Proven ability to work in a high-frequency, intraday trading environment with tight feedback loops between data, models, and execution.

• Experience with ETL/ELT frameworks to write pipelines to load millions/billions of records.

• Advanced skills in writing highly optimized SQL code.

• Hands-on experience developing data solutions in Python, Pandas, Numpy, etc.

• Experience with relational databases; Snowflake highly preferred.

• Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

Employee Programs & Benefits:

CCI offers competitive benefits and programs to support our employees, their families and local communities. These include:

• Competitive comprehensive medical, dental, retirement and life insurance benefits

• Employee assistance & wellness programs

• Parental and family leave policies

• CCI in the Community: Each office has a Charity Committee and as a part of this program employees are allocated 2 days annually to volunteer at the selected charities.

• Charitable contribution match program

• Tuition assistance & reimbursement

• Quarterly Innovation & Collaboration Awards

• Employee discount program, including access to fitness facilities

• Competitive paid time off

• Continued learning opportunities

Visit  https://www.cci.com/careers/life-at-cci/# to learn more!

#LI-CD1