Design, build, and operate big-data and streaming platforms (Kafka, Hadoop, Dremio). Develop, deploy, and monitor data pipelines using Java, Python, Spark/Flink; collaborate on data modeling and ingestion, ensure data integrity and availability, act as a Big Data SME, and perform root-cause analysis.
We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evolving global financial markets.
Core Responsibilities
Skills and Experience:
#LI-DNP
Core Responsibilities
- Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)
- Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink)
- Collaborate with development teams on data modeling, data ingestion, and capacity planning
- Work with users to ensure data integrity and availability
- Act as a Big Data SME and consult on a variety of data-related questions from users and developers
Skills and Experience:
- 5+ years experience working in a mature data engineering environment
- 3+ years of experience building Kafka streaming applications and/or maintaining Kafka clusters
- 2+ years of experience building applications/pipelines with Big Data backends (S3, HDFS, Databricks, Iceberg, etc)
- Experience with Apache Spark, Apache Flink or similar tools
- Strong Java, Python, and SQL development skills
- Experience with common data-science toolkits, especially python-based
- Hands-on experience with Kubernetes and Docker
- Experience with monitoring tools such as Prometheus/Grafana, Alert Manager, Alerta and OpsGenie
- Strong statistical analysis skills
- Demonstrated ability to troubleshoot and conduct root-cause analysis
- Unix scripting experience (bash, python, etc.)
#LI-DNP
IMC Trading London, England Office
London, United Kingdom
Similar Jobs at IMC Trading
.png){kind=avatar}
Fintech • Machine Learning • Software • Financial Services
Build, operate, and scale large-scale data storage platforms (Hadoop, S3-compatible, enterprise storage). Tune Linux for I/O performance, automate deployments with Ansible/Puppet, implement observability with Prometheus, and partner with engineers on storage- and Kafka-focused data solutions. Familiarity with Kubernetes and development in Java/Python required.
Top Skills:
AnsibleClaudeHadoopJavaKafkaKubernetesLinuxPrometheusPuppetPythonS3S3-Compatible Enterprise StorageYarn
Fintech • Machine Learning • Software • Financial Services
Operate and maintain the Performance Team's data platform: ensure reliability, correctness, and performance of ETLs and pipelines; implement quality checks, alerting, runbooks, and automation; troubleshoot GitLab CI/CD and resource bottlenecks; continuously tune workloads for efficiency.
Top Skills:
Data PipelinesETLGitGitlab Ci/CdPandasPysparkPython
Fintech • Machine Learning • Software • Financial Services
The Data Center Engineer will manage physical servers and network hardware, ensuring their installation, maintenance, and troubleshooting, along with overseeing documentation and vendor coordination.
Top Skills:
BashFiber OpticsLinuxNetwork CablingNetwork DevicesPythonServer HardwareStorage Systems
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
