The Dot Collective Logo

The Dot Collective

Data Engineer

Reposted 3 Days Ago
In-Office
London, Greater London, England, GBR
Mid level
In-Office
London, Greater London, England, GBR
Mid level
The Data Engineer will implement cloud-native data platforms, engineer scalable pipelines, and optimize cloud resources using Python and SQL, while applying agile methodologies and cloud automation tools.
The summary above was generated by AI
About The Dot Collective

We are a new generation consultancy based across UK and EU and founded on the premises of the engineering excellence and empowering people to make an impact. 

We work with all modern tech stacks and typically run agile scrum on all our projects.

About you

Are you passionate about data and its transformational powers? Do you like being able to make a huge difference in a limited period of time? We might be just the right place for you.

 

Your key skills and capabilities:

·      Implementing cloud-native data platforms
·      Engineering scalable and reliable pipelines
·      Good knowledge of distributed computing with Spark
·      Understanding of cloud architecture principles and best practices
·      Hands-on experience in designing, deploying, and managing cloud resources
·      Excellent python and SQL skills
·      Agile ways of working
·      Experience in cloud automation and orchestration using tools such as CloudFormation or Terraform
·      Monitoring and performance tuning of cloud-based applications and services

 

Nice to haves: (MLOps): 

  • Model Deployment & Serving – Deploy and manage ML models using MLflow, Azure ML, SageMaker, or similar, ensuring scalability and performance. 
  • Monitoring & Retraining – Set up model drift detection, performance monitoring, and automated retraining  
  • ML Pipelines & CI/CD – Automate end-to-end ML workflows 

We expect you to have some knowledge about how to architect, design, develop, deploy, and operate a data platform. 

Our promise to you

We will always see you as a human being and will do our very best to support your needs and wellbeing – well-designed co-working and collaboration spaces, remote working patterns that work for you, parenting leave, sabbaticals and ability to work on personal projects.

We believe that a geled team is worth its weight in gold – we will do everything we can to avoid breaking well-performing teams. Whilst continuity across every project is not always possible, we thoughtfully assemble high-performing, blended teams with the appropriate levels of experience and expertise to deliver the best outcomes for our clients — and teams you’ll enjoy working with.

We are committed to prioritising the wellbeing of our employees. To fulfill this promise, we provide a comprehensive employee wellbeing program that includes mental health support, flexible working arrangements, wellness activities, and a positive work culture.

We recognise that the world of tech delivery has moved on significantly in the last 15 years and know a thing or two about how to bring projects over the line without experiencing lots of despair and burn-out. In fact, we like to believe that our projects are the opposite of that – they are run smoothly and most of the time are fun to work on. 

Similar Jobs

9 Days Ago
Easy Apply
Hybrid
London, England, GBR
Easy Apply
Senior level
Senior level
Artificial Intelligence • Machine Learning • Software
Design, build, deploy, and optimize distributed big-data ingestion, standardization, and ML pipelines at scale. Support platform reliability, cost controls, security accreditations, and customer integrations. Serve as technical lead in client meetings, mentor engineers, and recommend tools and best practices for data pipeline development and deployment.
Top Skills: AWSAzureDatabricksDatadogDockerEc2GCPGitIamKubernetesOpensearchPostgresPythonRest ApisS3SparkSQLTerraform
15 Days Ago
In-Office
Entry level
Entry level
Digital Media • Gaming • Software • Esports • Automation
Build and maintain near-real-time and batch regulatory reporting systems. Migrate legacy SQL Server solutions to GCP BigQuery, design cloud-native data models and ETL/ELT pipelines, implement validations, monitoring, CI/CD and IaC, apply AI-assisted tooling, perform QA and documentation, and collaborate with senior engineers to ensure accurate, traceable regulator-ready outputs.
Top Skills: Claude CodeGCPGitGitlabGoogle BigqueryGoogle Cloud ComposerGoogle Cloud FunctionsGoogle Cloud StorageGoogle Pub/SubMicrosoft Sql ServerSQLTerraform
15 Days Ago
In-Office
Mid level
Mid level
Digital Media • Gaming • Software • Esports • Automation
Build and maintain near-real-time and batch regulatory reporting systems. Migrate legacy SQL Server reporting to GCP BigQuery, design cloud-native data models and ETL/ELT pipelines, implement validation, monitoring, CI/CD and IaC, and apply AI-assisted tooling to improve accuracy, traceability and performance for regulatory submissions.
Top Skills: Ci/CdClaude CodeCloud ComposerCloud FunctionsCloud StorageEltETLGCPGitGitlabGoogle BigqueryMicrosoft Sql ServerPub/SubSQLTerraform

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account