Mars

Platform Data Engineer

Reposted 21 Days Ago

Be an Early Applicant

In-Office

London, England

Mid level

In-Office

London, England

Mid level

The role involves engineering and maintaining a data platform on Azure, developing tools, collaborating with users, and utilizing infrastructure as code practices.

The summary above was generated by AI

Job Description:

What are we looking for?

Essential Requirements:

Proven experience in data platform engineering, including building, developing, and optimising data infrastructure.

Proficient primarily in Terraform, with strong experience in Infrastructure as Code, DevOps pipelines, and scripting using Bash and PowerShell.

Proficiency in Python.

Expertise in Azure cloud services and infrastructure as code (e.g., Azure Resource Manager templates, Terraform) and DevOps Pipelines such as Azure DevOps Pipelines or GitHub Actions.

Excellent communication skills being able to explain complex platform concepts to both data engineers and business users.

Nice to Haves:

Bachelor's or master's degree in computer science, Information Technology, or a related field

Experience with containerisation and orchestration technologies (e.g., Docker, Kubernetes).

Knowledge of big data technologies and frameworks (e.g., Hadoop, Spark).

Familiarity with other cloud platforms (e.g. AWS, Google Cloud) and PaaS providers (e.g. Snowflake)

Knowledge of Inner or Open Source paradigm and way of working

Knowledge of Cloud (Azure) Networking and Security Standards

Key Responsibilities:

Data Platform Engineering: Contribute to designing, developing, and maintaining our data platform and core toolsets on the Azure cloud. Ensure the platform is highly available, scalable, and performs optimally.

Data Tools and Frameworks Development: Contribute to developing and implementing data platform tools and frameworks on Azure to support the organisation's data needs. Collaborate with other teams to align data infrastructure with business objectives.

Collaborate and support platform users: Work alongside other data teams and business users to help understand their requirements of the platform and support in a third-line capability as and when needed.

Infrastructure as Code: Utilise Azure infrastructure as code practices to automate the provisioning and management of data platform resources. Ensure consistency, repeatability, and efficiency in infrastructure deployment.

Technology Evaluation: Stay up-to-date with emerging technologies and industry best practices in data engineering and Azure cloud services. Evaluate and recommend new tools and technologies to enhance the data platform's capabilities and efficiency.

#TBDDT

Top Skills

AWS

Azure

Azure Devops

Bash

Docker

Github Actions

GCP

Hadoop

Kubernetes

Powershell

Python

Snowflake

Spark

Terraform

Similar Jobs

Cloudflare

Senior Systems Engineer

10 Days Ago

Hybrid

Senior level

Cloud • Information Technology • Security • Software • Cybersecurity

As a Senior Engineer, you will develop and manage Cloudflare's storage and database solutions, ensuring high performance and innovative data products. Responsibilities include coding, architecture, and optimizing large-scale distributed systems.

Top Skills: C++JavaScriptRustTypescript

Spotify

Infrastructure Engineer

4 Days Ago

Hybrid

London, Greater London, England, GBR

Mid level

Music

As a Data Infrastructure Engineer, you'll develop and maintain efficient data pipelines and backend systems, ensuring reliability and scalability for data collection and consumption at Spotify.

Top Skills: Apache BeamDataflowGkeGoogle Cloud Pub/SubJavaScalaScio

Checkout.com

Platform Engineer

10 Days Ago

Hybrid

London, Greater London, England, GBR

Senior level

Cloud • eCommerce • Fintech • Payments • Financial Services

The role involves building a large-scale event streaming platform, mentoring teams, supporting cloud-based technologies, and developing streaming applications using tools like Kafka and Flink.

Top Skills: AWSC#Ci/CdDockerFlinkJavaKafkaKubernetesPythonSQLTerraform

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.