DATAPAO Logo

DATAPAO

Senior Data Engineer (Databricks) - UK

Job Posted 20 Days Ago Posted 20 Days Ago
Be an Early Applicant
United Kingdom
Senior level
United Kingdom
Senior level
The Senior Data Engineer will manage complex projects, lead teams, and develop data engineering solutions using Databricks and cloud technologies.
The summary above was generated by AI

At DATAPAO, data ignites passion, community fuels collaboration, and growth knows no bounds. We are a leading Data Engineering and Data Science consulting company, recognized for our innovation and rapid growth. We have been named Databricks EMEA Emerging Business Partner of the Year and have achieved a second consecutive appearance on the Financial Times FT1000 list.

We are currently looking for a Senior Data Engineer to join us remotely in the UK. We plan to set up a hub in the UK in the following 12-18 months to enable our GTM strategy, and this would be our first hire in the region. You will work with our EMEA and US customers to help them solve their data engineering, ML, ML Ops, and cloud migration puzzles.

"As a Data Engineer at DATAPAO, you will have the unique opportunity to push the boundaries of technology and lead the way in how data transforms the world. We work with customers who want to innovate and change their industries. So it never gets boring! Sorting out a complex technical puzzle, setting up a new data architecture from scratch, or guiding our customers through adopting the latest technologies is our routine here. Hence, we'd expect you to be more than just a (data) engineer. We'd expect you to breathe and live data, to thrive for knowledge and excellence, and to be keen to build something enduring and impactful for our customers. We'd expect you to be a (data) Paoneer!"  (Máté Gulyás, CEO)

What will you do?

As a Senior Data Engineer, you are expected to deliver (across industries) on some of our most complex projects - individually or by leading small delivery teams. Although we work for the biggest multinational companies where years-long behemoth projects are the norm, our projects are fast-paced, typically 2 to 4 months long. Most are delivered using Apache Spark/Databricks on AWS/Azure and require you to directly manage the customer relationship alone or in collaboration with a Project Manager. Additionally, at this seniority level, we expect you to compound your impact across the team and the organization - by supporting our pre-sales process, mentoring more junior engineers, and contributing to hiring best-in-class data talent.

What does it take to fit the bill?

Technical Expertise

  • You (ideally) have 5+ years of experience in Data Engineering, with a focus on cloud platforms (AWS, Azure, GCP);
  • You have a proven track record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog);
  • You have extensive experience in ETL/ELT development and data pipeline orchestration (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions.);
  • You’re proficient in SQL and Python, using them to transform and optimize data like a pro;
  • You know your way around CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation, or Bicep);
  • You’ve hands-on experience integrating Databricks with BI tools (Power BI, Tableau, Looker).

 Consulting & Client-Facing Skills

  • Ideally, you bring a proven history in consulting, from scoping to gathering requirements, designing solutions, and communicating effectively with stakeholders. If you bring a product company background with you, that's also fine as long as you can show a good consulting mindset and desire to be customer-facing;
  • You’ve successfully delivered projects like Data Lakehouse buildouts and cloud data migrations;
  • You excel in explaining technical concepts to non-technical audiences and drive decision-making.

Operational Readiness & Soft Skills

  • You’re (almost) ready to hit the ground running, immediately contributing to live client projects;
  • In a fast-paced consulting environment, where no two days are the same, flexibility and problem-solving comes naturally to you. Furthermore, resilience and thriving on challenges are essential traits in our industry;
  • Your communication skills are on point—whether you’re writing, speaking, or collaborating with stakeholders, you know how to keep everyone in the loop.

What do we offer?

You'll have the rare opportunity to join DATAPAO at a time when you can still meaningfully impact our growth trajectory and organizational success. Furthermore, as our first-ever UK hire, you’ll also get to spearhead our regional expansion.

Surely, we know everyone needs a little something to do their best work. Here is a list of some other extras we offer:  

  • The chance to work remotely - as we don't have a physical office in the UK yet, we offer a fully remote setup for the time being. However, given our strong community emphasis, we'd expect you to spend one month in our Budapest hub during onboarding and visit the office for one week every quarter;
  • World-class educational benefits - there’s no shortage of learning opportunities at DATAPAO, meaning that you'll get access to Databricks' public and internal courses to learn all the tricks of Distributed Data Processing, MLOps, Apache Spark, Databricks, and Cloud Migration from the best. Additionally, we'll pay for various data & cloud certifications, you'll get dedicated time for learning during work hours, and access to our internal library; 
  • Flexible PTO days - we’re flexible with how many days you take off if that does not conflict with customer success and the work getting done;
  • 4 weeks of paternity leave - because we think it’s important for both parents to be there when it matters the most;
  • Employee Assistance Program (EAP) - life always happens! And we'd like to be there for you when it counts the most. Through EAP, we offer our employees access to psychology, financial, and legal consulting services via phone or in person;
  • Pension scheme enrollment and a comprehensive private health insurance plan - offered via our EOR (Employer of Record) provider, Remote.com. Remote will be your official employer in the UK for the foreseeable future until we establish our own legal entity in the UK;
  • Top-notch working equipment - working comfortably means working well. You will get a MacBook Pro, a phone, and a sign-up bonus of 1000 GBP gross (to be paid with your first payroll) to set up your home office or whatever else is needed to give your best;
  • The chance to make an impact in a high-transparency culture - open feedback and no politics are things we value a lot at DATAPAO. Additionally, you'll get the chance to work in the field of data & AI and shape the future of a rapidly growing tech company.

IMPORTANT NOTE: Given that we are still sorting our ways out in the UK, this list will likely get an update in the following months, and we're also committed to growing it with us over time.

The gross salary for this position ranges from 70.000 to 100.000 GBP/year, depending on your assessed seniority level during the selection process.

Please note that currently we are unable to support transfer or offer full sponsorship for Skilled Worker visas as we’re just setting foot into the UK.

About DATAPAO

At DATAPAO, we are delivery partners and the preferred training provider for Databricks, the creators of Apache Spark. Additionally, we are Microsoft Gold Partners in delivering cloud migration and data architecture on Azure. Our delivery partnerships enable us to work in a wide range of industries and with some of the most prominent global companies such as Norsk-Hydro, Richter, Bayer, Schufa, GetYourGuide, TechnoAlpin and Logically to name just a few.

As a training provider, we deliver onsite and online courses globally for Databricks and on our own. We have been teaching professionals at Apple, Amazon, Uber, Microsoft, T-Mobile, GE, Ericsson, and many more to improve their impact with data.

For more insights into DATAPAO, check the below links:

  • Designing and Implementing a Real-time Data Lake with Dynamically Changing Schema (EN) by Máté Gulyás (2021, Spark AI Summit)
  • Productionising Machine Learning models (EN) by Máté Gulyás (2023, Mndwrk Event)
  • "Ha a data governance jól működik, az olyan, mint egy láthatatlan szupererő” (HU) by Máté Gulyás (2023, Com-Forth Zóna Podcast)

You can also follow us on LinkedIn for all the good stuff or just hit our recruitment team at jobs@datapao.com

We’re strong believers in scaling up a team without judgment or prejudice. What we really care about is working with the best people out there, no matter their background. And you should also not worry if you don't tick every box in the requirements. If you’re passionate about data and learning new things, you’ll fit right in, and we'd love to hear back from you.

When we hear back from you, we'd like you to know that we are committed to your privacy and keeping your data safe. We do not share your data with any third parties (except the ones we use to run our recruitment process) and keep your application for two years unless you ask us otherwise. We use your data solely for recruitment purposes, such as letting you know about new career opportunities at DATAPAO and/or managing your application.


Top Skills

Adf
Airflow
Spark
AWS
Azure
Bicep
Ci/Cd
CloudFormation
Databricks
Databricks Workflows
Delta Lake
Dlt
Elt
ETL
GCP
Glue
Looker
Power BI
Pyspark
SQL
Step Functions
Tableau
Terraform
Unity Catalog

Similar Jobs

4 Hours Ago
Hybrid
London, Greater London, England, GBR
Mid level
Mid level
Financial Services
The Analyst/Associate will support M&A and capital markets transactions, conduct financial analysis, and mentor junior team members, contributing to client strategies and presentations.
Top Skills: ExcelPowerPoint
5 Hours Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Financial Services
As a Vice President, Data Analyst, you will analyze data requirements, collaborate on data governance, enhance data processes, and manage client deliverables.
Top Skills: AlteryxPythonSnowflakeSQLTableau
5 Hours Ago
Hybrid
London, England, GBR
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Senior Data Scientist will develop and implement data science and machine learning solutions to solve business problems, lead technical teams, train junior staff, and transition developments into production environments while collaborating with domain experts.

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account