Senior Data Engineer

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Senior Data Engineer
 

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. An ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work® Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.

Please visit Fractal | Intelligence for Imagination for more information about Fractal.

Location: London, UK.

Position Overview:

We are seeking a highly experienced Senior Data Engineer to join our team onsite and play a critical role in the implementation and optimization of the Digital Data Foundation (DDF). The ideal candidate will possess strong expertise in data engineering, including proficiency in the Simpel framework, advanced Python programming, and hands-on experience with Azure Databricks and PySpark. This role focuses on designing scalable, high-performance data solutions to meet business-critical needs.

Key Responsibilities:

• Design, develop, and manage data pipelines for ingestion, transformation, and integration using the Simpel framework.

• Work with Azure Databricks, configuring clusters, managing jobs, tasks, tokens, secrets, and leveraging Delta Tables for efficient data storage and processing.

• Write, optimize, and debug PySpark scripts to handle large-scale data processing tasks.

• Develop, test, and distribute Python code using wheel files for package management.

• Collaborate with cross-functional teams to implement data models aligned with the Common Data Model (CDM) standards.

• Perform data validation and quality checks to ensure reliability and integrity of data workflows.

• Leverage Git for version control and code collaboration.

Qualifications:

• Programming Skills:

  • Proficiency in Core Python, including data types, operators, control flow, functions, modules, and OOP concepts such as classes, objects, and inheritance.

• Data Engineering Expertise:

  • Experience with PySpark for distributed data processing.

  • Proficiency in Azure Databricks, including clusters, jobs, tasks, tokens, secrets, and Delta Tables.

• Simpel Framework: Proven ability to design and manage data pipelines using Simpel.

• Version Control: Hands-on experience with Git for version control and collaborative coding.

• Package Management: Knowledge of generating and distributing Python wheel files.

• Data Modeling: Experience in implementing data transformations aligned with the Common Data Model (CDM).

Preferred Qualifications:

• Familiarity with Terraform for Azure resource provisioning and management.

• Knowledge of Databricks Unity Catalog for data governance.

• Understanding of Azure Event Grid and Azure Resource Tagging.

• Industry experience in Consumer Packaged Goods (CPG) or similar domains.

• Proficiency in analytics tools like Power BI or Tableau.

Education:

• Bachelors or equivalent experience in statistics, computer science, engineering, informatics, data science, or related field; additional business degree is a plus

Fractal Analytics provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!