Pantheon Ventures Logo

Pantheon Ventures

Data Engineer (Databricks)

Job Posted 12 Days Ago Posted 12 Days Ago
Be an Early Applicant
London, England
Mid level
London, England
Mid level
The Data Engineer will design and implement a new Data Warehouse using Azure technologies, focusing on best practices in data pipelining and transformation.
The summary above was generated by AI

Pantheon has been at the forefront of private markets investing for more than 40 years, earning a reputation for providing innovative solutions covering the full lifecycle of investments, from primary fund commitments to co-investments and secondary purchases, across private equity, real assets and private credit.

We have partnered with more than 650 clients, including institutional investors of all sizes as well as a growing number of private wealth advisers and investors, with approximately $65bn in discretionary assets under management (as of December 31, 2023).

Leveraging our specialized experience and global team of professionals across Europe, the Americas and Asia, we invest with purpose and lead with expertise to build secure financial futures.

For further details please visit www.pantheon.com

Company Profile

 

Pantheon is an international investor in private equity, infrastructure & real assets and debt that invests on behalf of over 680 institutional investors (as at June 30, 2021), including public and private pension plans, insurance companies, endowments and foundations. Pantheon’s investment strategies include primary fund programs, secondaries, co-investments, infrastructure, real assets, real estate, private debt and customized programs. Pantheon also manages and advises Pantheon International Plc. (“PIP”), an investment company listed on the London Stock Exchange. Pantheon employs over 383 staff, including a global investment team of 113 investment professionals. Pantheon is headquartered in London with further offices in San Francisco, Hong Kong, Bogotá, Seoul, Tokyo, New York, Dublin and Berlin.

Pantheon is owned by Affiliated Managers Group Inc (“AMG”), alongside senior members of the Pantheon team.  AMG is a NYSE-listed asset management company with equity investments in leading boutique investment management firms.  The ownership structure, with Pantheon management owning a meaningful share of the equity in the business, provides a framework for long-term succession and enables Pantheon management to continue to direct the firm’s day-to-day operations.


For further details, please visit our website: www.pantheon.com



Purpose of Position

Pantheon is undergoing a multi-year programme to build out a new best in class Data Platform using cloud native technologies hosted in Azure. We require an experienced and passionate hands-on Senior Data Engineer to design and implement new data pipelines for adaption to business and/or technology changes. This role will be integral to the success of this programme and establishing Pantheon as a data-centric organisation. 


You will be working with a modern Azure tech stack and proven experience of ingesting and transforming data from a variety of internal and external systems is core to the role.


You will be part of a small and highly skilled team and you will need to be passionate about providing best in class solutions to our global user base.

Key Responsibilities

Pantheon require a highly capable, enthusiastic and experienced individual to join our team who will design and implement development activities to build out a new best in class Data Warehouse in cloud native Azure technology. The Data Engineer will design and execute development activities across projects ensuring that the software produced is written in a standard, maintainable and efficient manner.

To be successful in the role you will be expected to:

  • Provide technical expertise in designing and implementing solutions, including determining root causes for complex data issues & developing practical efficient & permanent solutions.
  • Carry out design, code, and test peer reviews throughout project providing technical guidance and to identify issues.
  • Be a strong advocate for efficient code with extensive experience in delivering working solutions.
  • Advocate and implement agile and lean principles ensuring efficiency within the development process.
  • Collaborate with the Data QAs to implement appropriate testing, policies, and standards.
  • Be a proactive and independent individual who drives quality within the organization.





Essential Technical Skills

  • Experience in designing and developing data warehouse solutions.
  • Building and configuring multistage Azure deployment pipelines
  • Advanced SQL, Python, PySpark
  • Azure Data Lake, Data Factory, Databricks and Functions
  • Azure Data Lake Storage Gen2
  • Traditional ETL (Informatica, SSIS etc.)
  • Azure Powershell / CLI
  • Azure Key Vault
  • ARM / Terraform scripts to deploy infrastructure services.

Essential Experience

  • Experience in designing and building data ingestion and transformation pipelines, data lake, data warehouse / data marts etc.
  • Experience working with Agile development methodologies such as Kanban/Scrum
  • A natural problem-solving attitude.
  • Conversant with current industry and technology trends.
  • Experience with dealing directly with stakeholders and business users

Desired Experience

  • Power BI
  • Business Objects Reporting

This job description is not to be construed as an exhaustive statement of duties, responsibilities, or requirements. You may be required to perform other job-related duties as reasonably requested by your manager.

Pantheon is an Equal Opportunities employer, we are committed to building a diverse and inclusive workforce so if you're excited about this role but your past experience doesn't perfectly align we'd still encourage you to apply.



Top Skills

Arm
Azure
Azure Cli
Azure Data Lake
Azure Data Lake Storage Gen2
Azure Powershell
Data Factory
Databricks
Informatica
Pyspark
Python
SQL
Ssis
Terraform

Pantheon Ventures London, England Office

4th Floor, 10 Finsbury Square,, London, United Kingdom, EC2A 1AF

Similar Jobs

2 Days Ago
Hybrid
London, England, GBR
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Principal Azure Data Engineer, you will design and develop data pipelines, implement best practices, and engage with clients to optimize data solutions in financial services.
Top Skills: Azure DatabricksAzure DevopsAzure Event HubsCi/CdCircleCIDeltalakeGithub ActionsHadoopHdfsHiveJenkinsKafkaNoSQLPysparkPythonSparkSQL
2 Days Ago
Hybrid
London, England, GBR
Mid level
Mid level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As an Azure Data Engineer at Capco, you will design and develop data pipelines, work with clients on solutions, and ensure adherence to best practices in engineering and SDLC.
Top Skills: Azure DevopsAzure Event HubsCircleCIClouderaDatabricksDeltalakeGithub ActionsHadoopHdfsHiveJenkinsKafkaNoSQLOrchestrationPysparkPythonSparkSpark Structured StreamingSQLUnity Catalog
15 Days Ago
Hybrid
London, England, GBR
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Senior Azure Data Engineer, you will lead the development of data solutions, automate processes, and optimize data pipelines for financial services clients.
Top Skills: AzureAzure DevopsAzure Event HubsCi/CdCircleCIClouderaDatabricksDeltalakeGithub ActionsHadoopHdfsHiveJenkinsKafkaNoSQLPysparkPythonSparkSQL

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account