AWS Data Engineer

Introduction

We are looking for an experienced AWS Data Engineer to join our team to support the development of the Customer Data Platform (CDP) project. As a Data Engineer, you will work closely with the Lead Engineer, Business Analysts and third-party professional services to lay the groundwork to enable the business to truly become data-driven, creating the one source of truth for our customer data.

Responsibilities

• Designing, building and maintaining the data lake solution and associated pipelines

• Develop and own the data strategy on coding best practices

• Contribute to the overall architecture by identifying gaps and efficiencies in the design

• Ensuring that data quality is considered at every point of the data journey and working closely with the business to ensure the correct rules and identifiers are in place

• Coaching the junior members of the Data team to be more cloud engineering focussed

• Maintaining, testing and implementing disaster recovery procedures.

Skills/Qualifications

• 5+ years as a Data Engineer within the AWS cloud environment

• Hands-on experience with the following:

o S3/Redshift

o AWS Glue

o AWS Lambda

o API Gateway

o Amazon AppFlow (Desirable)

o FindMatches (Desirable)

• Expertise in moving and transforming data using Python, Spark & Scala

• Experience in using REST APIs for data transfer

• Solid understanding of master data management and its integration into the broader infrastructure

• Knowledge and experience with testing, releasing, and CI/CD pipeline deployments into AWS using tools like Bitbucket, Jenkins, ServiceNow

• Understanding of Agile methodologies, processes and procedures

• Demonstrated ability to be a self-starter and take ownership of their work

• Experience in using SalesForce would be considered an advantage

dmg events is an equal opportunity employer. If you have not had feedback from us within 14 days, please consider your application as unsuccessful for this round.