Data Engineer

What you will deliver

• Monitoring daily BAU data pipelines and ensure our data solution is refreshed up to date every day

• Working with the team within an Agile framework using agile methodology tooling that controls our development and CI/CD release processes

• Get up to speed with existing data infrastructure, tools, and processes.

• Monitoring and responding to IT incidents.

• Build familiarity with key pipelines/processes and support documentation and enhance documentation.

• Begin proactive monitoring and suggest quick wins for stability and efficiency.

• Working on incident RCA along with other engineers within the team.

• Create and maintain technical documentation, RCA reports, and knowledge base articles.

• Implement monitoring dashboards and alerts for key jobs and data quality checks.

• Mentor junior engineers or act as a technical go-to for pipeline and cloud topics.

Your Skills and Experience

Essential

• Experience with data solution BAU processes (ETL, table refresh etc.)

• Experience in Big Data data integration technologies such as Spark, Kafka

• Experience in programming language such as Python.

• Experience using AWS (Athena, Glue, EMR, Step functions, Cloud watch), DBT and Snowflake.

• Analytical and problem-solving skills, applied to data solution

• Experience of CI/CD

• Experience in handling IT incidents.

• Experience with IT incident management process.

• Basic understanding of event streaming.

• Basic knowledge on Scala(nice to have).

Desirable

• Experience of ETL technologies

• Previous exposure to own data solution BAU monitoring and enhancement

• Exposure to grafana

#LI-Hybrid

#LI-TM1

At NewDay, we value all types of diversity. We’re an equal opportunity employer and believe that our differences create a vibrant, authentic working culture. We want all our colleagues to feel able to bring their whole selves to work. We don’t discriminate on the basis of protected characteristics or identities. We make sure that every job is crafted to be inclusive and that people with disabilities or caring responsibilities can take part in the application and interview process.

Tell us if you need accommodations: We’ll put reasonable adjustments in place to support you.

We work with Textio to make our job design and hiring inclusive.