Westpac Logo

Westpac

Senior Data Engineer

Posted 9 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in Square, Newry Mourne and Down, Northern Ireland, GBR
Senior level
Remote
Hiring Remotely in Square, Newry Mourne and Down, Northern Ireland, GBR
Senior level
Lead and mentor a squad building and operating CDC and streaming data pipelines from DB2/VSAM/Oracle to Kafka and HDFS. Ensure platform reliability, security, compliance, incident response, scalable designs, service SLAs, tooling standards, and stakeholder/vendor management while driving continuous improvement.
The summary above was generated by AI

Mō te tūranga | About the Role

The Senior Data Engineer not only provides expert domain knowledge and expertise in the area they are working in, but as a senior member of the squad, provides mentorship and guidance to others. They operate with greater scope within the service group, wider technology business unit and with business stakeholders to ensure high levels of Service Delivery are maintained and an overarching focus on risk and compliance is always front of mind in the squad.

Communication, negotiation, collaboration and teamwork, and partnership/relationship building skills are key to achieving desired outcomes in this role. In particular to enable the delivery of great innovative banking products that continue to enhance our customers’ experience.

The CDC Squad develops and maintains the data pipelines that capture changes from hundreds of tables across DB2 z/OS, DB2 LUW, VSAM, and Oracle and stream them to Kafka and HDFS. Our data supports analytics, regulatory reporting, and other engineering squads across the bank. We also do other work from time to time to support the wider service group.  

What you’ll do:

  • Provide technical leadership and guidance within the squad, shaping engineering practices, solution design, and platform stability.
  • Ensure CDC platforms, data products, and pipelines remain reliable, secure, compliant, and aligned with organisational risk and regulatory requirements.
  • Drive the resolution of complex production issues, including coordinating on-call coverage, early life support and critical incident response.
  • Translate business and architecture requirements into scalable technical designs, ensuring consistency with wider Technology patterns and standards.
  • Maintain and improve service operations by ensuring SLAs, monitoring, and system health metrics are consistently met.
  • Contribute to squad level standards for engineering quality, tooling, coding practices, documentation, and deployment processes.
  • Mentor engineers, fostering technical growth, capability uplift, and a culture of excellence across the squad.
  • Support prioritisation alongside Leads, Service Owners, and Delivery Leads, advising on scope, timelines, and technical dependencies.
  • Lead problem investigations, root‑cause analysis, and continuous improvement initiatives to enhance platform stability and performance.
  • Manage relationships with internal stakeholders, third‑party vendors, and platform partners to ensure the delivery of high‑quality outcomes.

Nā tāu rourou | What will you bring?

  • 5+ years of experience in software development, data engineering, platform engineering, or a related technical discipline.
  • Solid understanding of CDC patterns and data streaming patterns.
  • Strong programming skills in Java and Python.
  • Deep experience with the Kafka stack, building real-time publishers and consumers.
  • Familiarity with the Hadoop stack, particularly HDFS and Spark.
  • Experience orchestrating data workflows with Airflow.
  • Knowledge of data encryption standards and secure software development practices. // Can we get rid of this? Or switch to something like “Awareness of secure software development practices for handling sensitive data”
  • Experience with Terraform, CI/CD pipelines and containerisation.
  • Familiarity with code quality and security scanning tooling such as SonarQube and Snyk.
  • Demonstrated ability to assess new technologies, review vendor solutions, and recommend improvements to existing engineering approaches.
  • Proven capability in diagnosing and resolving complex technical issues throughout the application lifecycle.
  • Strong understanding of quality assurance, testing frameworks, and continuous improvement.
  • Tertiary qualifications in Computer Science, Information Systems, Engineering, or related discipline, with relevant technical certifications preferred.
  • Demonstrated ability to mentor, support and grow engineers.
  • Comfortable in Agile delivery and modern DevOps practices.

Westpac Hei Wāhi Mahi | Working at Westpac EDIT ACCORDINGLY FOR FIXED TERM/CASUAL
In addition to immersing yourself in a supportive team environment, you'll receive some great job perks and benefits including:

  • 4 weeks standard holiday + 5 additional days of wellbeing leave to support you to be your best
  • Additional purchased leave options up to 4 weeks per year
  • Banking benefits, insurance discounts and superannuation scheme
  • Growth and development – we provide opportunities for development and promote internal mobility
  • Recognition - we recognise and reward our star performers
  • School holiday subsidy - help you balance work and family during school holiday
  • 2 Volunteer days per year

Ko mātou tēnei | Our Organisation
At Westpac, we’re working together to build a fairer and stronger New Zealand for our people, customers, and communities. For over 160 years we’ve been driven by our purpose to Create Better Futures Together.

What makes us unique are the incredible people we’re lucky enough to have walk through our doors every day. The giant ‘W’ on our building doesn’t just stand for Westpac – it says, double you. We’re a place that values, rewards and recognises individuality. Where you can be your whole self, your true self, and your best self. We’re recognised as a place where talent is developed, where passions are fuelled and where ambitions of all shapes and sizes thrive. And it all starts with you!

Tono mai ināianei! | Apply Now!

Apply today with your CV and Cover Letter. 

The people of Aotearoa, New Zealand hail from many cultures and backgrounds. At Westpac New Zealand, we draw on this enormous talent pool to cultivate a team rich in ability and empowered to reach its full potential. Our aim is to be brave challengers, celebrating our differences and relentlessly advocating for our customers. It starts with us – we believe that when we care deeply and do our best for our people, they’ll do their best for our customers. We encourage people from all walks of life to apply, including those who are neurodiverse, have chronic health conditions or disabilities – your attitude and passion are as important to us as your experience, qualifications and capabilities. 

Mahi tahi tātou, kaha ake tātou | Together Greater

Applications close:

22 July 2026

Similar Jobs

Yesterday
Remote
United Kingdom
Senior level
Senior level
Artificial Intelligence • Blockchain • Internet of Things • Machine Learning • Software
Own and operate Databricks-based data platform production support, build and migrate ETL/ELT pipelines to Databricks across Azure/AWS, optimize compute and performance, enforce Delta Lake architecture and data security, implement observability and CI/CD, support multi-tenant onboarding and on-call incident response, and maintain runbooks and SLA metrics.
Top Skills: SparkAWSAzureCi/CdDatabricksDatabricks Feature StoreDelta LakeFeastInformaticaInfrastructure As CodeMicrosoft Sql ServerPostgresPysparkPythonRole-Based Access ControlSecrets ManagementServerless ComputeSQLSsis
9 Days Ago
Remote
UK
Senior level
Senior level
Artificial Intelligence
Build and maintain scalable data pipelines and platform components to serve analytics, ML, and product teams. Design data services/APIs, ensure data quality, observability, security and compliance, and evolve cloud-native infrastructure using IaC and Kubernetes. Partner with cross-functional teams, produce documentation, and ship reliable, tested data solutions.
Top Skills: AirflowArgoDbtJavaKubernetesPythonScalaSQLTerraform
9 Days Ago
Remote
UK
Senior level
Senior level
Cloud • Software
Build, test, and document secure batch and real-time data pipelines for a government client; design logical and physical databases; extend platform capabilities; ensure data models align with architecture; perform data analysis and root-cause investigations to improve processing and availability for downstream consumers.
Top Skills: AnsibleAws AthenaAws Ec2Aws GlueAws LambdaAws RdsDroneJenkinsLinuxNoSQLPackerPythonRelational DatabasesTerraformWindows

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account