Design, develop, and optimize enterprise-scale Snowflake data warehouses, pipelines, models, queries, and workflows. Build ingestion and transformation processes with Python, PySpark, Airflow, and AWS. Ensure data quality, governance, security, compliance, performance, and cost efficiency. Automate deployment and monitoring through CI/CD and DevOps practices, troubleshoot production issues, and collaborate with stakeholders and engineering teams. Provide technical leadership, lead discussions, and mentor engineers.
Role Summary
We are seeking a highly skilled Senior Data Engineer with 8–15 years of experience in designing, developing, and implementing enterprise-scale data solutions. The ideal candidate will possess strong expertise in Snowflakeand hands-on experience with Python, PySpark, AWS, and Airflow for building scalable, high-performance data platforms. The role demands strong technical leadership, problem-solving capabilities, and the ability to collaborate effectively with cross-functional teams to deliver robust data engineering solutions.
Key Responsibilities
- Design, develop, and optimize data pipelines and data models using Snowflake for enterprise analytics and reporting
- Write and optimize complex SQL / PL‑SQL queries, procedures, and transformations to support large‑scale data processing
- Build and optimize enterprise data warehouse solutions on Snowflake.
- Develop data ingestion, transformation, and orchestration workflows using Python, PySpark, and Airflow.
- Develop and optimize complex SQL queries, stored procedures, views, streams, and tasks in Snowflake.
- Implement scalable cloud-based data solutions leveraging AWS services.
- Ensure data quality, governance, security, and compliance across the data platform.
- Perform query tuning, performance optimization, and cost optimization within Snowflake.
- Automate deployment and monitoring through CI/CD and DevOps practices.
- Collaborate with business stakeholders, architects, analysts, and engineering teams to translate business requirements into technical solutions.
- Troubleshoot production issues and implement preventive measures to enhance platform reliability.
Preferred Experience
- Experience in large-scale cloud data migration initiatives.
- Strong understanding of enterprise data architecture and modern data platforms.
- Experience working with structured, semi-structured, and unstructured data.
- Exposure to Banking, Financial Services, or other large enterprise environments will be an added advantage.
- Experience in leading technical discussions and mentoring engineering teams.
Similar Jobs
Fintech • Mobile • Payments • Software • Financial Services
Lead data architecture and resiliency for marketing data pipelines. Build scalable Airflow/dbt workflows, productionize CDP datasets, own MarTech integrations, bridge engineering and analytics, and mentor engineers to improve reliability and observability for high-volume streaming and batch systems.
Top Skills:
AirflowApache IcebergBrazeCustomer Data Platform (Cdp)DbtEvent StreamingHightouchKafkaKafka StreamsPythonReverse EtlTrino
Financial Services
Lead software engineering initiatives for data platforms within an agile team. Provide technical guidance, develop and review secure production code, solve complex design and functionality problems, and influence application architecture and technical operations. Drive responsible adoption and governance of AI-assisted engineering tools, including code review, refactoring, testing, troubleshooting, and incident analysis. Serve as a subject matter expert, promote engineering standards, and contribute to firmwide software development practices.
Top Skills:
Ai-Assisted Software Development ToolsCloud-Native TechnologiesSoftware Development Life Cycle (Sdlc) ToolsTest Automation
Financial Services
Designs and maintains scalable data pipelines and real-time streaming applications using Java, Kafka, AWS, and Python. Develops batch and streaming ETL processes, optimizes low-latency data flows, integrates cloud services, and collaborates with engineers, analysts, and data scientists. The role also requires documentation, security and compliance adherence, production support, and use of authorized AI capabilities for data engineering and operational workflows.
Top Skills:
Amazon Ec2Amazon RdsAmazon S3Apache KafkaAWSAws GlueAws LambdaDockerETLFixGitJavaKubernetesNoSQLPythonScalaSQL
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
