Design, develop, and optimize enterprise-scale Snowflake data warehouses, pipelines, models, queries, and workflows. Build ingestion and transformation processes with Python, PySpark, Airflow, and AWS. Ensure data quality, governance, security, compliance, performance, and cost efficiency. Automate deployment and monitoring through CI/CD and DevOps practices, troubleshoot production issues, and collaborate with stakeholders and engineering teams. Provide technical leadership, lead discussions, and mentor engineers.
Role Summary
We are seeking a highly skilled Senior Data Engineer with 8–15 years of experience in designing, developing, and implementing enterprise-scale data solutions. The ideal candidate will possess strong expertise in Snowflakeand hands-on experience with Python, PySpark, AWS, and Airflow for building scalable, high-performance data platforms. The role demands strong technical leadership, problem-solving capabilities, and the ability to collaborate effectively with cross-functional teams to deliver robust data engineering solutions.
Key Responsibilities
- Design, develop, and optimize data pipelines and data models using Snowflake for enterprise analytics and reporting
- Write and optimize complex SQL / PL‑SQL queries, procedures, and transformations to support large‑scale data processing
- Build and optimize enterprise data warehouse solutions on Snowflake.
- Develop data ingestion, transformation, and orchestration workflows using Python, PySpark, and Airflow.
- Develop and optimize complex SQL queries, stored procedures, views, streams, and tasks in Snowflake.
- Implement scalable cloud-based data solutions leveraging AWS services.
- Ensure data quality, governance, security, and compliance across the data platform.
- Perform query tuning, performance optimization, and cost optimization within Snowflake.
- Automate deployment and monitoring through CI/CD and DevOps practices.
- Collaborate with business stakeholders, architects, analysts, and engineering teams to translate business requirements into technical solutions.
- Troubleshoot production issues and implement preventive measures to enhance platform reliability.
Preferred Experience
- Experience in large-scale cloud data migration initiatives.
- Strong understanding of enterprise data architecture and modern data platforms.
- Experience working with structured, semi-structured, and unstructured data.
- Exposure to Banking, Financial Services, or other large enterprise environments will be an added advantage.
- Experience in leading technical discussions and mentoring engineering teams.
Similar Jobs
Fintech • Mobile • Payments • Software • Financial Services
Lead data architecture and engineering for Wise’s marketing platform, building resilient high-volume streaming and batch pipelines with Python, dbt, Airflow, Kafka, Trino, and Iceberg. Develop unified customer data platform datasets, own MarTech integrations, establish data quality and reliability standards, scope ambiguous technical problems, and mentor software engineers. Partner closely with marketing, product, analytics, and engineering stakeholders to deliver scalable acquisition infrastructure.
Top Skills:
Ai/Ml Data IntegrationAirflowApache IcebergBatch Data PipelinesBig DataBrazeData ArchitectureData Quality FrameworksDbtHightouchKafkaKafka StreamsPythonReverse EtlStreaming Data PipelinesTrinoVendor Api Integrations
Fintech • Payments • Financial Services
Design and maintain scalable data platform infrastructure, ingestion pipelines, ETL/ELT workflows, data models, governance, reliability, and observability. Collaborate with analytics and engineering teams, support data warehouse architecture, participate in on-call incident response, document operational processes, and establish strong engineering practices for analytics and future AI capabilities.
Top Skills:
AirbyteAirflowApache IcebergCi/CdDbtDltDockerFlinkGitJavaKafkaKafka ConnectKubernetesPythonSnowflakeSQLTerraform
Enterprise Web • HR Tech • Information Technology • Software • Cybersecurity
Develop and maintain customer-facing analytical reporting, data pipelines, and data models. Build Python applications, ensure data quality and consistency, collaborate with analytics engineers, and enable business teams to access actionable data. The role also involves cloud data warehouse optimization, infrastructure as code, software engineering best practices, and cross-functional product collaboration within an agile SaaS environment.
Top Skills:
AWSAzureBigQueryCloudFormationContinuous IntegrationDbtFlaskGCPGitLookerPlotlyPower BIPythonRedshiftSnowflakeSQLSqlalchemyTerraform
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
