Design, develop, and optimize enterprise-scale Snowflake data warehouses, pipelines, models, queries, and workflows. Build ingestion and transformation processes with Python, PySpark, Airflow, and AWS. Ensure data quality, governance, security, compliance, performance, and cost efficiency. Automate deployment and monitoring through CI/CD and DevOps practices, troubleshoot production issues, and collaborate with stakeholders and engineering teams. Provide technical leadership, lead discussions, and mentor engineers.
Role Summary
We are seeking a highly skilled Senior Data Engineer with 8–15 years of experience in designing, developing, and implementing enterprise-scale data solutions. The ideal candidate will possess strong expertise in Snowflakeand hands-on experience with Python, PySpark, AWS, and Airflow for building scalable, high-performance data platforms. The role demands strong technical leadership, problem-solving capabilities, and the ability to collaborate effectively with cross-functional teams to deliver robust data engineering solutions.
Key Responsibilities
- Design, develop, and optimize data pipelines and data models using Snowflake for enterprise analytics and reporting
- Write and optimize complex SQL / PL‑SQL queries, procedures, and transformations to support large‑scale data processing
- Build and optimize enterprise data warehouse solutions on Snowflake.
- Develop data ingestion, transformation, and orchestration workflows using Python, PySpark, and Airflow.
- Develop and optimize complex SQL queries, stored procedures, views, streams, and tasks in Snowflake.
- Implement scalable cloud-based data solutions leveraging AWS services.
- Ensure data quality, governance, security, and compliance across the data platform.
- Perform query tuning, performance optimization, and cost optimization within Snowflake.
- Automate deployment and monitoring through CI/CD and DevOps practices.
- Collaborate with business stakeholders, architects, analysts, and engineering teams to translate business requirements into technical solutions.
- Troubleshoot production issues and implement preventive measures to enhance platform reliability.
Preferred Experience
- Experience in large-scale cloud data migration initiatives.
- Strong understanding of enterprise data architecture and modern data platforms.
- Experience working with structured, semi-structured, and unstructured data.
- Exposure to Banking, Financial Services, or other large enterprise environments will be an added advantage.
- Experience in leading technical discussions and mentoring engineering teams.
Similar Jobs
Fintech • Mobile • Payments • Software • Financial Services
Design and build low-latency, real-time liquidity observability systems and streaming data pipelines for global financial operations. Architect Kafka and Flink pipelines, develop real-time aggregation and event-driven architectures, model streaming and analytical data, and ensure reliability through idempotency, exactly-once processing, failure recovery, and schema evolution. Collaborate with product, data science, quantitative analysis, and treasury teams to support liquidity positioning, forecasting, and operational visibility.
Top Skills:
Apache FlinkApache KafkaApache Spark StreamingAvroKafka StreamsProtobuf
Fintech • Payments • Financial Services
Design and maintain scalable data platform infrastructure, ingestion pipelines, ETL/ELT workflows, data models, governance, reliability, and observability. Collaborate with analytics and engineering teams, support data warehouse architecture, participate in on-call incident response, document operational processes, and establish strong engineering practices for analytics and future AI capabilities.
Top Skills:
AirbyteAirflowApache IcebergCi/CdDbtDltDockerFlinkGitJavaKafkaKafka ConnectKubernetesPythonSnowflakeSQLTerraform
Energy • Financial Services • Utilities • Renewable Energy
Build and maintain batch and real-time data pipelines, data models, dashboards, and data products supporting front-office trading. Responsibilities include orchestration, schema and ORM design, SQL optimization, data quality controls, streaming architectures, Python visualization, DevOps, monitoring, testing, security, and stakeholder collaboration. The role owns delivery end to end and contributes to architecture and engineering standards.
Top Skills:
AirflowAzure Application InsightsAzure Blob StorageAzure DevopsAzure Event HubsAzure Key VaultCi/CdDagsterDockerKafkaKubernetesPlotly DashPrefectPythonSQLSqlalchemyStreamlitTableau
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
