Design and maintain scalable data platforms and pipelines, collaborate with teams on analytics, and ensure data quality using AWS services.
We are looking for a Senior Data Engineer to join a project with one of our clients. The client has been established for over 10 years, is part of an international group, and develops its own product portfolio across several key areas, including Accounting, Compliance, Healthcare, among others.
Responsibilities:
- Design, develop, and maintain scalable data platforms and data pipelines.
- Collaborate with Data Scientists and ML Engineers to support analytics, model development, and deployment workflows.
- Implement and optimize ETL/ELT pipelines and end-to-end data processing solutions.
- Build and manage cloud-based data infrastructure, preferably in AWS.
- Ensure data quality, reliability, and observability through testing and best practices.
- Promote high standards of code quality, documentation, and maintainability.
- Support the team in adopting best practices for data processing, storage, and computation.
- Work within an Agile Scrum framework, contributing actively to sprint planning and execution.
- Evaluate new technologies and tools, bringing strong technical opinions and recommendations to improve the data ecosystem.
- Contribute to the continuous improvement of internal processes, engineering practices, and performance optimization.
Requirements
- Degree in Computer Engineering, IT or similar.
- 5+ years of experience as a Data Engineer.
- Strong programming skills in Python.
- Solid knowledge of SQL/NoSQL.
- Experience with Spark, Kafka and modern data processors.
- Knowledge of frameworks: Airflow, dbt, Debezium, Flink.
- Hands-on experience with AWS Data Engineering services.
- Experience building E2E data pipelines and ETL/ELT processes.
- Familiarity with Infrastructure as Code, preferably AWS CDK.
- Experience with data and code quality practices and testing.
- Experience working in Agile Scrum teams.
- Strong communication, autonomy, and decision-making skills.
- Fluent in English.
Benefits
- Employment Contract;
- Health Insurance;
- Meal Card;
- Gym Ticket;
- Hybrid Work (Porto - Portugal)
Top Skills
Airflow
AWS
Dbt
Debezium
Flink
Kafka
NoSQL
Python
Spark
SQL
Similar Jobs
Financial Services
The Senior Python Data Engineer will develop scalable data solutions, collaborate with stakeholders, and ensure code quality while managing data processing flows and applications.
Top Skills:
DataikuPandasPolarsPython
Healthtech
Design and maintain ETL pipelines, manage data warehouses, work with complex data architectures, and support algorithms and AI teams.
Top Skills:
Apache AirflowAWSBigQueryCloud StorageDbtDockerFhirGCPJSONKafkaKubernetesMySQLPythonSQLTerraform
Digital Media • Consulting
The Data Engineer will develop data access services for pricing environments, ensuring compliance with best practices and managing technical debt.
Top Skills:
GitHadoopHiveJavaJenkinsKafkaNoSQLScalaSparkSpringSpring BootSQLVisual Studio
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
