DoorFeed Logo

DoorFeed

Data Engineer

Posted Yesterday
Be an Early Applicant
In-Office
London, Greater London, England
Junior
In-Office
London, Greater London, England
Junior
Design, build, and maintain data ingestion and transformation pipelines for hundreds of thousands of property listings daily. Manage PostgreSQL databases, implement ETL and data warehousing solutions, and apply AI/ML to enrich data. Build pipelines from diverse sources and improve live property data processing.
The summary above was generated by AI

The Opportunity:
We are seeking a skilled data engineer with at least 2 years experience to join our team in our London office. You will design, build, and maintain data pipelines transforming data from hundreds of thousands of property listings every day and use AI and machine learning to enhance our data.

Key Responsibilities:

  • Maintain and improve our data pipeline of live properties.

  • Manage PostgreSQL databases.

  • Use data processing tools to transform data from hundreds of different sources.

  • Use AI and Machine Learning to enrich our data.

  • Build data ingestion pipelines from scratch from a variety of different data sources.

Required qualifications:

  • Proficient in Python, SQL, pandas with a good general understanding of data engineering technologies.

  • Understanding of ETL processes and data warehousing.

  • Strong problem-solving and communication skills.

  • Minimum 2 years relevant professional experience.

  • Able to come into our central London office 5 days per week.

Preferred Qualifications:

  • Comfortable with learning and applying new & unfamiliar technologies to ensure best solution is implemented.

  • Experience with AWS services (S3, RDS, Lambda, EC2, Athena etc.).

  • Experience with machine learning frameworks.

  • Experience with data orchestration tools (Airflow, Dagster etc.)

Top Skills

AI
Airflow
Aws Athena
Aws Ec2
Aws Lambda
Aws Rds
Aws S3
Dagster
Data Warehousing
ETL
Machine Learning Frameworks
Pandas
Postgres
Python
SQL
HQ

DoorFeed London, England Office

London, United Kingdom

Similar Jobs

3 Days Ago
In-Office
London, Greater London, England, GBR
Senior level
Senior level
Fintech • Information Technology • Financial Services
Design, build, and operate enterprise-grade, cloud-native data platforms and pipelines for Preqin's Company Intelligence. Provide technical architecture, end-to-end delivery, data governance, observability, and reliability while leading and mentoring a small team and partnering with product and analytics to deliver measurable business value.
Top Skills: Apache AirflowAWSAzureCi/CdDbtGitKubernetesPythonSnowflakeSQLTerraform
15 Days Ago
Hybrid
London, England, GBR
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Senior Azure Data Engineer, you'll design and deploy data engineering pipelines using Databricks on Azure, collaborate with clients, and implement best practices in a consulting environment.
Top Skills: AzureAzure DevopsAzure Event HubsClouderaDatabricksDeltalakeGithub ActionsHadoopHiveJenkinsKafkaPysparkPythonSpark Structured StreamingSQLUnity Catalog
15 Days Ago
Hybrid
London, England, GBR
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Principal Data Engineer will design and build scalable data pipelines, collaborate with clients on solutions, and mentor junior engineers in a hybrid environment.
Top Skills: BigQueryDataflowDataprocGithub ActionsGoogle Cloud PlatformJenkinsPysparkPythonSQL

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account