Darkroom Logo

Darkroom

Data Engineer

Reposted 20 Hours Ago
Be an Early Applicant
In-Office
8 Locations
Senior level
In-Office
8 Locations
Senior level
As a Senior Data Engineer, you'll build and optimize data pipelines for an AI platform, ensuring data integrity and performance while collaborating with various teams.
The summary above was generated by AI

Data Engineer | Matter

About the Role

We are seeking an experienced Senior Data Engineer. You’ll work closely with our CTO, CPO, and product teams to architect, build, and deliver robust data pipelines and transformations for our always-on AI platform. Success in this role will have a direct, measurable impact on business outcomes and future product velocity.

Key Responsibilities

  • Architect, build, and optimize scalable end-to-end data pipelines using dbt and our stack (Python microservices, Postgres, BigQuery, and GCP).

  • Design, implement, and maintain ETL/ELT processes to ingest, clean, and transform large datasets from a variety of sources.

  • Collaborate with product and engineering to define data requirements for new product features and analytics initiatives.

  • Manage our data pipeline by onboarding new clients, loading their data, and applying all required formulas.

  • Maintain and troubleshoot workflows by fixing broken formulas, adding new services, and ensuring reliable, high-throughput performance.

  • Ensure data reliability, integrity, and security at scale.

  • Troubleshoot, performance-tune, and document all pipelines and data workflows for smooth handoff.

About You

  • 5+ years of hands-on experience building production-grade data pipelines, ETL/ELT workflows, and transformed datasets at scale.

  • Expert-level Python; strong experience with dbt, Postgres, BigQuery, and core GCP data services (e.g., Dataflow, Pub/Sub, Storage, Composer).

  • Demonstrated experience architecting, optimizing, and troubleshooting cloud-based data infrastructure.

  • Familiarity with analytics, BI tools, and data visualization platforms is a plus.

  • Startup or contract/consulting experience strongly preferred; you move quickly and commit to clear deliverables and deadlines.

  • Excellent communication skills: you read requirements carefully, keep stakeholders looped in, and document as you go. You can boil down complex tasks into plain english for non-data engineers to understand.

  • Low-ego, high-ownership, and passionate about building product-focused solutions.

Top Skills

BigQuery
Dbt
GCP
Postgres
Python

Similar Jobs

18 Days Ago
In-Office
Lahore, Punjab, PAK
Junior
Junior
Information Technology • Software
The Data Engineer will design and maintain ETL/ELT pipelines, build cloud solutions, and collaborate with teams on data projects.
Top Skills: Amazon KinesisApache AirflowSparkAWSAws GlueAzureAzure Data FactoryBigQueryBitbucketDatabricksGCPGitGitlabGoogle Pub/SubKafkaPythonRedshiftSnowflakeSQL
18 Days Ago
In-Office
Islamabad, Punjab, PAK
Mid level
Mid level
Cloud • Information Technology • Consulting
The AWS Data Engineer will design and manage cloud-based data infrastructure, optimize databases, support developers, and implement CI/CD pipelines while ensuring security and compliance.
Top Skills: Amazon RdsAuroraAWSAws Database Migration ServiceBashCloudFormationEc2MySQLOraclePostgresPythonTerraform
18 Days Ago
In-Office
Lahore, Punjab, PAK
Mid level
Mid level
Cloud • Information Technology • Consulting
The AWS Data Engineer designs and manages cloud-based data infrastructure, optimizing databases and ensuring data migrations while collaborating with teams to provide scalable solutions.
Top Skills: AWSAws AuroraAws DmsAws RdsBashCloudFormationMySQLNoSQLOraclePostgresPythonSQLTerraform

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account