Our new Boston office
Jellyfish Logo

Jellyfish

Data Engineer

Reposted 2 Hours Ago
Remote or Hybrid
Hiring Remotely in United States
Mid level
Remote or Hybrid
Hiring Remotely in United States
Mid level
The Data Engineer will build and maintain data pipelines, optimize workflows, manage infrastructure, and enhance pipeline observability while collaborating with teams for effective data delivery.
The summary above was generated by AI

Jellyfish is the backbone for elite engineering organizations, and our data pipelines need to be as high-performing and reliable as the teams we serve. We are looking for a Data Engineer to join our data platform team and help us execute, automate, and maintain the next generation of our Jellyfish data platform. In this role, you’ll be a core builder—fully autonomous, highly proficient, and responsible for translating architectural blueprints into clean, production-grade pipelines. If you view manual data patches and unmonitored workflows as bugs to be squashed and want to write code that directly impacts how the world’s best engineering leaders measure their output, you’re the perfect fit.

What you’ll actually be doing:
  • Core Pipeline Engineering – You’ll write the clean, modular Python and optimized SQL that drives our daily data transformations. You will be responsible for implementing our Medallion-layer data models (Bronze → Silver → Gold), ensuring high performance and data integrity.

  • Modern Orchestration & Tuning – You’ll manage and tune our workflow orchestration engines (like Prefect or Dagster). You’ll hunt down slow execution paths, optimize parameter serialization (e.g., leveraging Pydantic v2), and ensure our distributed processing jobs run efficiently.

  • Infrastructure as Code (IaC) – You won't just write data scripts; you'll own your infrastructure deployment. You will use Terraform to manage and provision data warehouse schemas, permissions, and tables across securely isolated staging and production catalogs.

  • API & Caching Integration – You’ll collaborate with product developers to expose data safely. You’ll help implement and maintain the application backend tiers, backend-for-frontend (BFF) layers, and Redis caching structures that protect our core data warehouse from frontend concurrency spikes.

  • On-Call & Pipeline Observability – You’ll participate in our data platform's incident response rotation. When a pipeline breaks, you won't just fix the data; you’ll refine the Datadog dashboards and alerts to ensure we catch the issue earlier next time.

You’re a great fit if:
  • Data Engineering Fluency – You have solid, hands-on production experience with Python, advanced SQL, and data transformation concepts. You are comfortable building and scheduling workflows using programmatic orchestrators (such as Prefect, Dagster, or Airflow).

  • Warehouse & Catalog Practitioner – You know your way around enterprise data platforms (e.g., Snowflake, Databricks, BigQuery). You understand how to navigate environment boundaries, manage access keys securely, and write performant queries.

  • Automation Mindset – You look at a repeated data backfill, a manual schema fix, or an untracked data quality bug and immediately think about how to script a permanent, automated solution.

  • Collaborative Builder – You love working in a team. You write readable code, value thorough documentation and clear data lineage, and enjoy collaborating with application engineers to solve complex data delivery problems.

  • Pragmatic Problem Solver – You know when to write a perfectly optimized distributed processing job and when a simple, well-indexed database table or cached view is the smartest move to keep the business moving.

Bonus Points:
  • You’ve worked in a rapidly scaling startup handling complex, multi-tenant B2B SaaS data.

  • You have experience with data quality testing frameworks (like Great Expectations or Soda).

  • You’ve interacted with cloud cost allocation tracking or token-level spend for LLM/AI model integrations.

A list of job experiences and qualification requirements is great, but humility, a performance-driven attitude, and a team-player approach are most important to us. We love to have fun and win in the process. We only hire people who have a passion for building great companies in an environment where a sense of humor is a must.

Occasional travel may be required.

Applicants must be authorized to work for any employer in the US. We are unable to sponsor or take over sponsorship of an employment visa at this time.

Let’s talk about us!
This is all about you, but you want to know a little about us. Jellyfish is the leading intelligence platform for AI-Integrated engineering, helping more than 1,000 companies including DraftKings, Keller Williams and Blue Yonder, leverage AI to transform how they build software. By combining the industry’s deepest engineering dataset with context-rich intelligence, Jellyfish helps R&D organizations understand what’s driving impact, adopt proven industry best practices, and make smarter decisions across AI adoption, planning, delivery, and engineering performance.

Similar Jobs at Jellyfish

12 Days Ago
Remote or Hybrid
Senior level
Senior level
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Design, build, and operate Jellyfish's Databricks Lakehouse and data/AI platform. Build ingestion, transformation, and delivery pipelines; govern data with Unity Catalog; enable BI, agentic analytics, metadata, lineage, and observability. Provide technical leadership, set architecture and standards, mentor peers, and collaborate with cross-functional stakeholders to make Databricks the foundation for analytics and AI.
Top Skills: Ci/CdDatabricksDatabricks AppsDatabricks Asset BundlesDatabricks LakehouseDatabricks SqlDatabricks WorkflowsDbtDelta LakeDelta LakeGenieLlmsOntologyPythonRetrieval-Augmented GenerationSQLTerraformUnity Catalog
2 Hours Ago
Remote or Hybrid
Senior level
Senior level
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Build user-facing data products by transforming internal data into actionable metrics. Collaborate with platform teams and data scientists to prototype, validate, and prioritize data sources. Write requirements and proposals, engage in user research, and deliver performant Python/SQL-based data features using Databricks and Postgres.
Top Skills: DatabricksPostgresPythonSQL
3 Days Ago
Remote or Hybrid
Senior level
Senior level
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.
Top Skills: Apache AirflowCi/CdClaudeCloudFormationDagsterDelta LakeGitGithub CopilotGitlabJIRALakehousePrefectPythonRest ApisTerraform

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account