Solve Intelligence Logo

Solve Intelligence

Data Engineer

Posted One Month Ago
In-Office
London, Greater London, England, GBR
Entry level
In-Office
London, Greater London, England, GBR
Entry level
Build and operate large-scale data ingestion, document processing, search, and serving systems for AI products. Responsibilities include handling massive heterogeneous datasets, designing schemas and indexes, enabling keyword, vector, and structured search, linking information across sources, and optimizing performance, reliability, latency, and cost. The role owns systems end to end, from source acquisition through user-facing functionality, and collaborates with AI researchers and product engineers.
The summary above was generated by AI
💡 About Us

We're the fastest-growing startup transforming the IP industry.

  • Traction: 20-30% MoM revenue growth; selling to 700+ global IP teams (DLA Piper, tech boutiques, and global enterprises).

  • Proven Value: Users report 50-90% efficiency gains using our AI platform.

  • Backing: Recently featured in Sifted following our $40M Series B announcement, bringing our total funding to $55M from elite investors including Y Combinator, 20VC, Visionaries, Microsoft and Thomson Reuters.

🏗️ About the role

We’re hiring a data engineer to build the ingestion and search systems behind Solve Intelligence’s AI products.

Our sources include global patent literature, case law, technical standards and contributions, scientific databases, academic papers, and content from across the web. The data spans structured records, documents, images, audio and video. You’ll work across bulk ingestion and on-demand retrieval, making this information searchable and useful in our products

You’ll own systems from source acquisition through to serving queries. The work includes:

  • Large-scale ingestion. Build and operate high-throughput, resumable pipelines for large datasets, with efficient incremental updates, monitoring and recovery from failures.

  • Document processing and data quality. Extract useful content from complex documents and other formats. Handle malformed records and changing schemas, and validate outputs while preserving structure and metadata.

  • Search and serving. Build keyword, vector and structured search, and design schemas, indexes and partitioning for fast queries over tens to hundreds of millions of records.

  • Connecting information across sources. Link patents, scientific records and supporting documents, preserve dates and versions, and make results traceable to their original sources.

  • Performance engineering. Profile parsing, ingestion, database builds and queries throughout development, testing against representative datasets at realistic scale. Diagnose CPU, memory and storage I/O bottlenecks, and tune jobs and infrastructure for throughput, latency and cost.

You’ll work closely with our AI researchers and product engineers, with substantial freedom to choose the approach and build the systems yourself.

🛠️ What you bring

Must haves:

  • Strong Python and SQL, with experience designing and operating production databases.

  • Solid experience building and operating production data pipelines over large, messy datasets.

  • Expertise with running search systems over large document collections.

  • End-to-end ownership from raw data to user-facing functionality.

  • A good understanding of schema design, indexing and query optimisation.

  • A track record of diagnosing and fixing performance bottlenecks in live systems through profiling and measurement.

Nice to Have:

  • Experience with PostgreSQL/pgvector, OpenSearch (or Elasticsearch), Spark/Delta Lake, AWS, NoSQL databases, or Rust/C++ is useful.

👋 The Founders

You'll partner with a founding team of AI PhDs and elite systems engineers:

  • Sanj (CRO): PhD in AI (Gatsby Unit, UCL), ex-Huawei R&D, former lead at Magic Carpet AI (acquired).

  • Chris (CEO): PhD in AI (UCL), published researcher, ex-Dyson and Alan Turing Institute.

  • Angus (CTO): MEng Computer Science, ex-Qualcomm and Coremont (Brevan Howard).

What we offer
  • Competitive Salary + Significant Equity: We want you to have true ownership in the success of the company.

  • Founding Impact: You'll have a direct hand in how we build out the data infrastructure the rest of the product depends on.

  • Support: Full visa sponsorship and private medical insurance.

  • The Environment: Free meals and a seat at the table with an incredibly smart, ambitious team.

 

Similar Jobs

5 Days Ago
Hybrid
Senior level
Senior level
Digital Media • Gaming • Software • Esports • Automation
Lead the modernization of regulatory reporting systems by designing scalable BigQuery and Dataform pipelines on Google Cloud Platform. Build and support ETL and ELT workflows, implement data-quality controls, monitoring, testing, and CI/CD, and modernize SQL Server solutions. Lead technical designs and delivery planning, reduce technical debt, collaborate with stakeholders, mentor engineers, and use AI-assisted development tools to improve engineering quality.
Top Skills: BigQueryCi/CdClaude CodeCloud ComposerCloud FunctionsCloud StorageDataformEltETLGoogle Cloud PlatformPub/SubSQLSQL Server
5 Days Ago
Hybrid
Senior level
Senior level
Digital Media • Gaming • Software • Esports • Automation
Lead the modernization of legacy SQL Server reporting systems into scalable Google Cloud architectures. Design and maintain BigQuery and Dataform pipelines, build resilient ETL and ELT workflows, implement data-quality controls and observability, and improve reporting architectures. Lead technical designs and delivery planning, reduce technical debt, collaborate with stakeholders, and mentor engineers while promoting testing, CI/CD, documentation, and AI-assisted development practices.
Top Skills: Ci/CdClaude CodeCloud ComposerCloud FunctionsCloud StorageDataformEltETLGoogle BigqueryGoogle Cloud PlatformPub/SubSQLSQL Server
10 Days Ago
In-Office
Entry level
Entry level
Digital Media • Gaming • Software • Esports • Automation
Build and maintain regulatory reporting systems using SQL Server and GCP BigQuery. Develop automated ETL and ELT pipelines, migrate legacy solutions to cloud-native platforms, and implement data modelling, validation, monitoring, alerting, and QA. Collaborate with technical leads, participate in code reviews, document processes, and use infrastructure as code, CI/CD, version control, and AI-assisted development to improve reporting accuracy, traceability, performance, and delivery efficiency.
Top Skills: Ci/CdClaude CodeCloud ComposerCloud FunctionsCloud StorageEltETLGitGitlabGoogle BigqueryGoogle Cloud Platform (Gcp)Pub/SubSQLSQL ServerTerraform

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account