S

Data Engineer

solve intelligence United Kingdom
Visa Sponsorship
Apply
AI Summary

Build and operate high-throughput data ingestion and search systems for AI products. Manage large-scale pipelines, document processing, and performance engineering for diverse data sources. Requires strong Python, SQL, and production database experience with end-to-end ownership.

Key Highlights
Own systems from source acquisition through to serving queries for tens to hundreds of millions of records.
Build and operate high-throughput, resumable pipelines for large datasets with efficient incremental updates.
Design schemas, indexes, and partitioning for fast keyword, vector, and structured search.
Key Responsibilities
Build and operate high-throughput, resumable pipelines for large datasets with efficient incremental updates, monitoring, and recovery from failures.
Extract useful content from complex documents and other formats, handling malformed records and changing schemas while validating outputs.
Build keyword, vector, and structured search systems, designing schemas, indexes, and partitioning for fast queries over large record sets.
Link patents, scientific records, and supporting documents, preserving dates and versions to ensure traceability to original sources.
Profile parsing, ingestion, database builds, and queries to diagnose CPU, memory, and storage I/O bottlenecks, tuning jobs and infrastructure for throughput, latency, and cost.
Technical Skills Required
Python SQL Data Pipelines
Benefits & Perks
Competitive Salary + Significant Equity
Full visa sponsorship
Private medical insurance
Free meals
Nice to Have
PostgreSQL/pgvector
OpenSearch (or Elasticsearch)
Spark/Delta Lake
AWS
NoSQL databases
Rust/C++

Job Description


💡 About Us

We're the fastest-growing startup transforming the IP industry.

  • Traction: 20-30% MoM revenue growth; selling to 700+ global IP teams (DLA Piper, tech boutiques, and global enterprises).
  • Proven Value: Users report 50-90% efficiency gains using our AI platform.
  • Backing: Recently featured in Sifted following our $40M Series B announcement, bringing our total funding to $55M from elite investors including Y Combinator, 20VC, Visionaries, Microsoft and Thomson Reuters.

🏗️ About The Role

We’re hiring a data engineer to build the ingestion and search systems behind Solve Intelligence’s AI products.

Our sources include global patent literature, case law, technical standards and contributions, scientific databases, academic papers, and content from across the web. The data spans structured records, documents, images, audio and video. You’ll work across bulk ingestion and on-demand retrieval, making this information searchable and useful in our products

You’ll own systems from source acquisition through to serving queries. The work includes:

  • Large-scale ingestion. Build and operate high-throughput, resumable pipelines for large datasets, with efficient incremental updates, monitoring and recovery from failures.
  • Document processing and data quality. Extract useful content from complex documents and other formats. Handle malformed records and changing schemas, and validate outputs while preserving structure and metadata.
  • Search and serving. Build keyword, vector and structured search, and design schemas, indexes and partitioning for fast queries over tens to hundreds of millions of records.
  • Connecting information across sources. Link patents, scientific records and supporting documents, preserve dates and versions, and make results traceable to their original sources.
  • Performance engineering. Profile parsing, ingestion, database builds and queries throughout development, testing against representative datasets at realistic scale. Diagnose CPU, memory and storage I/O bottlenecks, and tune jobs and infrastructure for throughput, latency and cost.

You’ll work closely with our AI researchers and product engineers, with substantial freedom to choose the approach and build the systems yourself.

🛠️ What you bring

Must Haves

  • Strong Python and SQL, with experience designing and operating production databases.
  • Solid experience building and operating production data pipelines over large, messy datasets.
  • Expertise with running search systems over large document collections.
  • End-to-end ownership from raw data to user-facing functionality.
  • A good understanding of schema design, indexing and query optimisation.
  • A track record of diagnosing and fixing performance bottlenecks in live systems through profiling and measurement.

Nice To Have

  • Experience with PostgreSQL/pgvector, OpenSearch (or Elasticsearch), Spark/Delta Lake, AWS, NoSQL databases, or Rust/C++ is useful.

👋 The Founders

You'll partner with a founding team of AI PhDs and elite systems engineers:

  • Sanj (CRO): PhD in AI (Gatsby Unit, UCL), ex-Huawei R&D, former lead at Magic Carpet AI (acquired).
  • Chris (CEO): PhD in AI (UCL), published researcher, ex-Dyson and Alan Turing Institute.
  • Angus (CTO): MEng Computer Science, ex-Qualcomm and Coremont (Brevan Howard).

What we offer

  • Competitive Salary + Significant Equity: We want you to have true ownership in the success of the company.
  • Founding Impact: You'll have a direct hand in how we build out the data infrastructure the rest of the product depends on.
  • Support: Full visa sponsorship and private medical insurance.
  • The Environment: Free meals and a seat at the table with an incredibly smart, ambitious team.


Similar Jobs

Explore other opportunities that match your interests

Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

homeprotect home insurance

United Kingdom

Senior Data Scientist - Pricing

Data Science
2d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Harnham

United Kingdom

Senior Data Science Manager

Data Science
5d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

scottishpower

United Kingdom

Subscribe our newsletter

New Things Will Always Update Regularly