C

Senior Research Engineer - Agentic and Algorithmic Evaluation Systems

United Kingdom
Visa Sponsorship Relocation
This Job is No Longer Active This position is no longer accepting applications
AI Summary

Design and build a unified benchmarking system for evaluating agentic and algorithmic solutions across motifs, topologies, and decomposition strategies. Lead external benchmark co-publications and ensure contamination-controlled, reproducible results that directly influence product decisions. Requires PhD-level research background, strong Python engineering skills, and experience with sandboxed execution grading.

Key Highlights
Build reproducible, contamination-controlled benchmarking system for LLM and agentic workloads
Lead external benchmark co-publications with rigorous evaluation standards
Directly feed evaluation results into product shipping decisions

Looking to advance your Development & Programming career with relocation support? Explore Development & Programming Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

Key Responsibilities
Design and build a unified system for evaluating agentic and algorithmic solutions
Mine real commits and traces, run sandboxed execution grading, and build task suites
Enforce controls against contamination, overfitting to benchmarks, and metric gaming
Compare algorithmic and agentic approaches honestly, not models or chips
Lead external benchmark co-publications
Feed results directly into which approach ships
Technical Skills Required
Python Sandboxed execution grading Distributed execution

Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.

Benefits & Perks
Competitive Salary
Equity & Ownership
Private healthcare

Interested in relocating to United Kingdom? Check out our comprehensive Relocation Jobs in United Kingdom page with detailed relocation packages and benefits.

Nice to Have
Published agentic or tool-use benchmarks that use execution-based grading
Experience running sandboxed execution grading at scale
Open-source evaluation or harness tooling
Familiarity with code-agent workloads such as search, edit, and repair

Job Description

We’re living through a Cambrian explosion of intelligence: new models and new chips, each specialised for different tasks, are arriving all at once. The result is a new era for AI, one of radical heterogeneity.Callosum is the Intelligent Systems Company. We believe the next generation of AI won't be defined by any single model or chip, but by intelligent systems in which hardware and intelligence co-evolve. We are building the infrastructure that unifies heterogeneous compute across the full stack. This opens a new axis of scaling intelligence: a dynamic system that tailors itself to what each workload actually needs, whether that's speed, cost, precision, or whatever unit comes next.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Aug 20, 2026
Employment Full-time
Experience Not Applicable
Location United Kingdom
Category Programming
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.