C

Senior Software Engineer (Heterogeneous AI Inference Systems)

United Kingdom
Visa Sponsorship Relocation
This Job is No Longer Active This position is no longer accepting applications
AI Summary

Lead the development of next-gen AI inference engines for heterogeneous hardware, optimizing scheduling, memory, and execution strategies. Contribute to open-source frameworks like SGLang and vLLM while collaborating with hardware teams. Requires deep expertise in ML serving, parallelism, and high-performance systems.

Key Highlights
Build and optimize inference engines for heterogeneous hardware (GPUs, accelerators, etc.)
Contribute to and extend open-source frameworks (SGLang, vLLM) for production-scale AI workloads
Design parallelism and disaggregation strategies to maximize performance and cost-efficiency

Looking to advance your Development & Programming career with relocation support? Explore Development & Programming Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

Key Responsibilities
Contribute to and maintain open-source inference engines (SGLang, vLLM) and internal forks where needed
Improve hardware-awareness in inference engines, optimizing scheduling, memory management, and execution pipelines
Design and implement advanced parallelism and disaggregation strategies for heterogeneous hardware
Collaborate with Accelerator Systems Software engineers to align engine-level abstractions with diverse hardware capabilities
Technical Skills Required
Python C++/CUDA High-performance computing (HPC) systems

Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.

Benefits & Perks
Competitive Salary (£101K - £192K)
Equity & Ownership
Private healthcare

Interested in relocating to United Kingdom? Check out our comprehensive Relocation Jobs in United Kingdom page with detailed relocation packages and benefits.

Nice to Have
Deep familiarity with SGLang and vLLM internals (scheduler design, memory management, execution pipelines)
Experience with disaggregated serving architectures and their tradeoffs
Record of working effectively in fast-moving open-source projects with evolving APIs

Job Description

We’re living through a Cambrian explosion of intelligence: new models and new chips, each specialised for different tasks, are arriving all at once. The result is a new era for AI, one of radical heterogeneity.Callosum is the Intelligent Systems Company. We believe the next generation of AI won't be defined by any single model or chip, but by intelligent systems in which hardware and intelligence co-evolve. We are building the infrastructure that unifies heterogeneous compute across the full stack. This opens a new axis of scaling intelligence: a dynamic system that tailors itself to what each workload actually needs, whether that's speed, cost, precision, or whatever unit comes next.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Aug 20, 2026
Employment Full-time
Experience Not Applicable
Location United Kingdom
Category Programming
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.