C

Senior Inference Systems Engineer (Heterogeneous AI Infrastructure)

United Kingdom
Visa Sponsorship Relocation
This Job is No Longer Active This position is no longer accepting applications
AI Summary

Design and optimize high-performance inference systems for heterogeneous AI workloads, focusing on KV cache, batching, memory management, and multi-node scheduling. Work with cutting-edge hardware (GPUs, accelerators) to maximize throughput, minimize latency, and scale across diverse models. Requires deep expertise in distributed systems, GPU optimization, and low-level programming.

Key Highlights
Own end-to-end performance of inference platforms across heterogeneous multi-GPU/multi-node environments
Optimize KV cache, batching, memory allocation, and scheduling for LLM inference at scale
Collaborate with hardware vendors (NVIDIA, Intel, Cerebras, etc.) to leverage next-gen silicon

Looking to advance your Development & Programming career with relocation support? Explore Development & Programming Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

Key Responsibilities
Design and optimize inference serving systems for heterogeneous multi-GPU/multi-node environments
Develop and refine KV cache lifecycle management, batching strategies, and memory allocation for high-throughput LLM inference
Profile and optimize GPU kernels, identify bottlenecks, and implement targeted performance improvements
Build scheduling logic for continuous batching, disaggregated prefill/decode, and speculative decoding
Optimize distributed inference workloads using NCCL, NVLink, RDMA, InfiniBand, and RoCE
Develop performance monitoring, regression detection, and benchmarking tooling across hardware configurations
Technical Skills Required
Distributed Systems Engineering CUDA Programming GPU Optimization

Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.

Benefits & Perks
Competitive Salary (£101K–£192K)
Equity & Ownership
Private Healthcare

Interested in relocating to United Kingdom? Check out our comprehensive Relocation Jobs in United Kingdom page with detailed relocation packages and benefits.

Nice to Have
Experience with production-grade, high-throughput model serving stacks
Multi-GPU/multi-node inference optimization using NCCL, NVLink, RDMA, InfiniBand, or RoCE
GPU memory profiling and CUDA/Triton kernel optimization expertise
Linux performance analysis and optimization

Job Description

We’re living through a Cambrian explosion of intelligence: new models and new chips, each specialised for different tasks, are arriving all at once. The result is a new era for AI, one of radical heterogeneity.Callosum is the Intelligent Systems Company. We believe the next generation of AI won't be defined by any single model or chip, but by intelligent systems in which hardware and intelligence co-evolve. We are building the infrastructure that unifies heterogeneous compute across the full stack. This opens a new axis of scaling intelligence: a dynamic system that tailors itself to what each workload actually needs, whether that's speed, cost, precision, or whatever unit comes next.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Aug 20, 2026
Employment Full-time
Experience Not Applicable
Location United Kingdom
Category Programming
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.