Machine Learning Engineer

About The Company

Inworld is a cutting-edge, product-oriented research laboratory composed of top AI researchers and engineers dedicated to advancing the field of artificial intelligence. The company specializes in developing best-in-class real-time multimodal models and the only real-time orchestration platform optimized for thousands of queries per second. With significant funding of over $125 million from prominent investors such as Lightspeed, Section 32, Kleiner Perkins, Microsoft’s M12 venture fund, Founders Fund, Meta, and Stanford, Inworld has established itself as a leader in AI innovation. The company's technology has powered experiences for renowned organizations including NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs, Wishroll, Little Umbrella, and Bible Chat. Recognized by CB Insights as one of the 100 most promising AI companies globally and named one of LinkedIn's Top 10 Startups in the USA, Inworld continues to push the boundaries of AI research and deployment.

About The Role

We are seeking a highly skilled and motivated AI Systems Engineer to join our dynamic team. This role involves working on the forefront of AI inference optimization, model acceleration, and high-performance system development. The ideal candidate will have a deep understanding of modern serving frameworks, distributed systems, and GPU optimization techniques. You will be responsible for taking models from research to production, ensuring they run efficiently and reliably at scale. This position offers an exciting opportunity to contribute to groundbreaking AI infrastructure that influences a wide range of applications. Candidates should thrive in an ambiguous environment, demonstrate a passion for engineering excellence, and have a proven track record of building and optimizing complex systems.

Qualifications

• PhD in Computer Science, Physics, Mathematics, or equivalent practical experience in building backend or ML systems
• Deep understanding of inference optimization techniques such as vLLM, TRT-LLM
• Hands-on experience with model acceleration methods including quantization, distillation, caching strategies, continuous batching, paged attention, and speculative decoding
• Proficiency in programming languages such as C++, CUDA, Rust, or highly optimized Python
• Experience with profiling code and optimizing GPU performance, particularly with NVIDIA GPUs

Looking to advance your Machine Learning & AI career with relocation support? Explore Machine Learning & AI Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

• Knowledge of distributed systems, including Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and handling thousands of concurrent connections
• Contributions to open-source inference engines or significant systems programming projects
• Ability to own projects end-to-end, from research to containerization, optimization, and deployment in production environments
  
  

Responsibilities

• Design, develop, and optimize high-performance inference systems for multimodal AI models
• Implement and improve model acceleration techniques to enhance inference speed and efficiency
• Profile and troubleshoot system bottlenecks, ensuring low latency and high throughput

Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.

• Build scalable distributed inference infrastructure capable of handling thousands of concurrent requests
• Collaborate with research teams to translate cutting-edge models into production-ready systems
• Contribute to open-source projects and publish technical work that advances the field
• Maintain high standards for system reliability, performance, and security
• Take full ownership of projects, from initial research to deployment and monitoring in production environments
  
  

Benefits

• Competitive salary range of £140,000 – £200,000, commensurate with experience and location

Interested in relocating to United Kingdom? Check out our comprehensive Relocation Jobs in United Kingdom page with detailed relocation packages and benefits.

• Equity options and comprehensive benefits package
• Opportunities for professional growth and working on pioneering AI projects
• Collaborative and innovative work environment with flat organizational structure
• Potential relocation support for candidates interested in moving to the San Francisco Bay Area
• Access to cutting-edge AI research and development resources
  
  

Equal Opportunity

Inworld is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, religion, gender, sexual orientation, age, disability, or any other protected characteristic. We encourage candidates from all backgrounds to apply and join us in shaping the future of AI technology.