Staff Software Engineer - AI Compute Infrastructure (GPU Cloud Platform)

teli labs • Netherlands

Visa Sponsorship

Apply Now

AI Summary

Lead the architectural design and development of Together AI’s next-gen AI cloud platform, focusing on GPU virtualization, distributed systems, and global infrastructure scaling. Own critical components like GPU scheduling, high-performance networking, and fault-tolerant control planes while mentoring teams and setting engineering standards. Requires 7+ years of distributed systems expertise, deep systems knowledge, and leadership in large-scale production environments.

Key Highlights

Architect and build a globally distributed, high-performance AI cloud platform with GPU virtualization and InfiniBand networking

Own critical infrastructure layers: GPU hypervisor, IaaS services, distributed control planes, and fault-tolerant systems

Set technical direction, mentor engineers, and define standards for reliability, scalability, and developer tooling

Searching for Devops roles that provide visa sponsorship? Connect with international employers through Devops Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Key Responsibilities

Design and implement GPU and network virtualization stack, including hypervisor, kernel, and SDN components for high-performance, portable, and isolated compute

Architect and roadmap the in-DC IaaS layer, including Kubernetes operators, VM provisioning, parallel filesystems, and VPC/InfiniBand partitioning for a new data center with thousands of GPUs

Develop the distributed GPU scheduling and global management plane for on-demand/reserved clusters across multiple data centers, including capacity scaling and automated onboarding

Design fault-tolerant monitoring and automated remediation systems to ensure reliability during hardware failures in distributed pretraining and inference workloads

Lead design reviews, resolve cross-team architectural disagreements, and define technical standards for Together Cloud’s engineering practices

Mentor senior and junior engineers, deepen team expertise in virtualization, DC networking, and GPU infrastructure, and elevate hiring standards

Create testing frameworks, developer documentation, and tools to ensure system robustness and usability across the organization

Technical Skills Required

Distributed Systems Architecture GPU Virtualization Kubernetes

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Benefits & Perks

Equal Opportunity Employer

Global AI cloud infrastructure focus

Interested in opportunities specifically in Netherlands? Discover our dedicated Visa Sponsorship Jobs in Netherlands page featuring roles from top employers in this location.

Nice to Have

Deep Kubernetes internals (operators, device/storage/network plugins, custom schedulers)

Experience with VMs/hypervisors (QEMU/KVM, cloud-hypervisor, VFIO, virtio, PCIe passthrough)

DC networking expertise (VLAN, VXLAN, VPN, VPC, OVS/OVN, Cluster API)

GPU virtualization and InfiniBand experience

DPUs/SmartNICs (e.g., BlueField) and high-performance compute networking

Job Description

Back to jobsNewStaff Software Engineer - AI Compute, Together CloudAmsterdamTogether AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the [Together GPU Clusters](https://www.together.ai/gpu-clusters) flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products.

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.