G

Infrastructure Engineer, AI Accelerator Clusters

United States
Visa Sponsorship
This Job is No Longer Active This position is no longer accepting applications

Own the full lifecycle of AI accelerator clusters from provisioning and capacity expansion to failure recovery and decommissioning. Design and operate control-plane services and infrastructure-as-code to ensure reliable, high-bandwidth compute platforms for AI researchers. Requires deep expertise in distributed systems, cloud platforms, and reliable infrastructure automation.

Key Highlights
Ownership of the entire lifecycle of accelerator clusters including provisioning, upgrades, and recovery
Focus on high-bandwidth, topology-aware connectivity and secure-by-default infrastructure
Direct collaboration with Training, RL Systems, and Inference teams to optimize compute roadmaps
Key Responsibilities
Design, build, and operate control-plane services and infrastructure-as-code for provisioning, configuration, and decommissioning.
Coordinate with cloud providers and hardware partners to bring new accelerator capacity online on schedule.
Build high-bandwidth, topology-aware connectivity and diagnose performance issues across hosts, switches, and routing.
Implement security controls including identity and access management, network policy, and workload isolation.
Define health signals and automate remediation to improve fleet scalability and fault tolerance.
Establish service-level objectives and observability for cluster readiness and utilization.
Lead incident response and blameless postmortems to turn operational pain into automation.
Collaborate with AI engineering teams to debug cross-layer failures and shape the compute roadmap.
Technical Skills Required
Distributed Systems Kubernetes Infrastructure as Code
Benefits & Perks
Visa sponsorship
Complimentary lunch and dinner
Office snacks and beverages
Nice to Have
Experience operating large GPU or accelerator fleets for distributed model training or inference
Depth in Kubernetes internals, custom controllers, operators, or Slurm
Experience with high-performance networking such as RDMA, InfiniBand, RoCE, BGP, or eBPF
Experience with Terraform and automated qualification of hardware and firmware
Knowledge of GPU systems, NCCL, NVLink, or NVSwitch

Job Description

Goaly is a stealth AI startup founded by ex-Meta Superintelligence Labs engineers and researchers. Our mission is to dramatically lower the cost, time, and talent barriers to building proprietary AI — and make each generation of models faster and cheaper to build than the last.Backed by leading AI investors and endorsed by frontier AI researchers and builders, we’re looking for exceptional new grads who want to work on hard, foundational AI systems problems with outsized ownership from day one.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

BeaconFire Inc.

United States

New

AI Engineer

  • Javascript
  • Data Structures
  • Java
  • Angular
Visa

Coach

United States

New

AI/ML Engineer

  • Python
  • Postgresql
  • AI
  • Fastapi
Visa Relocation

Visas, Work Permits & Legal Insights

Stay informed about visa types, work permits, and immigration updates for international professionals.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.