AI Inference Engineer

Jobgether • Eastern Region

Remote

This Job is No Longer Active This position is no longer accepting applications

AI Summary

Jobgether is seeking an AI Inference Engineer to design, optimize, and maintain the inference layer for high-performance AI execution on edge devices. The ideal candidate will have a strong foundation in systems programming and machine learning, with expertise in C++ and experience with inference frameworks. This is an opportunity to work on cutting-edge AI and decentralized technologies, with a focus on low-level optimization and architecture.

Key Highlights

Design and optimize the inference layer for high-performance AI execution on edge devices

Collaborate with research teams to transition models from experimentation to production-ready deployments

Integrate AI-driven features into existing products, ensuring seamless performance and reliability

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

Key Responsibilities

Design, optimize, and maintain the inference layer for high-performance AI execution on edge devices

Develop and optimize C++-based inference systems for deploying AI models on edge devices

Collaborate with research teams to transition models from experimentation to production-ready deployments

Technical Skills Required

C++ JavaScript Llama.cpp GGML ONNX Deep learning concepts Transformers LLMs Diffusion models

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Benefits & Perks

Fully remote, globally distributed work environment

Opportunity to work on cutting-edge AI and decentralized technologies

High ownership and impact on core product infrastructure

Job Description

This role offers a unique opportunity to work at the cutting edge of on-device AI, building the core systems that power fast, private, and reliable inference on real-world hardware. You will operate close to the metal, designing and optimizing the runtime layer that enables machine learning models to perform efficiently without relying on cloud infrastructure. The position sits at the intersection of systems engineering and AI, where performance, stability, and scalability are critical. You will collaborate with researchers and product teams to bring advanced models into production environments. With a strong focus on low-level optimization and architecture, your work will directly shape the future of decentralized, peer-to-peer AI experiences. This is an ideal role for engineers who enjoy deep technical challenges and ownership of core infrastructure.

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.