Senior C++ Engineer – AI Inference Runtime (QVAC Local AI Stack)

Tether.io • Colombia

Remote

Apply Now

AI Summary

Lead the development of the C++ runtime layer for QVAC’s local AI stack, optimizing inference engines like llama.cpp and ggml for edge devices. Focus on performance, stability, and scalability to enable private, on-device AI experiences. Collaborate with researchers to bridge AI research and production, defining core abstractions for future AI products.

Key Highlights

Own the C++ runtime layer for local AI inference, ensuring high performance, reliability, and hardware compatibility

Port and optimize inference engines (e.g., llama.cpp, ggml) for edge devices with low-latency and energy efficiency

Define core abstractions for AI features, balancing speed, memory, and maintainability for production use

Key Responsibilities

Develop and optimize the C++ runtime layer for deploying machine learning models on edge devices using llama.cpp and ggml

Collaborate with researchers to transition models from research to production environments, including coding and training support

Integrate AI features into existing products, enhancing them with cutting-edge machine learning advancements

Ensure runtime stability, low-latency performance, and hardware compatibility across diverse edge devices

Define and evolve core abstractions for AI inference to support future scalability and maintainability

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

Technical Skills Required

C++ Machine Learning Inference Engines (llama.cpp, ggml) GPU Frameworks (CUDA, Vulkan, Metal, OpenCL)

Benefits & Perks

Fully remote work

Global team collaboration

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Nice to Have

Experience training/fine-tuning LLMs

Productionizing AI models

Research experience in new model architectures

Distributed systems expertise

JavaScript experience

Job Description

At Tether, we’re not just building products, we’re pioneering a global financial revolution. Our cutting-edge solutions empower businesses—from exchanges and wallets to payment processors and ATMs—to seamlessly integrate reserve-backed tokens across blockchains. By harnessing the power of blockchain technology, Tether enables you to store, send, and receive digital tokens instantly, securely, and globally, all at a fraction of the cost. Transparency is the bedrock of everything we do, ensuring trust in every transaction.Our innovative product suite features the world’s most trusted stablecoin,

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.