Senior Machine Learning Scientist – Speech Synthesis & Multi-Modal AI

Wiraa • United State

Remote Visa Sponsorship

Apply Now

AI Summary

Lead cutting-edge research in speech synthesis and multi-modal AI at Rime, designing advanced models for enterprise-grade voice AI. Focus on full/half-duplex architectures, neural codecs, and rigorous evaluation frameworks while collaborating with linguists. Requires deep expertise in PyTorch, speech representation, and production-ready model deployment.

Key Highlights

Research and develop state-of-the-art speech synthesis models (autoregressive/non-autoregressive) for enterprise-grade voice AI.

Lead multi-modal architectures for full/half-duplex communication, including unified sequence-to-sequence systems and neural codecs.

Collaborate with PhD linguists to align TTS frontend processes with model design, ensuring high-quality prosodic control.

Key Responsibilities

Design, implement, and evaluate advanced speech synthesis models (autoregressive and non-autoregressive).

Lead research on full/half-duplex multi-modal architectures, including unified sequence-to-sequence systems and neural codecs.

Develop and maintain rigorous evaluation frameworks balancing objective metrics and perceptual quality assessments.

Collaborate with linguists to align TTS frontend processes (e.g., grapheme-to-phoneme conversion, prosody) with model design.

Proactively identify and address data quality issues, including annotation pipeline degradation and evaluation set leakage.

Build and optimize data pipelines and training workflows to improve team efficiency and scalability.

Contribute to model deployment readiness, including performance optimization and integration with production systems.

Searching for Machine Learning & AI roles that provide visa sponsorship? Connect with international employers through Machine Learning & AI Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Technical Skills Required

PyTorch Speech Synthesis (Tacotron, FastSpeech, VITS, VALL-E, Codec-LM) Neural Codecs (EnCodec, DAC, Mimi)

Benefits & Perks

Competitive base salary with early-stage equity participation

Remote-friendly work environment with flexible location arrangements

Visa sponsorship available for eligible candidates

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Nice to Have

Multilingual TTS experience

Background in prosody or paralinguistics

Published research in speech/audio/ML venues

Experience deploying research models to production (e.g., quantization, distillation, streaming inference)

Job Description

Rime is a pioneering company specializing in voice AI solutions for enterprises managing large-scale customer experiences. Our core technology focuses on text-to-speech (TTS) models that are meticulously engineered to meet the demanding requirements of production environments, including pronunciation accuracy, low latency, and deployment flexibility. Unlike many others in the field, Rime's approach centers on the quality and depth of data rather than solely on model architecture. We have developed a proprietary corpus of full-duplex, studio-quality conversational speech, carefully recorded and annotated by PhD linguists, which serves as a unique competitive advantage. Supported by top-tier investors such as Unusual Ventures, our team operates at the nexus of product innovation, research excellence, and artisanal craftsmanship in voice model development. Our mission is to master the art of building voice AI that transforms pilots into scalable production systems.

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.