Evaluate and monitor Voice AI Agents to improve psychiatric care automation and patient journeys. Analyze production behavior, investigate AI failures, and design evaluation frameworks for reliability. Requires 5+ years of analytics experience, strong SQL and Python skills, and fluency in Russian.
Key Highlights
Focus on Voice AI Agents in a high-impact healthcare environment
Direct influence on product decisions using production evidence and AI behavior analysis
High ownership role working at the intersection of Product, Engineering, and Operations
Key Responsibilities
Analyze production behavior of Voice AI Agents and conversational AI workflows.
Investigate hallucinations, inconsistencies, silent failures, and quality degradation in AI-driven conversations.
Work with call transcripts, logs, and operational datasets to uncover actionable insights.
Design evaluation frameworks for measuring AI quality, reliability, and business impact.
Build monitoring systems and dashboards for AI performance visibility.
Measure the impact of AI systems on operational efficiency, business outcomes, and patient experience.
Detect quality shifts, anomalies, and emerging failure modes in production environments.
Partner with Product, Engineering, QA, and Operations teams on AI initiatives.
Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
Technical Skills Required
SQL
Python
Product Analytics
Benefits & Perks
Fully remote
Health insurance after probation
Sports & wellness compensation
Personalized English lessons via Preply
19 working days of vacation per year
3 additional wellness days
Paid sick leave for the first 5 working days
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
Nice to Have
Experience with conversational AI or AI agents
Experience evaluating LLM outputs
Experience with AI quality metrics and evaluation methodologies
Experience with prompt iteration and AI evaluation frameworks
Job Description
is an AI-powered mental healthcare platform setting a new standard for safe, effective, and scalable psychiatric care in the United States. We combine licensed providers with proprietary AI tools to deliver consistent, outcomes-driven treatment for conditions like ADHD, anxiety, depression, and more. MEDvidi's technology automates charting, follow-ups, and treatment planning, freeing providers to focus on patient care while improving efficiency and clinical quality.
Want the full job description?
Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn
This is a short excerpt. All rights to the full description belong to its original publisher.
