O

Data Analyst - Translation Quality & AI

OnTheGoSystems • Serbia
Remote
Apply
AI Summary

OnTheGoSystems is seeking a Data Analyst to investigate and improve AI-powered translation quality by analyzing user behavior, AI performance, and multilingual data. The role involves owning analytical problems end-to-end, forming hypotheses, and turning data into actionable recommendations for the LLM team. The ideal candidate has strong analytical skills, proficiency in SQL and Python, and fluency in English plus at least one additional language.

Key Highlights
Investigate translation quality issues by analyzing user edits, AI outputs, and customer feedback across language pairs
Define metrics, monitor trends, and separate real signals from coincidence using data-driven hypothesis testing
Build repeatable reports, scripts, and monitoring processes to continuously improve machine translation quality
Key Responsibilities
Define meaningful metrics for translation quality, AI performance, and user behavior
Monitor trends and identify unusual patterns or quality issues in translation data
Turn observations into structured investigations and test multiple hypotheses
Extract and combine data from SQL databases, NoSQL databases, logs, APIs, and CSV exports
Compare results across language pairs, AI models, providers, customers, content types, and traffic levels
Separate real signals from coincidence by validating findings with data
Review translation samples to confirm whether patterns represent genuine quality issues
Investigate root causes and recommend practical improvements
Evaluate multilingual AI output for meaning, terminology, tone, formality, grammar, pronouns, and consistency
Use AI tools, dictionaries, and other resources to investigate languages while recognizing when expert linguistic input is needed
Review AI-generated analyses, identify incorrect conclusions, and help improve automated evaluation systems
Build repeatable reports, scripts, and monitoring processes
Communicate findings clearly to developers, product managers, and linguists
Technical Skills Required
SQL Python Data Analysis
Benefits & Perks
100% remote work
Body & Mind Movement program
Home office computer budget
Nice to Have
Experience with translation quality or localization
Experience with multilingual content
Experience with data visualization or business intelligence tools

Job Description


At OnTheGoSystems, we're building AI systems that help people translate content across many languages. Our LLM team works with AI-generated translations, user edits, customer feedback, and quality data to continuously improve translation quality.

We're looking for a Data Analyst who enjoys solving open-ended problems, finding patterns in complex datasets, and turning data into practical recommendations. This is not a reporting role. You'll decide what to measure, investigate why things happen, and help the team make better decisions based on evidence.

What You'll Do

You'll own analytical problems from start to finish.

For example, you may discover that users edit translations much more often for one language pair than another. Instead of simply reporting it, you'll investigate why. You'll form hypotheses, gather the data, test possible explanations, and recommend the next steps.

Your work will include:

  • Defining meaningful metrics for translation quality, AI performance, and user behavior
  • Monitoring trends and identifying unusual patterns or quality issues
  • Turning observations into structured investigations and testing multiple hypotheses
  • Extracting and combining data from SQL databases, NoSQL databases, logs, APIs, and CSV exports
  • Comparing results across language pairs, AI models, providers, customers, content types, traffic levels, and other dimensions
  • Separating real signals from coincidence by validating findings with data
  • Reviewing translation samples to confirm whether patterns represent genuine quality issues
  • Investigating root causes and recommending practical improvements
  • Evaluating multilingual AI output for meaning, terminology, tone, formality, grammar, pronouns, and consistency
  • Using AI tools, dictionaries, and other resources to investigate languages you don't speak, while recognizing when expert linguistic input is needed
  • Reviewing AI-generated analyses, identifying incorrect conclusions, and helping improve our automated evaluation systems
  • Building repeatable reports, scripts, and monitoring processes
  • Communicating findings clearly to developers, product managers, and linguists

Requirements

  • Strong analytical thinking, curiosity, and attention to detail
  • The ability to work independently and define what should be investigated
  • Experience turning open-ended questions into structured analyses and actionable recommendations
  • A solid understanding of metrics, segmentation, distributions, correlations, and the difference between correlation and causation
  • Experience writing SQL, Python, or similar scripts to collect, clean, and analyze data
  • Experience working with multiple data sources, including databases, logs, APIs, and exported datasets
  • Strong hands-on experience using AI tools while critically evaluating their output
  • Fluent English plus at least one additional language (preferably European), with the ability to assess translation quality and explain language issues
  • Clear written communication and the ability to explain analytical findings to non-technical colleagues

Bonus points for experience with:

  • Translation quality or localization
  • Multilingual content
  • Data visualization or business intelligence tools

Benefits

You'll work on real AI systems used by customers around the world and directly influence how we measure and improve machine translation quality.

This role is ideal for someone who enjoys exploring difficult questions, testing ideas, and discovering insights that aren't immediately obvious. You'll have the freedom to propose your own analyses and the responsibility to turn them into evidence-based recommendations.

What We Offer

  • 100% remote work
  • Body & Mind Movement program
  • Home office computer budget
  • Kindle with access to our company library
  • Local public holidays respected
  • Excellent opportunities for growth
  • Collaboration with talented colleagues across the globe

If you're excited by data, languages, AI, and solving complex problems, apply now, and we'd love to hear from you!

Similar Jobs

Explore other opportunities that match your interests

Junior Business Intelligence Analyst

Data Science
•
6d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Associate

AI Digital

Serbia
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Entry level

hiredbuddy

United State

Data Architect

Data Science
•
5h ago
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Mid-Senior level

Arkhya Tech. Inc.

United State

Subscribe our newsletter

New Things Will Always Update Regularly