M

AI Research Engineer

micro1 • United Arab Emirates
Full Remote
Apply Now

Design evaluation frameworks and benchmarks for frontier coding agents at the intersection of AI research and software engineering. Lead end-to-end research initiatives measuring and improving coding model performance across diverse software engineering tasks. Build high-quality datasets, tooling, and infrastructure supporting large-scale experimentation and evaluation pipelines.

Key Highlights
Design evaluation frameworks and benchmarks for frontier coding agents
Lead end-to-end research initiatives measuring coding model performance
Build high-quality datasets, tooling, and evaluation infrastructure
3+ years experience in software engineering, ML, or AI research required
Key Responsibilities
Design and own evaluation frameworks for coding agents, including benchmark specifications, scoring methodologies, rubrics, and quality standards
Lead end-to-end research initiatives focused on measuring and improving coding model performance across diverse software engineering tasks
Develop high-quality datasets, golden examples, and evaluation protocols that enable reliable assessment of frontier coding systems
Analyze model behavior and failure modes, identifying systematic weaknesses and translating findings into actionable improvements
Build tooling and infrastructure that support large-scale experimentation, data generation, review workflows, and evaluation pipelines
Establish best practices for coding-agent assessment, ensuring methodological rigor, reproducibility, and measurement quality
Partner closely with researchers, engineers, and applied AI teams to design experiments and evaluate emerging model capabilities
Contribute to technical reports, benchmark studies, and client-facing research initiatives
Technical Skills Required
Python Machine Learning C++
Benefits & Perks
Up to 100% reimbursement for health-insurance premiums
Paid time off
401(K) plan with company match
Equity compensation
Nice to Have
Experience working on frontier AI systems, coding agents, or model evaluation research
Deep interest in understanding how data, evaluations, and feedback mechanisms influence model capabilities
Track record of independently driving ambiguous technical or research projects from conception to execution
Experience designing benchmarks or datasets for machine learning systems at scale
Familiarity with agentic workflows, tool use, reinforcement learning, or post-training methodologies
Publications, open-source contributions, or demonstrated technical leadership in AI, machine learning, or software engineering

Job Description

We are seeking a Member of Technical Staff to help advance the evaluation and development of frontier coding agents. Sitting at the intersection of AI research, software engineering, and model evaluation, you will design the benchmarks, methodologies, and data systems that shape how next-generation coding models are measured and improved.

What You'll Do

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Remote Work Guides

Practical guides for finding and thriving in remote roles.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.