A

Senior AI Optimization Engineer

Arm • United Kingdom
Visa Sponsorship
Apply Now

Join Arm's PE AI team to evaluate and improve AI-assisted and agentic engineering workflows, delivering measurable gains in productivity and quality. Build repeatable evaluation pipelines, instrument AI systems with tracing/metrics, and help engineering teams adopt effective AI-powered workflows. Requires hands-on software engineering skills and practical experience improving AI-assisted coding workflows using agent frameworks and coding assistants.

Key Highlights
Evaluate and improve AI-assisted and agentic engineering workflows at scale
Build repeatable evaluation pipelines and automated quality checks
Instrument AI workflows with tracing, metrics, and debugging capabilities
Help engineering teams adopt effective AI-powered workflows
Work collaboratively with technical leads and partner engineers
Key Responsibilities
Build repeatable evaluation pipelines and representative task-based datasets using MLflow and promptfoo
Instrument AI workflows with tracing and metrics using OpenTelemetry and Prometheus
Implement and test improvements to AI-assisted and agentic engineering workflows
Integrate automated quality checks into Jenkins pipelines or GitLab CI/CD workflows
Package evaluation tools and workflow services with Docker and deploy in cloud environments
Share findings and practical guidance, document evaluations, and peer review colleagues' work
Technical Skills Required
AWS CI/CD Docker
Nice to Have
Practical C# development experience
Experience designing evaluation methods for nondeterministic outputs including rubric-based scoring and model-based judging
Experience benchmarking AI-assisted workflows across different models, configurations, or engineering environments
Experience integrating AI evaluations and regression checks into CI/CD pipelines

Job Description

The PE AI team helps engineering teams across Arm adopt and improve AI tools, agents, and workflows for measurable gains in productivity and quality.

As a Senior AI Optimization Engineer, you'll evaluate real-world AI use cases and improve AI-assisted and agentic engineering workflows, balancing task success and quality with latency, reliability, and cost. You'll create repeatable evaluations and automated quality checks, use evidence to guide improvements, and help engineering teams adopt effective workflows.

Responsibilities

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Visas, Work Permits & Legal Insights

Stay informed about visa types, work permits, and immigration updates for international professionals.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.