MLOps Engineer

hire feed • Australia

Remote

This Job is No Longer Active This position is no longer accepting applications

AI Summary

Design and evaluate autonomous AI agents, shape the future of agentic AI systems, and provide expert human feedback to leading AI organizations. The role involves writing evaluation rubrics, debugging agent traces, and stress testing agents. Strong technical skills in AI, software architecture, and programming languages are required.

Key Highlights

Design and evaluate autonomous AI agents

Shape the future of agentic AI systems

Provide expert human feedback to leading AI organizations

Key Responsibilities

Write evaluation rubrics with objective pass/fail criteria

Debug agent traces to identify failure patterns

Stress test agents against edge cases, prompt injection, and tool misuse

Assess production-grade modular software architecture

Analyse multi-turn system interactions and behaviours

Provide high-density technical feedback for LLM training

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

Technical Skills Required

Python JavaScript Go Java SQL databases

Benefits & Perks

Hourly compensation: $30-$50

Weekly payments via PayPal or AirTM

Full compensation details provided prior to task acceptance

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Nice to Have

Experience integrating agents with live tools such as Supabase, Gmail, and other APIs

Familiarity with persistent state and session-tracking patterns

Experience identifying privacy leaks, authority escalation, or indirect prompt injection vulnerabilities

Job Description

Job Title: MLOps Engineer (Remote)
Location: Remote (United States, Canada, United Kingdom, Australia)
Work Mode: Fully Remote

Role Overview

Help design and evaluate autonomous AI agents across multiple LLMs, spanning health, education, daily life, and other real-world domains (all coding work). Shape the future of agentic AI systems by providing expert human feedback to leading AI organisations. Help train Large Language Models (LLMs) for complex, multi-step architectural workflows.

Key Responsibilities

AI Agent Evaluation