H

Senior AI Agent Evaluator and LLM Trainer

hire feed • Italy
Remote
This Job is No Longer Active This position is no longer accepting applications

Design and evaluate autonomous AI agents across multiple LLMs, shape the future of agentic AI systems, and provide expert human feedback to leading AI organisations.

Key Highlights
AI Agent Evaluation
Technical Assessment
Project Workflow
Key Responsibilities
Write evaluation rubrics with objective pass/fail criteria
Debug agent traces to identify failure patterns
Stress test agents against edge cases, prompt injection, and tool misuse
Technical Skills Required
Go Python JavaScript Java SQL databases
Benefits & Perks
Hourly compensation $30-$50
Weekly payments via supported payout platforms
Equal Opportunity Statement
Nice to Have
Experience integrating agents with live tools such as Supabase, Gmail, and other APIs
Familiarity with persistent state and session-tracking patterns
Experience identifying privacy leaks, authority escalation, or indirect prompt injection vulnerabilities

Job Description

  • Job Title: Go Developer (Remote)
  • Location: Remote (Finland, France, Italy, Norway)
  • Work Mode: Fully Remote

Role Overview

Help design and evaluate autonomous AI agents across multiple LLMs, spanning health, education, daily life, and other real-world domains (all coding work). Shape the future of agentic AI systems by providing expert human feedback to leading AI organisations. Help train Large Language Models (LLMs) for complex, multi-step architectural workflows.

Key Responsibilities

AI Agent Evaluation

  • Write evaluation rubrics with objective pass/fail criteria
  • Debug agent traces to identify failure patterns
  • Stress test agents against edge cases, prompt injection, and tool misuse

Technical Assessment

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources

Similar Jobs

Explore other opportunities that match your interests

Senior Software Engineer, AI Gateway (Multi-LLM Routing & Distributed Systems)

Programming
•
1d ago

Log in free to see full details

•••••• •••••• ••••••
Technical Skills Required ••••••

kong

Italy
Visa Sponsorship Relocation Remote
Technical Skills Required
ai angular c c# devops +4

heliont

Italy
Visa Sponsorship Relocation Remote
Technical Skills Required
ai aws cloud cyber security django +11

keypartners

Italy

Remote Work Guides

Practical guides for finding and thriving in remote roles.

Browse all articles

Subscribe our newsletter

New Things Will Always Update Regularly