H

AI Agent Evaluator and LLM Engineer

hire feed • Norway
Remote
This Job is No Longer Active This position is no longer accepting applications

Evaluate and improve autonomous AI agents across multiple domains, providing expert human feedback to leading AI organizations. Design and evaluate Large Language Models (LLMs) for complex workflows. Assess production-grade software architecture and provide high-density technical feedback.

Key Highlights
Evaluate AI agents and LLMs
Design and evaluate complex workflows
Assess software architecture
Key Responsibilities
Write evaluation rubrics with objective pass/fail criteria
Debug agent traces to identify failure patterns
Stress test agents against edge cases, prompt injection, and tool misuse
Technical Skills Required
Python JavaScript Go Java SQL AI automation backend engineering complex systems integration
Benefits & Perks
Remote work
Hourly compensation $30-$50
Weekly payments via PayPal or AirTM
Nice to Have
Experience integrating agents with live tools such as Supabase, Gmail, and other APIs
Familiarity with persistent state and session-tracking patterns
Experience identifying privacy leaks, authority escalation, or indirect prompt injection vulnerabilities

Job Description

  • Job Title: LLM Engineer (Remote)
  • Location: Remote (Finland, France, Italy, Norway)
  • Work Mode: Fully Remote

Role Overview

Help design and evaluate autonomous AI agents across multiple LLMs, spanning health, education, daily life, and other real-world domains (all coding work). Shape the future of agentic AI systems by providing expert human feedback to leading AI organisations. Help train Large Language Models (LLMs) for complex, multi-step architectural workflows.

Key Responsibilities

AI Agent Evaluation

  • Write evaluation rubrics with objective pass/fail criteria
  • Debug agent traces to identify failure patterns
  • Stress test agents against edge cases, prompt injection, and tool misuse

Technical Assessment

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources

Similar Jobs

Explore other opportunities that match your interests

Visa Sponsorship Relocation Remote
Technical Skills Required
ai ai tools css figma git +4

orviko

Norway
Visa Sponsorship Relocation Remote
Technical Skills Required
ai angular asp.net cloud containerization +5

accelerec ltd.

Pakistan
Visa Sponsorship Relocation Remote
Technical Skills Required
ai django git python

talenthop

United State

Remote Work Guides

Practical guides for finding and thriving in remote roles.

Browse all articles

Subscribe our newsletter

New Things Will Always Update Regularly