Jobgether
Canada
Experienced Intermediate Software Engineer (Ruby on Rails) - Canada
Programming Full-time Mid-Senior level 1d ago
- AI
- Artificial Intelligence
- Gdpr
- IOS
Q
AI Summary
Design and evaluate autonomous AI agents across multiple LLMs for real-world domains. Provide expert human feedback to train Large Language Models for complex workflows. Requires backend engineering, AI automation, or systems integration experience with strong programming skills.
Key Highlights
Design and evaluate autonomous AI agents across multiple LLMs.
Provide expert human feedback for LLM training.
Requires experience in backend engineering, AI automation, or complex systems integration.
Key Responsibilities
Write evaluation rubrics with objective pass/fail criteria
Debug agent traces to identify failure patterns
Stress test agents against edge cases, prompt injection, and tool misuse
Assess production-grade modular software architecture
Analyse multi-turn system interactions and behaviours
Provide high-density technical feedback for LLM training
Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
Technical Skills Required
Benefits & Perks
Hourly compensation ranges from USD $30–$50
Weekly payments via PayPal or AirTM
Fully Remote
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
Nice to Have
Integrating agents with live tools such as Supabase, Gmail, and other APIs
Familiarity with persistent state and session-tracking patterns
Experience identifying privacy leaks, authority escalation, or indirect prompt injection vulnerabilities
Job Description
- Job Title: ML Engineer (Remote)
- Location: Remote (United States, Canada, United Kingdom, Australia)
- Work Mode: Fully Remote
Role Overview
Help design and evaluate autonomous AI agents across multiple LLMs, spanning health, education, daily life, and other real-world domains (all coding work). Shape the future of agentic AI systems by providing expert human feedback to leading AI organisations. Help train Large Language Models (LLMs) for complex, multi-step architectural workflows.
Key Responsibilities
AI Agent Evaluation
- Write evaluation rubrics with objective pass/fail criteria
- Debug agent traces to identify failure patterns
- Stress test agents against edge cases, prompt injection, and tool misuse
Want the full job description?
Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn
This is a short excerpt. All rights to the full description belong to its original publisher.
Keep exploring
Similar Jobs
Explore other opportunities that match your interests
Very
Canada
Lead Embedded Hardware Engineer (Remote - Canada)
Programming Full-time Mid-Senior level 1d ago
- AI
- Embedded
- Linux
- Product Design
Pushoperations
Canada
Full Stack Developer (Remote - Canada)
Programming Full-time Mid-Senior level 2d ago
- AI
- AWS
- Cloud
- Firebase
Remote Work Guides
Practical guides for finding and thriving in remote roles.
How to Get a Remote Job with No Experience
Getting a remote job with no experience is possible if the job seeker knows where to look and how to present their skills. Entry‑l...
Read Article
Do Remote Jobs Provide Equipment?
You might be wondering if your new employer will pay for your home office setup or if you’ll have to cover the costs yourself. The...
Read Article
What Are the Highest-Paying Remote Jobs?
If you’re looking for a career that offers a great income and the ability to work from anywhere, you’re not the only one. The job...
Read Article
Which Companies Offer Remote Jobs?
Advances in technology have made remote jobs more popular than before. Many companies now allow employees to work from home either...
Read ArticleSubscribe to our newsletter
New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.