Senior Python Engineer for LLM Evaluation

hackajob • India

Remote

This Job is No Longer Active This position is no longer accepting applications

AI Summary

Senior Python Engineer for part-time, task-based work focused on evaluating and testing Large Language Models (LLMs). Evaluate failure modes, design test cases, and analyze LLM behavior. Requires Python expertise, strong engineering judgment, and comfort with debugging code.

Key Highlights

Evaluating Large Language Models (LLMs)

Designing structured test cases

Analyzing LLM failure modes

Working directly with Git repositories and existing codebases

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

Technical Skills Required

Python Git Structured testing

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Benefits & Perks

Part-time, remote work

Flexible schedule

Job Description

Senior Python Engineer / LLM Evaluation – Part-Time, Remote

We are hiring experienced Python engineers for part-time, task-based work focused on evaluating and testing Large Language Models (LLMs).

This is not traditional QA and not junior AI labeling work. We are looking for senior engineers who can reason deeply about system behavior, ambiguity, and real-world usage — not just write code.

What You’ll Do

• Design structured test cases that simulate real human workflows

• Define gold-standard outputs and expected behaviors

• Analyze LLM failure modes such as hallucinations, bias, and context limitations

• Work directly with Git repositories and existing codebases

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.