Senior Python Software Engineer - LLM Evaluation & Repository Validation (Part-Time, Remote)

hire feed • Latin America

Remote

This Job is No Longer Active This position is no longer accepting applications

AI Summary

Analyze and triage GitHub issues, set up code repositories, evaluate unit tests, and collaborate with researchers to expand dataset coverage for AI-assisted software development. Requires 3+ years of Python experience, Git, Docker, and navigating complex codebases.

Key Highlights

Work on cutting-edge AI projects with leading LLMs

Blend practical software engineering with AI research

Shape the future of developer tools

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

Key Responsibilities

Analyze and triage GitHub issues across trending open-source libraries

Set up and configure code repositories, including Dockerization and environment setup

Evaluate unit test coverage and quality in public repositories

Modify and run codebases locally to assess LLM interaction with real-world projects

Collaborate with researchers to identify repositories and issues challenging for LLMs

Technical Skills Required

Python Git Docker

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Benefits & Perks

Competitive payout based on experience

Remote work (work from anywhere)

Job Description

Role: Software Engineer – Python (Remote)
Location: Remote (Work from Anywhere)
Job Type: Part-Time
Payout: Competitive, based on experience

Role Overview:

We are hiring for one of our clients, seeking a Senior Software Engineer – Python (LLM Evaluation & Repository Validation) to work on a part-time basis. The role involves building verifiable software engineering tasks based on public repository histories using synthetic approaches with human-in-the-loop validation. The projects focus on creating LLM evaluation and training datasets for realistic software engineering problems.

Key Responsibilities:

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.