Senior Ruby Developer - LLM Evaluation & Repository Validation (Part-Time, Remote)

hire feed • United States

Remote

This Job is No Longer Active This position is no longer accepting applications

AI Summary

Evaluate LLM performance on realistic code problems through hands-on engineering work. Analyze GitHub issues, set up code repositories, and collaborate with researchers. Requires 3+ years of software engineering experience and strong Ruby proficiency.

Key Highlights

Evaluate LLM performance on realistic code problems

Analyze and triage GitHub issues across trending open-source libraries

Set up and configure code repositories, including Dockerization and environment setup

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

Key Responsibilities

Analyze and triage GitHub issues across trending open-source libraries

Set up and configure code repositories, including Dockerization and environment setup

Evaluate unit test coverage and quality in public repositories

Modify and run codebases locally to assess LLM performance in bug-fixing scenarios

Collaborate with researchers to identify repositories and issues challenging for LLMs

Technical Skills Required

Ruby Git Docker

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Benefits & Perks

Competitive payout based on experience

Remote work (work from anywhere)

Job Description

Role: Ruby Developer (Remote)
Location: Remote (Work from Anywhere)
Job Type: Part-Time
Payout: Competitive, based on experience

Role Overview:

We are hiring for one of our clients, seeking a Senior Software Engineer – Ruby (LLM Evaluation & Repository Validation) to work on a part-time basis. The role involves building verifiable software engineering tasks using public repository histories for LLM training datasets. Candidates will evaluate LLM performance on realistic code problems through hands-on engineering work.

Key Responsibilities:

• Analyze and triage GitHub issues across trending open-source libraries.

• Set up and configure code repositories, including Dockerization and environment setup.

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.