G

Founding Engineer, Agent Harness for Production AI Systems

United States
Visa Sponsorship
This Job is No Longer Active This position is no longer accepting applications

Build the agent harness layer between frontier models and real users, including loops, tools, context, sandboxing, and evals. Ship and operate production agent workflows that run at scale, with full observability, replayability, and reliable execution. Own end-to-end problem solving and evaluation, requiring strong production software experience and core agent/tooling and debugging skills.

Key Highlights
Founding role building the agent harness layer for real customer usage
Own the full lifecycle from prototype to production and improve environments/evals/models from production traces
Design sandboxed, reproducible execution and an eval stack that detects reward hacking and silent failures
Key Responsibilities
Own the agent harness components including the agent loop, tool interface, system prompts, permissions, stop conditions, retries, budget caps, and output checks.
Build sandboxed execution environments (containers/microVMs) that are isolated, reproducible, and fast enough for thousands of parallel agent rollouts for serving and RL/evals.
Design context engineering strategies such as windowing, compaction, file-backed memory/state, retrieval, and sub-agent hand-offs for long-running tasks.
Make agent runs observable and replayable by tracing model calls, tool calls, and state changes for reproduction of failures.
Build the evaluation stack using offline suites, tests on production traces, LLM-as-judge, and checks for reward hacking and silent failures.
Ship the system with customers by embedding with real users, taking workflows from prototype to stable production, and turning patterns into reusable building blocks.
Close the loop with research by converting production traces and failures into tasks, environments, and reward signals for post-training.
Own model call routing and manage cost, latency, and quality trade-offs across where different models run.
Technical Skills Required
Python Docker Linux
Benefits & Perks
Hybrid in Palo Alto: 4+ days/week in office
Visa sponsorship: H-1B and OPT/CPT support available, with immigration counsel
Complimentary lunch, dinner, snacks, and drinks
Nice to Have
Experience building agent platforms, workflow systems, model-serving products, ML infrastructure, or other developer-facing AI systems.
Experience with multi-tenant control planes, identity and access management, metering or billing, enterprise security, or high-throughput APIs.
Familiarity with LLM inference, fine-tuning, evaluation, tool use, sandboxes, or the operational lifecycle of production agents.
Experience owning open-source SDKs, developer tools, API documentation, examples, or community-facing integrations.
Full-stack ability and an eye for interaction design for product problems beyond the backend.

Job Description

Goaly is a stealth AI startup founded by ex-Meta Superintelligence Labs engineers and researchers. Our mission is to dramatically lower the cost, time, and talent barriers to building proprietary AI — and make each generation of models faster and cheaper to build than the last.Backed by leading AI investors and endorsed by frontier AI researchers and builders, we’re looking for exceptional new grads who want to work on hard, foundational AI systems problems with outsized ownership from day one.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

BeaconFire Inc.

United States

New

AI Engineer

  • Javascript
  • Data Structures
  • Java
  • Angular
Visa

Visas, Work Permits & Legal Insights

Stay informed about visa types, work permits, and immigration updates for international professionals.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.