AI Testing Engineer (Freelance | WFH)
About BeGig:
BeGig is a leading tech freelancing marketplace, connecting innovative early-stage non-tech founders with top-tier freelance talent. Joining BeGig means continuous access to high-impact AI, ML, and tech projects tailored to your expertise.
Your Opportunity:
We are looking for an AI Testing Engineer to ensure the reliability, accuracy, safety, and performance of AI models and applications. You’ll collaborate with developers and data scientists to build testing frameworks, evaluate AI outputs, and flag issues before deployment.
Role Overview:
- Develop and execute test plans for machine learning models and AI workflows.
- Evaluate LLM and model outputs for quality, bias, correctness, and edge cases.
- Collaborate with engineering teams to automate testing pipelines and ensure release readiness.
Key Responsibilities:
- Design unit, integration, and regression tests for ML models and LLM applications.
- Build automated evaluation frameworks to assess accuracy, latency, and behavior.
- Create synthetic datasets and edge cases to stress-test AI systems.
- Perform human-in-the-loop evaluations for prompt and agent-based workflows.
- Track model versioning, performance metrics, and testing coverage.
Technical Requirements:
- 2+ years in QA, ML testing, or AI application development.
- Proficiency in Python and testing tools (pytest, unittest, or custom scripts).
- Experience testing LLMs or generative models (OpenAI, Claude, etc.).
- Familiarity with LangChain, RAG workflows, or agent systems is a plus.
- Bonus: experience with CI/CD for AI/ML pipelines, MLflow, or similar tooling.
What We’re Looking For:
- Detail-oriented tester with deep understanding of AI system behaviors.
- Freelancer who can anticipate risks and ensure AI reliability.
- Comfortable working closely with development, product, and AI research teams.
Why Join Us:
- Contribute to building safe, effective, production-ready AI tools.
- Fully remote and flexible freelance opportunities.
- Get matched with future roles in AI QA, model evaluation, and test automation.
- Join a growing community focused on trust and accountability in AI systems.
Ready to put AI systems through their paces? Apply now to become an AI Testing Engineer with BeGig.
