AI Prompt Engineer and Tester

Location: Remote (Serbia/Balkan)

Position Type: Full time, B2B contract

About the company

At SETVI, we’re on a mission to revolutionize how manufacturers and distributors accelerate revenue. Headquartered in Philadelphia, USA, and with a fast growing team in Belgrade, Serbia, our AI-powered platform cuts through manual complexity, streamlines operations, and unlocks new levels of efficiency and sales growth. By focusing exclusively on manufacturing and distribution, we deliver industry-specific tools and workflows that drive real impact where it matters most. Today, SETVI is helping to power businesses ranging from $100M to $1BN+ in revenue and, we're just getting started! 

Check us out here to learn more > https://setvi.com/

Role overview

We are a cutting-edge technology company at the forefront of the Artificial Intelligence (AI) revolution. Our mission is to create intelligent solutions to transform the Manufacturing and Distribution industry and drive innovation. As we continue to expand, we seek a talented and motivated AI Prompt Engineer and Tester to join our dynamic team and play a pivotal role in shaping the future of AI.

In this role, you will not only craft, optimize, and refine prompts for Large Language Models (LLMs) but also rigorously validate and test the results within our AI-driven platform. Your work will be pivotal in ensuring that AI outputs - from product matching to attribute comparisons - meet our high standards for accuracy, relevance, and quality.

What you'll do

Prompt Development & Optimization:

• Design, refine, and maintain clear, concise, and creative prompts to improve LLM performance.
• Experiment with various LLM prompt-engineering techniques to enhance model responses and tailor them to specific business needs.
• Analyze model outputs to identify areas of improvement and suggest prompts to our Data Scientist to optimize AI model performance. You will be trained on LLM prompts.

Rigorous Output Validation & Testing:

• Conduct thorough testing of AI outputs - such as product matches and product attribute comparisons - to ensure accuracy and consistency.
• Develop and follow test plans to identify, document, and track issues or areas of improvement in model responses.
• Self-learning and conducting research to stay updated with the latest advancements in AI, NLP (Natural Language Processing), and prompt engineering practices.

Cross-Functional Collaboration:

• Work closely with product managers, developers, and data scientists to align prompt strategies with overall product goals and customer requirements.
• Participate in client-facing meetings to gather feedback, provide insights, and ensure prompt strategies meet end-user expectations.

Your profile

• University degree in Machine Learning, Data Science or other related fields
• Knowledge of LLM, data science, machine learning principles, or NLP concepts
• Strong proficiency in English with an exceptional command of grammar, syntax, and language nuances
• Familiarity with AI-related tools, platforms, and models such as OpenAI, Gemini, Anthropic models or other LLMs
• Experience in client-facing roles
• A creative mindset with the ability to design engaging, clear, and effective prompts to elicit the desired AI responses
• Solid problem-solving and analytical skills, with a keen eye for detail
• Ability to conduct research and experiment with different prompt techniques to refine and improve model outputs
• Excellent communication skills, both written and verbal, with the ability to clearly explain prompt strategies and adjustments
• Passion for artificial intelligence, natural language processing, and the future of AI-driven technologies

Perks of working at SETVI

• Compensation above the industry average - because we want you to feel appreciated
• 21 days of PTO - excluding public holidays
• Work from anywhere - as long as you get the job done
• Opportunity to work on exciting projects at a growing startup company
• Monthly get-togethers with the local team
• Expand your knowledge and learn more about design, technology, and all things that spark your interest (Udemy courses)
• Referral bonuses