AI Scenario Tester

Pixel Systems is looking for an AI Scenario Tester to help us test and verify the practical AI components we are adding to our business software projects. As our toolset grows, we need someone who can systematically check how these systems handle real world data inputs. This is a part time, contract position for someone early in their career who wants to gain experience in software testing and quality assurance within a fully remote team.

About Pixel Systems
We are a small software agency that builds the tools teams actually use. We do not do flashy consumer apps or marketing sites. Instead, we focus on practical solutions like admin panels, CRM integrations, and database migrations. Our clients come to us when they need to replace a disorganized spreadsheet with a real database or get their different software tools to communicate with each other. We use reliable, well-tested technologies like Node, React, and Postgres because we want the software we build to be stable and easy to maintain. Everything we do is fully remote, and we prefer a straightforward approach: fixed quotes, weekly demos, and clear documentation.

The Role
In this role, you will help us ensure that the AI features we build are accurate and predictable. You will not be writing the underlying code, but you will be the one responsible for trying to break it. You will spend your time creating different scenarios to see how the software reacts to various types of input, such as messy text, incomplete data, or unusual file formats. Your day to day work will involve the following:

• Creating lists of test cases to verify that an AI model is extracting the right information from business documents.
• Running manual tests on internal tools to see if they categorize support tickets or invoices correctly.
• Documenting bugs and unexpected behaviors in a clear, step by step format that developers can follow.
• Comparing different versions of AI outputs to see which one provides more accurate results for our clients.
• Participating in weekly remote demos to show the team what you found during your testing sessions.
• Verifying that fixes implemented by developers actually solve the issues you identified.
• Helping to organize the data folders and testing logs we use to track system performance over time.

Interested in remote work opportunities in QA & Testing? Discover QA & Testing Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

What You Bring
We are looking for someone who is organized and enjoys the process of finding small mistakes that others might miss. You do not need a specialized degree or previous professional experience in software testing to be successful here. We value the following qualities:

• A high level of attention to detail and the ability to stay focused on repetitive tasks.
• Strong communication skills in written English, with the ability to explain complex problems simply.
• A curious mindset and a desire to understand why a system is behaving a certain way.
• The ability to work independently and manage your own schedule in a remote environment.
• A patient approach to troubleshooting and an interest in how software is developed.
• Reliability and a commitment to meeting deadlines even when working on your own.

Helpful Background
While this is an entry level role and we provide guidance on our specific tools, some background knowledge will help you get started. It is helpful if you have any of the following:

• Basic familiarity with how websites work and what an API does.
• Experience using spreadsheets to organize information or track data.
• An interest in how large language models respond to specific instructions.
• Exposure to technical tools like GitHub or basic scripting in a language like Python.
• Previous experience in a role that required meticulous record keeping.
• A general understanding of what JSON data looks like.

Working at Pixel Systems
Working here means being part of a small team where everyone is expected to be useful. We do not have many layers of management, so you will work directly with the people building the software. We believe that working code is better than a perfect plan that never ships. This position is fully remote, allowing you to work from wherever you are most productive. This is a paid role with compensation that is competitive for the entry level market and the nature of the work. We offer a no-drama environment where we focus on solving real operational headaches for our clients. You will see the results of your work quickly as we ship updates every week.
We believe that the best software is the kind that people do not have to think about because it functions as expected every single time. Our goal is to take the stress out of business operations by building systems that are honest and reliable. If you enjoy solving problems and prefer practical, steady work over chasing the latest industry trends, you will find our approach refreshing. We value the quiet satisfaction of a job well done and the clarity that comes with building things the right way.