QA Engineer - Work From Home
About the Role
This remote contract opportunity is for a software quality assurance professional to evaluate technical AI outputs and help improve the performance of next-generation AI systems. The role focuses on assessing response accuracy, testing quality, identifying defects, and providing structured feedback that supports better AI training and evaluation. Prior AI experience is not required, but candidates must have previous paid experience in human-in-the-loop AI evaluation work. Strong software testing skills, attention to detail, and clear written communication are essential for this high-volume project.
Key Responsibilities
Evaluate and score AI-generated technical outputs against established quality criteria and rubrics, identifying responses that appear correct but contain inaccuracies or omissions. Design and assess functional, regression, edge-case, negative, and boundary test cases. Review bug reports and test documentation for reproducibility, completeness, and appropriate severity assessment. Identify, isolate, and document defects with precise reproduction steps using structured tracking methods. Provide detailed written feedback and annotations that developers can understand and act on without further clarification. Collaborate with project teams to refine evaluation guidelines and improve testing standards and methods.
Required Qualifications
Professional experience as a QA Engineer, SDET, Test Engineer, QA Analyst, or in a comparable software quality assurance role. Strong knowledge of quality assurance, software testing, test case design, bug tracking, regression testing, and manual and automated testing strategies. Hands-on experience with automation frameworks and test management tools such as Selenium, Playwright, Cypress, Appium, Postman, Jira, TestRail, Zephyr, BrowserStack, or similar tools. Previous paid experience supporting AI training through human data annotation, labeling, reinforcement learning from human feedback (RLHF), AI response or model evaluation, or rubric-based grading. Software QA experience alone does not satisfy this project requirement. Strong analytical and problem-solving skills, attention to detail, and the ability to communicate complex findings clearly in written English at B2 level or above. Reliable internet access and readiness to begin promptly. Education and Experience No formal degree is required. Practical testing experience and relevant hands-on skills are prioritized. Location and Employment Type This is a remote contract engagement supporting a high-volume project.
Compensation
The compensation range is $90 to $175 per hour.