We are looking for QA Engineers to support a project focused on testing AI outputs, evaluating data quality, and improving AI model performance.
This opportunity is suitable for professionals with strong QA experience who are interested in applying their testing and analytical skills to AI evaluation.
What You'll Do
Design, execute, and document test cases and scenarios.
Validate AI-generated outputs against defined requirements.
Review, annotate, and label datasets to support model training.
Evaluate model predictions and identify errors, inconsistencies, and patterns.
Document test results, evaluations, and feedback clearly.
Collaborate with cross-functional teams to clarify requirements and findings.
Help improve testing methodologies for AI-driven systems.
Provide actionable recommendations to improve data quality and model performance.
What We're Looking For
Hands-on experience in software QA and testing .
Strong understanding of test planning, execution, and defect reporting.
Experience with data annotation, data labeling, RLHF, or AI/model evaluation is preferred.
Strong analytical and problem-solving skills.
Excellent attention to detail.
English proficiency at B2 level or above .
Ability to work independently in a remote environment.
Project Details
Role: QA Engineer
Work Type: Contractor
Location: Remote
Focus: AI Evaluation, QA & Data Quality
AI Experience: Not required if you have relevant QA expertise.
JOB TITLE QA Engineer – AI Model Evaluation & Data Annotation (Remote Contract, $63–$120/hr) JOB TYPE Contract (remote) PAY Listed range: $63–$120 per hour. Final terms are confirmed during onboarding. LOCATION Remote ABOUT THE ROLE Neural Sourcing is sharing an open contract role from micro1, an AI training data company. ...
... designing evaluation frameworks for LLMs, RAG pipelines, AI agents, and data workflows. It sits where conventional QA automation meets the newer discipline of AI evaluation. Please note: This is a talent pipeline requirement. Durapid is building a pool of pre-screened AI QA Engineers for upcoming client projects in India, ...
QA Automation Engineer – Playwright & AI Summary We are seeking a highly skilled QA Automation Engineer specializing in Playwright and AI technologies to join our IT Services team. In this pivotal role, you will be responsible for designing and implementing robust automated testing frameworks that leverage modern tools ...
... quality reliability and accuracy of ML-driven systems through automated testing data validation API verification and telecom domain analytics. - Role: Senior AI Telecom QA Engineer - Location: All Persistent Locations - Experience: 6 to 12 Years - Job Type: Full-Time Employment What Youll Do: - Design develop and maintain ...
... quality reliability and accuracy of ML-driven systems through automated testing data validation API verification and telecom domain analytics. - Role: Senior AI Telecom QA Engineer - Location: All Persistent Locations - Experience: 6 to 12 Years - Job Type: Full-Time Employment What Youll Do: - Design develop and maintain ...
... detailing with right level of acceptance criteria, calling out dependencies and risks upfront. Required Skills & Experience - 3–8 years of relevant experience in QA, data testing, data validation, or quality engineering, depending on the position. - Strong SQL skills and experience validating data across source and target ...
... DPO) and the evaluation methodologies used to validate them, ideally gained at a frontier model labs.- Model benchmarking : experience building, running, or maintaining benchmark suites used to track and compare frontier model capabilities across training runs and releases.- Data quality : experience with the data quality ...
... plans, test data, automated browser and API checks, evidence reports, failure routing, and release confidence — with agents helping create and run the work, and engineers governing the quality. You will help design and operate this QA system, including: - Browser and API test runners - Synthetic test data - Isolated test environments ...
Job Overview We are looking for a skilled Senior QA Engineer with 4+ years of experience in Marketplace, SaaS, or E-commerce application testing . The ideal candidate should have strong expertise in manual testing, API testing, database validation, and end-to-end testing of marketplace platforms such as Autodesk Marketplace ...
QA Automation EngineerPython + Playwright / Java + Selenium / TOSCA & Enterprise AI SystemsAbout the Role:We are seeking a highly technical QA Automation Engineer to anchor the quality, reliability, and precision of our Enterprise AI and core software systems. In this role, you will be responsible for designing, building, ...