We are looking for QA Engineers to support a project focused on testing AI outputs, evaluating data quality, and improving AI model performance.
This opportunity is suitable for professionals with strong QA experience who are interested in applying their testing and analytical skills to AI evaluation.
What You'll Do
Design, execute, and document test cases and scenarios.
Validate AI-generated outputs against defined requirements.
Review, annotate, and label datasets to support model training.
Evaluate model predictions and identify errors, inconsistencies, and patterns.
Document test results, evaluations, and feedback clearly.
Collaborate with cross-functional teams to clarify requirements and findings.
Help improve testing methodologies for AI-driven systems.
Provide actionable recommendations to improve data quality and model performance.
What We're Looking For
Hands-on experience in software QA and testing .
Strong understanding of test planning, execution, and defect reporting.
Experience with data annotation, data labeling, RLHF, or AI/model evaluation is preferred.
Strong analytical and problem-solving skills.
Excellent attention to detail.
English proficiency at B2 level or above .
Ability to work independently in a remote environment.
Project Details
Role: QA Engineer
Work Type: Contractor
Location: Remote
Focus: AI Evaluation, QA & Data Quality
AI Experience: Not required if you have relevant QA expertise.
JOB TITLE QA Engineer – AI Model Evaluation & Data Annotation (Remote Contract, $63–$120/hr) JOB TYPE Contract (remote) PAY Listed range: $63–$120 per hour. Final terms are confirmed during onboarding. LOCATION Remote ABOUT THE ROLE Neural Sourcing is sharing an open contract role from micro1, an AI training data company. ...
... and a better working world for all. EY- Assurance – Senior – Digital Role : GenAI / Agentic AI Evaluation Engineer (Quality, Safety & Reliability) Position Details As part of EY GDS Assurance Digital, you will help design, build, and scale a standardized evaluation capability, focused on evaluating GenAI, RAG-based, and ...
... designing evaluation frameworks for LLMs, RAG pipelines, AI agents, and data workflows. It sits where conventional QA automation meets the newer discipline of AI evaluation. Please note: This is a talent pipeline requirement. Durapid is building a pool of pre-screened AI QA Engineers for upcoming client projects in India, ...
We are looking for experienced Senior Mobile Software Engineers to contribute to a project focused on evaluating advanced AI systems through challenging mobile software engineering tasks. The role involves designing realistic coding problems, creating reproducible development environments, and developing reference solutions ...
... to test AI systems and can take ownership of AI quality and evaluation. We are looking for ownership-driven QA professionals who can solve problems, challenge AI behavior and improve quality rather than simply execute test https://jobeax.com/link/sLvd3ppXDN3k9Qmi Responsibilities:- Create AI test scenarios, datasets and ...
... processes align with banking application requirements and quality https://jobeax.com/link/NKlt3YnZFxTxA2qx Skills :- Strong experience in Test Automation and QA processes.- Hands-on experience in API Testing.- Strong SQL skills for data validation and testing.- Experience in Data Reconciliation Testing and migration validation.- ...
... methodologies. Qualifications - Prior paid human data experience supporting AI training—such as annotation, labeling, RLHF, AI response evaluation, model evaluation, or rubric-based grading—is required. - Professional experience as a QA Engineer, SDET, Test Engineer, QA Analyst, or in a similar software quality assurance ...
... team measure, trust, and improve the quality of AI https://jobeax.com/link/uHQAd3bTIk5DvSey this role, you will be responsible for defining and building Tekion’s AI evaluation capabilities as a shared platform service. You will work closely with ML Engineers, Data Scientists, the AI Platform team, and Product Management to ...