Back to list

Vacancy description

QA Engineer - AI Evaluation & Data Quality in India, भारत

eDataBae

  • RemoteWork from anywhere
  • ContractFixed-term or freelance

India, भारत

We are looking for QA Engineers to support a project focused on testing AI outputs, evaluating data quality, and improving AI model performance.

This opportunity is suitable for professionals with strong QA experience who are interested in applying their testing and analytical skills to AI evaluation.

What You'll Do

  • Design, execute, and document test cases and scenarios.
  • Validate AI-generated outputs against defined requirements.
  • Review, annotate, and label datasets to support model training.
  • Evaluate model predictions and identify errors, inconsistencies, and patterns.
  • Document test results, evaluations, and feedback clearly.
  • Collaborate with cross-functional teams to clarify requirements and findings.
  • Help improve testing methodologies for AI-driven systems.
  • Provide actionable recommendations to improve data quality and model performance.

What We're Looking For

  • Hands-on experience in software QA and testing .
  • Strong understanding of test planning, execution, and defect reporting.
  • Experience with data annotation, data labeling, RLHF, or AI/model evaluation is preferred.
  • Strong analytical and problem-solving skills.
  • Excellent attention to detail.
  • English proficiency at B2 level or above .
  • Ability to work independently in a remote environment.

Project Details

  • Role: QA Engineer
  • Work Type: Contractor
  • Location: Remote
  • Focus: AI Evaluation, QA & Data Quality
  • AI Experience: Not required if you have relevant QA expertise.

Similar vacancies

More like this role

  • Remote
  • Contract
  • IT
  • QA

$63 USD - $120 USD / hour

JOB TITLE QA Engineer – AI Model Evaluation & Data Annotation (Remote Contract, $63–$120/hr) JOB TYPE Contract (remote) PAY Listed range: $63–$120 per hour. Final terms are confirmed during onboarding. LOCATION Remote ABOUT THE ROLE Neural Sourcing is sharing an open contract role from micro1, an AI training data company. ...

Bangalore, भारत

Durapid Technologies Pvt Ltd

AI QA Engineer

  • Full-time
  • Contract
  • IT
  • QA

Rs 5 - 10 lakhs p.a.

... designing evaluation frameworks for LLMs, RAG pipelines, AI agents, and data workflows. It sits where conventional QA automation meets the newer discipline of AI evaluation. Please note: This is a talent pipeline requirement. Durapid is building a pool of pre-screened AI QA Engineers for upcoming client projects in India, ...

India, भारत

  • Hybrid
  • Full-time
  • IT
  • QA

$436 USD - $1654.4 USD

... quality reliability and accuracy of ML-driven systems through automated testing data validation API verification and telecom domain analytics. - Role: Senior AI Telecom QA Engineer - Location: All Persistent Locations - Experience: 6 to 12 Years - Job Type: Full-Time Employment What Youll Do: - Design develop and maintain ...

Pune, भारत

  • Hybrid
  • Full-time
  • IT
  • QA

$436 USD - $1654.4 USD

... quality reliability and accuracy of ML-driven systems through automated testing data validation API verification and telecom domain analytics. - Role: Senior AI Telecom QA Engineer - Location: All Persistent Locations - Experience: 6 to 12 Years - Job Type: Full-Time Employment What Youll Do: - Design develop and maintain ...

Pune, भारत

  • Full-time
  • IT
  • QA

Rs 10 - 20 lakhs p.a.

... detailing with right level of acceptance criteria, calling out dependencies and risks upfront. Required Skills & Experience - 3–8 years of relevant experience in QA, data testing, data validation, or quality engineering, depending on the position. - Strong SQL skills and experience validating data across source and target ...

Hyderabad, भारत

  • Remote
  • Full-time
  • IT
... plans, test data, automated browser and API checks, evidence reports, failure routing, and release confidence — with agents helping create and run the work, and engineers governing the quality. You will help design and operate this QA system, including: - Browser and API test runners - Synthetic test data - Isolated test environments ...

India, भारत

nCircle Tech Pvt. Ltd.

QA Engineer / Sr QA Engineer

  • Full-time
  • Contract
  • IT
  • QA
Job Overview We are looking for a skilled Senior QA Engineer with 4+ years of experience in Marketplace, SaaS, or E-commerce application testing . The ideal candidate should have strong expertise in manual testing, API testing, database validation, and end-to-end testing of marketplace platforms such as Autodesk Marketplace ...

Pune, भारत

  • Remote
  • Full-time
  • IT
  • QA
... design, strategy and alignment. Job Description QAD is seeking a Sr QA Engineer to own the continuous validation and quality of Champion Assist, a multi- agent AI product with ~20 evolving agents. You will test the agents themselves: their reasoning, tool use, orchestration and handoffs, and the quality of their responses. ...

Pune, भारत

  • Hybrid
QA Automation EngineerPython + Playwright / Java + Selenium / TOSCA & Enterprise AI SystemsAbout the Role:We are seeking a highly technical QA Automation Engineer to anchor the quality, reliability, and precision of our Enterprise AI and core software systems. In this role, you will be responsible for designing, building, ...

India, भारत

  • Hybrid
  • IT
  • QA
... etc. BI team has four sub-components as Data analysis, ETL, Data Visualization and QA. It manages deliveries through Snowflake, Sisense and Microstrategy as main infrastructure solutions. Other technologies including Python, R, Airflow are also used in ETL, QA and data visualizations. WHAT YOU’LL DO - Work with Business ...

Noida, भारत