Back to list

Vacancy description

QA Engineer - AI Evaluation & Data Quality in India, भारत

eDataBae

  • RemoteWork from anywhere
  • ContractFixed-term or freelance

India, भारत

We are looking for QA Engineers to support a project focused on testing AI outputs, evaluating data quality, and improving AI model performance.

This opportunity is suitable for professionals with strong QA experience who are interested in applying their testing and analytical skills to AI evaluation.

What You'll Do

  • Design, execute, and document test cases and scenarios.
  • Validate AI-generated outputs against defined requirements.
  • Review, annotate, and label datasets to support model training.
  • Evaluate model predictions and identify errors, inconsistencies, and patterns.
  • Document test results, evaluations, and feedback clearly.
  • Collaborate with cross-functional teams to clarify requirements and findings.
  • Help improve testing methodologies for AI-driven systems.
  • Provide actionable recommendations to improve data quality and model performance.

What We're Looking For

  • Hands-on experience in software QA and testing .
  • Strong understanding of test planning, execution, and defect reporting.
  • Experience with data annotation, data labeling, RLHF, or AI/model evaluation is preferred.
  • Strong analytical and problem-solving skills.
  • Excellent attention to detail.
  • English proficiency at B2 level or above .
  • Ability to work independently in a remote environment.

Project Details

  • Role: QA Engineer
  • Work Type: Contractor
  • Location: Remote
  • Focus: AI Evaluation, QA & Data Quality
  • AI Experience: Not required if you have relevant QA expertise.

Similar vacancies

More like this role

  • Remote
  • Full-time
  • Contract

$60 USD - $100 USD / hour

... Design Engineer AI Evaluation Type: Contract Compensation: $60$100/hour Location: Remote Commitment: 20 hours/week Role Responsibilities - Design realistic engineering problems with prompts input files and graders to evaluate AI models . - Develop tasks using SolidWorks AutoCAD FreeCAD and code-based CAD tools like build123d ...

Bombay, भारत

  • Full-time
  • Contract
  • IT
  • QA
... trained to formalize and reason with a symbolic world model encoded in Lean 4. Pramaana was founded by a team out of Google, DeepMind, and Glean, combining frontier AI researchers and formal methods experts. The Role QA/SDET (Software Development Engineer in Test) for a rules-to-proof product. You test every stage of the pipeline, ...

Bangalore, भारत

  • Full-time
  • QA

$14.68 USD

... experience. We are looking for an experienced Agentic AI QA Partner to drive quality engineering, validation, evaluation, and governance for Agentic AI and Generative AI solutions across the product. Your future duties and responsibilities • Define and implement QA and Quality Engineering strategies for Agentic AI and Generative ...

Bangalore, भारत

  • Remote
  • Contract
  • Medicine

$50 USD

... no hour logging. There are no tiers or speed adjustments to the rate. QA and adjudication tasks have a higher per-task rate. - $50 one-time onboarding reward, paid once your first task on the project is approved. - Quality incentives: additional earnings for high-quality approved tasks, on terms set out in the project guidelines. ...

Bangalore, भारत

  • Remote
  • Part-time
  • Contract
  • Medicine

$50 USD

... no hour logging. There are no tiers or speed adjustments to the rate. QA and adjudication tasks have a higher per-task rate. - $50 one-time onboarding reward, paid once your first task on the project is approved. - Quality incentives: additional earnings for high-quality approved tasks, on terms set out in the project guidelines. ...

Delhi, भारत

  • Part-time
  • Medicine

$35 USD - $50 USD / hour

... flat rate set to about $35/hr equivalent based on estimated task time. There are no tiers or speed adjustments to the base rate. QA and adjudication tasks are paid at a higher rate. - $50 one-time onboarding reward, paid once your first production task is approved - Incentives: additional earnings for high-quality approved ...

Bombay, भारत

  • Contract
  • IT
  • QA
... plans. • Design, execute, and maintain functional, regression, integration, API, data validation, and exploratory test coverage for assigned features. • Build and maintain automated tests using approved frameworks and contribute to stable CI/CD quality gates. • Partner with product owners, engineers, business analysts, and operations ...

Bangalore, भारत

  • On-site
  • Full-time
  • Contract
  • IT
  • QA
... Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent hands-on experience. - Three to five years of experience, as stated for the QA Engineer II role. - Experience with AI-powered QA tools or techniques, including test generation, failure triage, or visual testing. - Experience writing automated ...

Bangalore, भारत

  • Hybrid
  • Full-time
  • Contract
  • IT
  • QA
QA Engineer - Bhilai Location Are you passionate about automation and building high-quality software? We are looking for a hands-on QA Engineer to design automation solutions, improve test coverage, and ensure quality across our enterprise applications. Join us to work on challenging projects, modern technologies, and make ...

Bhilai, भारत

  • IT
  • QA
... Practical experience testing AI/ML and AI-enabled applications, including model outputs, APIs, backend services, and application integrations. - Strong knowledge of QA methodologies, test automation strategies, API testing, and software quality engineering best practices within Agile/Scrum environments. - Experience with AWS, ...

Bangalore, भारत

  • Hybrid
  • IT
  • QA
... and we are seeking a meticulous and detail-oriented Automation Quality Analyst specialising in Playwright to join our quality assurance team. As an Automation QA Analyst, you will play a critical role in ensuring the quality and reliability of our software products by designing and maintaining automated test coverage, executing ...

India, भारत