Loading description…
Vacancy description
Recruitment Room
$ 26880 - $ 69120 p.a.
भारत
Contract · Remote · Northern America & Europe
Annual Compensation Equivalent: $26,880–$69,120/year
Hourly Rate: $14–$36/hr
The annual compensation figure is a full-time equivalent based on 40 hours per week across 48 workable weeks. It is not a guaranteed salary or earnings level.
We are looking for Senior AI Trainers to evaluate and improve the quality of AI chat and search systems through structured model evaluation, prompt development, response annotation, and quality assurance.
You’ll assess AI-generated responses against detailed guidelines, identify inconsistencies and edge cases, create prompts that test model capabilities, and provide structured feedback to improve model performance. The role is remote and requires strong attention to detail, analytical thinking, and independent execution.
Evaluate AI chat and search tools under standardized and repeatable conditions.
Apply detailed grading guidelines to evaluate, rank, and annotate AI-generated responses.
Provide structured feedback to improve model accuracy, helpfulness, and overall performance.
Write, refine, and stress-test prompts covering diverse scenarios, edge cases, and user intents.
Verify consistency and accuracy across evaluations and correct discrepancies between ratings and established guidelines.
Use AI training and evaluation platforms to record findings and submit evaluation datasets.
Collaborate with project trainers and contributors to resolve ambiguities and improve evaluation guidelines.
Participate in ongoing quality reviews and incorporate feedback to maintain consistent annotation standards.
Work independently while meeting project requirements, quality standards, and deadlines.
Exceptional attention to detail and accuracy when reviewing AI-generated content.
Strong written and verbal communication skills.
Excellent time management and self-organization for remote work.
Analytical and problem-solving ability.
Ability to apply detailed guidelines consistently and identify subtle quality issues.
Ability to explain evaluation decisions clearly and constructively.
Experience with AI model training, RLHF, data labeling, annotation, or similar AI evaluation projects.
Familiarity with AI products, prompt engineering, and model behavior and limitations.
Experience creating evaluation rubrics or grading AI-generated outputs.
Experience reviewing AI responses for accuracy, helpfulness, consistency, or safety.
Background in AI training, machine learning data preparation, or LLM-focused projects.
Contractor engagement.
Remote work across Northern America and Europe.
Hourly rate: $14–$36/hr.
Annual compensation equivalent: $26,880–$69,120 based on 40 hours per week across 48 workable weeks.
Actual earnings depend on the amount of work assigned and completed.