... includes exploratory data analyses , statistical modeling work , machine learning pipelines , and technical reports. - Evaluate AI-generated or human-created work against established criteria to ensure quality and accuracy. - Provide detailed written justifications for evaluations and scores to maintain transparency. - Apply ...
AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll evaluate AI-generated responses using defined quality ...
... Reliability) Position Details As part of EY GDS Assurance Digital, you will help design, build, and scale a standardized evaluation capability, focused on evaluating GenAI, RAG-based, and Agentic AI solutions before deployment. This role sits at the intersection of AI evaluation engineering, Responsible AI, and GenAI security/red ...
... - English (India) Type: Contract Compensation: $12/hour Location: Remote Duration: Up to 6 months Commitment: 10+ hours/week Role Responsibilities - Evaluate AI model output lyrics, voice generation, and other standards in music. - Score the quality of musical training data to enhance model performance. - Collaborate with ...
... into actionable model or prompt improvements.- Establish AI governance documentation, audit trails, and safety reports.- Embed evaluation and safety checks into AI release pipelines with engineering teams.- Track relevant AI governance and regulatory frameworks, including NIST AI RMF and India/EU AI https://jobeax.com/link/XZWIbwdqxtvXofHu ...
... experience. - Degree in Mechanical , Electrical , Aerospace , Robotics , Computer Graphics , or related fields. - Experience with AI training, benchmarking, or evaluation. Start Date - Immediate start ; applications reviewed on a rolling basis. Application Process (Takes 20–30 mins to complete) - Upload resume - AI interview ...
... anymore — they're asking why some conversations succeed while others fail. Understanding that difference is one of the most important challenges in enterprise Voice AI today. Blue Machines runs production systems handling millions of conversations for India's largest airlines, banks, mutual funds, and retail chains. Not prototypes. ...
... Build grading criteria that define correct answers for scientific tasks. - Calibrate tasks against frontier models, ensuring tasks ship only when strong models fail more often than succeed. - Work independently and asynchronously to meet deadlines while improving AI model performance . Qualifications Must-Have - PhD in mathematics ...
... relevant mobile technologies across Android, iOS, and cross-platform development - Ensure tasks are technically accurate, challenging, and suitable for structured AI evaluation What We're Looking For Strong hands-on experience in at least one of these areas: - Cross-platform: TypeScript/JavaScript with React Native or Dart ...
... US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may: - Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor ...