Back to list

Vacancy description

AI Agent Tester - Real-World Tasks - Remote in भारत

Recruitment Room

  • RemoteWork from anywhere
  • ContractFixed-term or freelance

$25 USD - $45 USD / hour

भारत

AI Agent Tester – Real-World Tasks - Remote

Role Overview

  • Employment Type: Contract

  • Location: Remote — United States

  • Compensation: $25–$45 per hour

  • Estimated Time per Task: Approximately 1.5 hours, including evidence collection and scoring

About the Role

We are seeking detail-oriented individuals to test AI agents on everyday tasks and evaluate their performance from a real user's perspective. You will compare two AI agents using your own accounts, assess their ability to complete practical activities, and document the quality, reliability, and usability of their results.

Tasks may involve shopping, travel bookings, bill payments, email follow-ups, returns, family logistics, and completing online forms. No coding or formal AI background is required, but familiarity with AI assistants and everyday digital workflows is important.

Key Responsibilities

  • Execute realistic scenarios involving errands, purchases, bookings, communications, and other everyday activities using two AI agents.

  • Approve, pause, or stop agents at key decision points when required.

  • Record each testing attempt using smartphone screen-recording capabilities.

  • Evaluate task completion, output quality, user control, satisfaction, and time taken.

  • Document errors, unexpected behavior, incomplete actions, and other usability issues.

  • Provide clear written feedback explaining what worked, what failed, and how the experience could improve.

  • Follow testing instructions and maintain accurate evidence and scoring for each run.

Required Qualifications

  • Be based in the United States and hold a bachelor's degree.

  • Have 2–3 years of professional experience, preferably in engineering, business management, office administration, or operations.

  • Use AI assistants regularly in everyday activities.

  • Have strong attention to detail and the ability to follow detailed instructions.

  • Demonstrate clear written communication and accurate documentation skills.

  • Have an active personal AI assistant account with Plus-tier access.

  • Have active access to Muse and Dots.

  • Own a smartphone capable of recording the screen.

  • Have a payment card available for test purchases, with eligible purchases reimbursed according to project terms.

Preferred Qualifications

  • Experience in a technical, business, or operational domain relevant to the scenarios being tested.

  • Strong familiarity with AI agents and their use in practical workflows.

  • Experience evaluating digital products, documenting user experiences, or identifying process failures.

Work Arrangement and Compensation

  • Hourly rate: $25–$45.

  • Schedule: Flexible, remote work performed using your phone.

  • Task duration: Approximately 1.5 hours per run, including evidence collection and scoring.

  • Test purchases: Eligible purchases are reimbursed according to project terms.

Selection Process

  1. Submit an application and complete the screening questions.

  2. Attend an interview lasting approximately 15–30 minutes.

  3. Complete a profile review.

  4. Complete onboarding before beginning assigned tasks.

Similar vacancies

More like this role

  • Remote
  • Contract

$25 USD - $45 USD / hour

AI Agent Tester – Real-World Tasks - Remote Role Overview - Employment Type: Contract - Location: Remote — United States - Compensation: $25–$45 per hour - Estimated Time per Task: Approximately 1.5 hours, including evidence collection and scoring About the Role We are seeking detail-oriented individuals to test AI agents ...

भारत

  • Full-time
  • IT
  • QA

$14.68 USD

Agent AI Platform Tester Position Description Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems ...

Bangalore, भारत

  • Remote
  • Contract
... role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. This operationally intensive engagement involves handling AI model and agent evaluations, often within strict timeframes and usage limit resets. ...

India, भारत

  • Remote
  • Full-time

₹380 INR - ₹570 INR / hour

... CRM Job details - Location: Remote, anywhere in India - Education: Any graduate - Employment type: Full-time - Pay: ₹380–₹570 a hour - Languages: English [{"name": "full_time", "text": "Full time", "categoryName": "Type of employment"}, {"name": "remote_work", "text": "Remote job", "categoryName": "Working conditions"}]

Indhur, भारत

  • Remote
  • Full-time

900k

... process, product functionality or usability, and performance during the design phase. - Agentic Systems Knowledge: An understanding of how to test and govern AI agents, ensuring they operate predictably, ethically, and securely. - Architectural Vision: Ability to translate complex business and technical realities into ...

Bangalore, भारत

  • Full-time
  • AI / ML
... ideal candidate combines strong software engineering fundamentals with hands-on experience building and operating real-world Agentic AI systems. What You'll Do Agentic Engineering & AI-Augmented SDLC - Drive the adoption of Agentic Engineering practices across the software development lifecycle , using AI agents to augment ...

Hyderabad, भारत

MARKETXPANDER SERVICES PRIVATE LIMITED

LeadSquared - Lead AI/ML Backend Engineer

  • Backend
... AI to take actions, retrieve knowledge, generate insights and get work done. With Agent Studio, we're enabling businesses to build, test and deploy their own AI agents for real-world workflows. And with Invorto, we're bringing AI to voice, allowing businesses to create intelligent voice agents tailored to their customer ...

Bangalore, भारत

  • Remote
... COMPENSATION: Output-based, with payment per task that meets project specifications. - PROJECT: AI training focused on real-world hardware engineering problems. - AI CODING AGENT EXPERIENCE: Mandatory. Key Responsibilities - Create technically rigorous, self-contained hardware engineering problems based on realistic industry ...

भारत

MARKETXPANDER SERVICES PRIVATE LIMITED

LeadSquared - Full Stack Engineer - Python

  • Fullstack
... AI to take actions, retrieve knowledge, generate insights and get work done. With Agent Studio, we're enabling businesses to build, test and deploy their own AI agents for real-world workflows. And with Invorto, we're bringing AI to voice, allowing businesses to create intelligent voice agents tailored to their customer ...

Bangalore, भारत

  • Full-time
Gushwork is building an Agent Operating System for small and mid-sized businesses around the world. It is a modern business software where AI agents and humans work together. Business owners and leaders set the goals. They decide what each agent is allowed to do. Then they review the metric each agent delivers. We started ...

Bangalore, भारत