Back to list

Vacancy description

AI Model Benchmarking Intern (Remote, Iowa-Based) in भारत

Braintrust

  • RemoteWork from anywhere
  • Part-timeFewer hours each week
  • ContractFixed-term or freelance

$22 USD - $28 USD / hour

भारत

  • Rate: $22 – $28/hr
  • Hours: 20 hours / week
  • Experience: 1 - 3 years
  • Location: United States | Canada + 23 more

AI Model Benchmarking Intern (Remote, Iowa-Based)

Part-time, 15–20 hours/week · Remote, Iowa-based · 6-month internship · $22–$28/hour

About SureHost

SureHost is an early-stage hospitality technology company based in Des Moines, Iowa. We help growing short-term rental operators confirm each property is guest-ready after a cleaning turn, using documented property standards, photo and video evidence, AI-assisted review, and human review where it matters.

We are working with an initial paying customer and preparing for broader growth in the U.S. market. Our customer and product work happens in Des Moines, and our technical team is based in Pune, India. Our stack is Python and Flutter, deployed on GCP.

The role

SureHost uses AI narrowly, where it can be measured and trusted. Language and vision models change quickly, and a model that looks strong in a demo can still fail on real property footage, cost too much to run, or make decisions an operator cannot follow.

In this role, you will help us tell the difference. You will build repeatable benchmarks that compare LLMs and VLMs on SureHost use cases, and your findings will inform model choices and the product roadmap. You will work with our AI Chief Architect.

What you will do

  • Research and compare evolving LLM and VLM models that may support SureHost's product use cases.
  • Create representative evaluation datasets, test cases, scoring criteria, and repeatable benchmark workflows.
  • Measure model quality across accuracy, reliability, latency, cost, and other product-relevant factors.
  • Analyze failure patterns and trade-offs, including false positives and false negatives on issues operators care about.
  • Present clear findings and recommendations to inform model strategy and the product roadmap.
  • Maintain benchmark results and documentation as models, APIs, and requirements change.

What you bring

  • Interest in applied AI and familiarity with LLMs, VLMs, generative AI tools, or model APIs through coursework or projects.
  • Logical, evidence-based thinking and comfort working with structured data and evaluation criteria.
  • Basic Python or data-analysis skills.
  • The ability to document methods and results clearly.
  • Patience to run repeatable experiments, investigate edge cases, and separate a compelling demo from dependable performance.
  • Clear communication, willingness to ask questions early, and responsible handling of customer, property, and company information.

Required

  • Based in Iowa.

Details

  • Pay: $22–$28/hour, based on experience and how independently you can work.
  • Hours: 15–20 hours per week, with flexible scheduling.
  • Location: Remote, for Iowa-based candidates.
  • Term: 6-month internship.
  • Start date: Flexible. We are onboarding now and can work around school schedules, finals, and the holidays.
  • Works with: AI Chief Architect.
  • Team time: A monthly in-person check-in over coffee in Des Moines.

What you get

  • Real responsibility on a live hospitality technology product, with few layers between customer needs and product decisions.
  • Direct mentorship from the AI Chief Architect on applied model evaluation.
  • Work you can point to: benchmark methods, results, and recommendations to reference in future roles.

Company: SureHost

Similar vacancies

More like this role

  • Remote
  • Full-time
  • Part-time
  • Contract

$22 USD - $35 USD / hour

... - 3 years - Location: United States | Canada + 23 more AI Software Development Intern, Internship-to-Hire (Remote, Iowa-Based) Part-time, 15–20 hours/week · Remote, Iowa-based · 3–6 month internship-to-hire · $25–$32/hour About SureHost SureHost is an early-stage hospitality technology company based in Des Moines, Iowa. ...

भारत

  • Remote
  • Full-time
  • Part-time
  • Contract
  • Product Management

$22 USD - $30 USD / hour

... Iowa. Details - Pay: $22–$30/hour, based on experience and how independently you can work. - Hours: 15–20 hours per week, with flexible scheduling. - Location: Remote, for Iowa-based candidates. - Term: 3–6 month internship-to-hire, with a conversion review at the end of the term. Full-time conversion is based on performance, ...

भारत

  • Full-time
... per the MAAB guidelines with good software engineering practices - Responsible for Requirement Analysis - Responsible for Test Specifications, Code Coverage, Model Quality and Model Validation (MIL What you need - Python - Git - C++ - MATLAB - JIRA - C Good to have - Confluence Job details - Location: Bengaluru - Experience: ...

Bangalore, भारत

  • Remote
  • Hybrid
  • Part-time
  • Contract
  • Product Management

$15 USD - $22 USD / hour

- Rate: $15 – $22/hr - Hours: 20 hours / week - Experience: 1 - 3 years Property Media & Data Collection Intern (Des Moines Metro) Part-time, 15–20 hours/week · Hybrid, Des Moines metro · 6-month internship · $15–$22/hour About SureHost SureHost is an early-stage hospitality technology company based in Des Moines, Iowa. ...

भारत

Role- Product Demonstration Model Intern Department: Creative & Production Location: Wagholi, Pune Employment Type: Internship Timings: 11 AM – 5 PM (Monday–Friday), Work from Office 1. About the Internship The role combines practical hardware installation, product demonstrations and on-camera performance. The selected ...

Pune, भारत

  • Remote
  • Full-time
... optimizing reward mechanisms, and improving the reliability of autonomous AI agents. You will explore cutting-edge approaches involving diffusion-based generative models, autoregressive architectures, and unified multimodal frameworks. Through rigorous experimentation and benchmarking, you will push the boundaries of model performance, ...

भारत

  • Remote
  • Full-time
  • Contract

$50 USD - $60 USD / hour

... Location: Remote Commitment: 10–20 hours/week Role Responsibilities - Complete and narrate real software development tasks on your Mac to create high-quality training data for advanced AI models . - Build, debug, refactor, and review code to support AI model benchmarking and improvement. - Work independently with clearly ...

Bombay, भारत

  • Remote
  • Full-time
  • Contract

$50 USD - $60 USD / hour

... Location: Remote Commitment: 1020 hours/week Role Responsibilities - Complete and narrate real software development tasks on your Mac to create high-quality training data for advanced AI models . - Build debug refactor and review code to support AI model benchmarking and improvement. - Work independently with clearly structured ...

Bombay, भारत

  • Remote
  • Contract

$86400 USD - $172800 USD / hour

... systems. In this remote contractor role, you will apply your expertise in computational biology, bioinformatics, genomics, and scientific programming to help train and benchmark AI models. You will evaluate complex biological data workflows, assess analytical methods, and provide expert guidance that improves how AI systems ...

भारत

  • Remote
  • Contract

$115200 USD - $230400 USD / hour

... depend on task availability, completion time, and approved work. About the Role We are seeking experienced Computational Physical Scientists with a background in AI training, model evaluation, or technical benchmarking to help improve advanced AI systems. In this fully remote contractor role, you will combine deep scientific ...

भारत