Vacancy description
$30 USD / hour
India, Bengaluru
AI Evaluation Engineer (Python, QA or Security) in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Please submit your CV in English and indicate your level of English proficiency.
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.
What this opportunity involves We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.
You'll create challenging tasks and evaluation criteria within realistic simulated environments:
What this is NOT
What we look for
Why this is hard
Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.
How it works
Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid
Compensation
Up to $30/hr equivalent , depending on level and pace. Tasks are estimated at ~20 hours each; you set your own schedule.
Similar vacancies
... equivalency reports, and compliance evaluations based on technical research. Qualifications & Requirements: ✔ Bachelor's degree in a relevant field such as Engineering, Product Testing, Building Product Certifications or a related discipline. ✔ Minimum of 5 years of experience standards research or testing, or a related ...
India, Kolkata
Funic Tech
... end-to-end pipelines covering data ingestion, training, evaluation, packaging, versioning, and deployment.- Develop and maintain Jenkins CI/CD pipelines across Dev, QA, and Production.- Deploy model-serving APIs on AKS using FastAPI and vLLM.- Apply ONNX/TensorRT optimization.- Implement observability using Evidently AI, Prometheus/Grafana, ...
India, Bengaluru
Stratosphere IT Services PVT Ltd
... offerings. - This position offers a unique opportunity to shape the technical direction of our AI initiatives while working in a high-impact, hybrid https://jobeax.com/link/1eyrmHNst0oOnGC1 Skillset : - Python- AI tools- LLMs- AWS Bedrock/Azure Open AI- MCP servers- Agentcore or similar- LangChain/LangGraph (ref:hirist.tech)
India, Gurugram
Quest Global
... patterns. Experience with data processing libraries like Pandas, NumPy. Knowledge of Agile/Scrum methodology. Experience working with messaging tools like Kafka Bachelor's degree in Computer Science, Information Technology, MTech Certifications in Python or Cloud technologies. Experience in AI/ML projects or automation tools. We ...
India, Bengaluru
... high-value use cases, ensuring that AI-driven outputs align with specific industry requirements and regulatory standards.- Establish rigorous evaluation frameworks and monitoring protocols to maintain model accuracy, mitigate hallucinations, and ensure the ethical deployment of AI systems.- Mentor junior engineers and foster ...
India, Bengaluru
FUNIC TECH PRIVATE LIMITED
# AI Engineer / Data Scientist - GenAI & Agentic AI- Experience : 5-7 Years- Location : Bangalore- Joining : Immediate to 15 Days- Job Summary :We are looking for a hands-on - AI Engineer / Data Scientist- with strong experience in - Generative AI, Agentic AI, LLMs, RAG, and Python- to design, develop, deploy, and optimize ...
India, Bengaluru
... GenAI (e.g., llama, OpenAI, HuggingFace, LangChain, Agentic AI etc) or Data Engineering (e.g., Data platforms, pandas, numpy) is a strong advantage. Benefits Work on cutting-edge technologies and impactful projects. Opportunities for career growth and development. Collaborative and inclusive work environment. Competitive ...
India
Cadence Design Systems (India) Pvt Ltd
... automation and scalability Experience Requirements - 7+ years in QA, SDET, or test automation engineering - Proven experience building and scaling automation frameworks - Hands-on experience with AI/ML systems or LLM-based applications Experience testing RAG pipelines or agentic workflows Owned end-to-end AI test strategy and ...
India, Bengaluru
Recruitment Room
$124800 USD - $166400 USD
... domain expert, or anyone who has had access to its source-world data. Prior exposure to the material would compromise the integrity of the study. Contract Details - Independent contractor engagement. - Fully remote with flexible scheduling. - One-time, short-term evaluation project. - Projects may be extended, shortened, ...
India
... responses. - Ability to follow structured evaluation guidelines consistently. - Comfortable interacting with AI tools and chatbots . - Strong attention to detail when reviewing AI-generated content and evaluation results. Core Skills - Critical Thinking - Business Analysis - Small Business Operations - AI Evaluation - ...
India
United HR Solutions Pvt Ltd
... Collaborate with data scientists, AI engineers and other technical teams to deliver end-to-end AI https://jobeax.com/link/aBEmjgpiI9IeDRRd : - Experience taking AI/GenAI applications from development to production.- Exposure to model deployment, monitoring, guardrails and LLM application security.- Experience working in a ...
India, Ahmedabad
Laksh Consultants
... Requirements : - 3+ years of professional AI/ML engineering experience with a track record of delivering production-grade AI systems.- Strong programming skills in Python and SQL, with hands-on experience in ML libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow).- Hands-on experience building ...
India, Hyderabad
Laksh Consultants
... Requirements : - 3+ years of professional AI/ML engineering experience with a track record of delivering production-grade AI systems.- Strong programming skills in Python and SQL, with hands-on experience in ML libraries (scikit-learn, pandas, numpy) and deep-learning frameworks (PyTorch or TensorFlow).- Hands-on experience building ...
India, Ahmedabad
... Role and Responsibilities The QA Engineer (or Senior QA Engineer) will work under the oversight of the Head of Engineering and Lead QA and assist with all the QA responsibilities below: Write, execute, and maintain automated test scripts for APIs, microservices, and front-end components. Perform manual testing when necessary, ...
India, India
NobleEdge Talent Advisory
... Engineering, Data Science, or related field.- 5+ years of experience in ML Engineering, AI Engineering, MLOps, or related roles.- Strong Python and software engineering skills with experience building production ML/AI systems.- Hands-on experience with ML model development, deployment, monitoring, evaluation, and lifecycle ...
India, Hyderabad
... Create clear, well-documented analytical artifacts and reproducible analysis workflows. Collaborate with ML engineers and researchers to design challenging, real-world evaluation scenarios for MLE Bench. Minimum 3+ years of experience as a Data Analyst or Analytics-focused Engineer . Strong proficiency in Python for data analysis. ...
India, Rāniganj
Hupo Zhongjian
... Full Stack Engineer - AI Products Employment Type: Full-time We build AI products for the people who sell insurance and banking products across Asia. An advisor can practise a hard client conversation against an AI persona, get a nudge during a live call, or have an AI agent make the first call for them. Our clients are ...
India, Delhi
Weekday AI
... experience with model training, fine-tuning, tuning, validation, and evaluation . - Advanced proficiency in Python and data-centric programming. - Strong experience working with Pandas or comparable dataframe-based data-processing frameworks . - Understanding of LLM application development, prompt engineering, inference workflows, ...
India, Pune
... over 4 billion decisions annually — turning architectural coherence into sustained risk performance and measurable value. Ready to solve meaningful challenges, work with enterprise customers, and help shape the future of AI-powered decisioning Join us. The QA Automation Engineer will be responsible for assuring the quality ...
India, Bengaluru
Sigmoid
... or similar stack a must - Experience with functional and object-oriented programming, Python or Scala a must - Ability to collaborate with a diverse set of engineers, data scientists and product managers - Experience in agile methodology Development and support experience in Big Data domain Architecting, developing, implementing ...
India, Bengaluru