Back to list

Vacancy description

Agent AI Platform Tester in Bangalore, भारत

Bangalore, भारत

Agent AI Platform Tester

Position Description
Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.

Job Title: Agent AI Platform Tester
Position: Senior Software Engineer
Experience: 2+ Years
Category: Software Development/ Engineering
Shift: General
Main location: Hyderabad, Bengaluru, Chennai
Position ID: J1026-0026
Employment Type: Full Time
Education Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 7 years of relevant experience.
Position Description: We are looking for a GenAI & Agentic AI Test Engineer to validate LLM-based applications, AI agents, RAG solutions, and multi-agent workflows. The role involves functional, quality, security, and performance testing of AI systems, with a strong focus on response accuracy, hallucination detection, prompt security, guardrails, and AI observability.

Your future duties and responsibilities
• 2+ years of experience in Software Testing / QA, with relevant experience in AI/ML, GenAI, or LLM testing.
• Strong understanding of LLMs, Generative AI, and Agentic AI architectures.
• Hands-on experience in RAG, prompt testing, and AI response evaluation.
• Experience testing AI agents, agent orchestration, MCP/A2A, and function/tool calling.
• Strong understanding of AI security testing, including prompt injection, jailbreaks, guardrails, and data privacy.
• Experience with API testing and test automation, preferably using Python.
• Good understanding of AI observability, OpenTelemetry, logs, traces, metrics, and performance testing.

Required qualifications to be successful in this role
Must-Have Skills
• GenAI / LLM / Agentic AI Testing
• RAG, Prompt Testing & Hallucination Detection
• MCP, A2A, Agent Orchestration & Tool/Function Calling
• Prompt Injection, Jailbreak & Guardrail Testing
• IAM, OAuth, RBAC, PII & Data Privacy
• API Testing / Automation / Python

Good-to-Have Skills
• Experience with Gemini, OpenAI, Azure OpenAI, AWS Bedrock, or Vertex AI.
• Knowledge of LangChain, LangGraph, CrewAI, AutoGen, or Semantic Kernel.
• Experience with RAGAS, DeepEval, TruLens, or similar LLM evaluation frameworks.
• Knowledge of vector databases, embeddings, semantic search, and reranking.
• Experience with OpenTelemetry, Grafana, Prometheus, Jaeger, Datadog, or Dynatrace.
• Knowledge of OWASP LLM security practices and AI governance/compliance.

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

Come join our team—one of the largest IT and business consulting services firms in the world.

Similar vacancies

More like this role

... https://jobeax.com/link/4zfBDpGhWyXsMoGR Engineering Lead - AI & Agent PlatformABOUT THE ROLE : You will join the product engineering group and work across several AI-native platforms, not a single product. The common thread is the agent layer : assistants, deep agents and workforce agents, the tools and retrieval behind them, ...

Hyderabad, भारत

  • Remote
  • Contract

$25 USD - $45 USD / hour

AI Agent Tester – Real-World Tasks - Remote Role Overview - Employment Type: Contract - Location: Remote — United States - Compensation: $25–$45 per hour - Estimated Time per Task: Approximately 1.5 hours, including evidence collection and scoring About the Role We are seeking detail-oriented individuals to test AI agents ...

भारत

  • Full-time
  • DevOps
... science role at TVH in Pune. What you'll do - Architect AI Agent Infrastructure: Design, provision, and maintain the cloud foundations required for enterprise AI agents using Vertex AI Agent Builder (Gemini… - Automate Everything: Build, optimize, and maintain robust, secure GitLab CI/CD pipelines for automated agent testing, ...

Pune, भारत

... by helping brands activate transformation through creativity and https://jobeax.com/link/ovlvwo912Rrtlsl6 Summary :We are looking for a skilled Performance Tester with hands-on experience in Adobe Experience Platform (AEP), including Adobe Journey Optimizer (AJO), Real-Time Customer Data Platform (RTCDP), and Customer ...

Noida, भारत

Nstarx India Private Limited

NStarX - AI Engineer - Agentic AI Platform

About the Role : We are seeking an experienced and driven Agentic AI Platform Engineer to design and build the core backend infrastructure for our enterprise-grade Agentic AI platform. In this role, you will move beyond prototyping to architect robust services handling agent orchestration, model routing, enterprise security, ...

Hyderabad, भारत

... Build agents from the ground up and architect and code agentic solutions using tools such as Codex, Claude Code, and modern agent frameworks.- Develop clean, maintainable, testable implementations suitable for production use.- Deploy and run agents on platforms such as AWS Bedrock, internal servers, containers, and Lambda ...

Noida, भारत

  • Remote
  • Full-time

900k

... OutSystems OutSystems is a leading AI Development Platform built for the enterprise. Global organizations trust OutSystems to rapidly build mission-critical apps and agents, modernize legacy processes with agentic systems, and govern their entire AI portfolio across complex regulatory environments, all on one unified platform. ...

Bangalore, भारत

... Kubernetes, IaaC, CI/CD, observability, security, and automation with knowledge of modern AI infrastructure patterns, agentic workloads, model lifecycle management, and AI governance requirements . Specific Role Responsibilities: - Design, develop, and maintain reusable cloud infrastructure and platform capabilities using Terraform, ...

Gurgaon, भारत

C3 India Delivery Centre

Junior AI Platform Engineer

  • Full-time
  • DevOps
... Open to freshers; up to 2 years, with a https://jobeax.com/link/2DENLGgQM7whDhaE, B.E. or B.Sc. What you'll do - Assist in developing backend services supporting AI and machine learning workloads - Develop and test REST APIs using Python or another approved programming language - Integrate machine learning models and Generative ...

Hyderabad, भारत

  • Full-time
  • Design
... engineering design reviews What you need - Visual design - Figma - Prototyping - User research - Wireframing - User flows Good to have - Interaction design Job details - Location: Bengaluru - Experience: 6–11 years - Education: Any graduate - Employment type: Full-time - Languages: English [{"name": "full_time", "text": "Full ...

Bangalore, भारत