Vacancy description
Cadence Design Systems (India) Pvt Ltd
India, Bengaluru
Tech Principal Software Engineer in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
At Cadence, we hire and develop leaders and innovators who want to make an impact on the world of technology.
Senior AI Test / Automation Engineer
Overview
Role: AI Test / Automation Engineer
Location: Bangalore India
Department: AI Engineering / Quality Assurance
Experience Level: Mid to Senior
We are looking for a highly motivated Senior AI Test / Automation Engineer to design and scale automated validation frameworks for AI/ML models, LLM-based applications, and agentic systems . This role is critical to ensure that AI solutions meet enterprise standards for quality, reliability, safety, and compliance before and after production deployment.
Key Responsibilities
Build and maintain AI test automation frameworks for pre-qualification and continuous validation of models and agent workflows
Develop comprehensive test suites , including:
Unit, integration, and end-to-end (E2E)
Functional, regression, performance, and safety testing
Validate AI system behavior , including:
Non-deterministic LLM outputs
Hallucinations and edge cases
Multi-step agent decision-making
Design and manage evaluation systems :
Golden datasets
Benchmarking pipelines (accuracy, latency, reliability)
Automate testing within CI/CD pipelines for model updates, prompt changes, and tool integrations
Implement observability and telemetry to enable traceability, monitoring, and audit readiness
Collaborate cross-functionally with ML, MLOps, Product, and Security teams to define quality gates and release criteria
Track and report quality KPIs , including test coverage, defect leakage, and system reliability
Drive root-cause analysis and continuous improvement across the AI testing lifecycle
Required Skills
Core Engineering
Strong programming skills in Python familiarity with Bash, TypeScript, or Go
Experience with test automation frameworks such as PyTest, Playwright, Selenium, or Cypress
Proficiency in CI/CD tools (GitHub Actions, Jenkins, GitLab CI)
Experience with cloud platforms (AWS, Azure, GCP) and containers (Docker, Kubernetes)
AI / ML & Agentic Systems
Hands-on experience with LLM ecosystems (OpenAI, Anthropic, Bedrock)
Familiarity with:
RAG architectures and vector databases (Pinecone, Weaviate)
Agent frameworks (LangChain, LlamaIndex, AutoGen)
AI Testing Techniques
Experience with non-deterministic testing approaches (statistical assertions, tolerance thresholds)
Knowledge of evaluation methods :
LLM-as-a-judge
BLEU, ROUGE, semantic similarity scoring
Experience with prompt and agent regression testing
Understanding of AI safety testing , including adversarial testing, bias/fairness validation, and jailbreak detection
Tooling (Preferred)
AI testing & observability tools: LangSmith, TruLens, Arize, Weights & Biases
Evaluation tools: DeepEval, Ragas, PromptFoo, Giskard
Monitoring: Prometheus, Grafana, OpenTelemetry
Soft Skills
Strong analytical and problem-solving skills
Excellent communication and cross-functional collaboration
Data-driven mindset with focus on quality KPIs
Detail-oriented with a strong bias toward automation and scalability
Experience Requirements
Experience in enterprise or regulated environments (SOC2, ISO 27001, etc.)
Exposure to:
Shift-left testing practices
Production observability and monitoring
Chaos or resilience testing
Senior-Level Differentiators
Education
~ Bachelor's or Master's degree in Computer Science, Software Engineering, or related field
Nice-to-have:
ISTQB certification
Cloud/ML certifications (AWS, Azure, GCP)
AI testing certifications
What Success Looks Like
AI systems that are accurate, reliable, and safe
Fully automated test pipelines integrated into CI/CD
Measurable improvements in defect leakage and model quality
Strong observability and auditability across AI systems
Scalable validation frameworks supporting rapid AI innovation
We're doing work that matters. Help us solve what others can't.
Similar vacancies
Sauce Labs
300k
... proprietary dataset of 8.7 billion test runs, Sauce Labs empowers the Fortune 2000 to bridge the gap between AI-driven code generation and enterprise-grade software quality. Release Assurance at the Speed of AI | Meet the new Sauce Labs We’re a small advanced tech team that takes ideas from “someone had a hunch” to “customers ...
India, Gurugram
... strategies that align engineering investments with business objectives and customer outcomes Lead the design and delivery of large-scale, mission-critical software systems across multiple teams Mentor engineers and foster a culture of innovation, collaboration, and engineering excellence Identify and mitigate technical ...
India, Noida
... role is a senior technical leadership position responsible for driving engineering excellence and digital transformation through customer-centric, AI-driven engineering solutions. As a founding Principal Software Engineer for Xometry's India PDT team, you will be instrumental in elevating engineering practice, influencing ...
India, Bengaluru
weekdayworks
This role is for one of our clients Industry: Software Development Seniority level: Mid-Senior level Min Experience: 10+ years Location: Bengaluru JobType: full-time
India, Bengaluru
235k
... identities. Today, Solera processes over 300 million digital transactions annually for approximately 235,000 partners and customers in more than 90 countries. As a Principal Software Developer, you will be responsible for the design, development, and maintenance of our Java applications. Your expertise in software development, ...
India, Rāniganj
one97 communications limited
Cocos – Senior Software Engineer Paytm is India's leading mobile payments and financial services distribution company. Pioneer of the mobile QR payments revolution in India, Paytm builds technologies that help small businesses with payments and commerce. Paytm's mission is to serve half a billion Indians and bring them ...
India, Noida
235k
... customers in more than 90 countries. We are seeking a highly skilled and experienced Principal Software Engineer with expertise in .NET Core to join our dynamic engineering team. In this role, you will be responsible for leading the design, development, and implementation of high-quality software solutions. You will collaborate ...
India, Rāniganj
... Engineering, Information Technology, or a related field (Master's a plus). Equivalent demonstrable experience will be considered.- Minimum 8 - 10 years of hands-on software development experience, operating at a Principal / Software Architect level of seniority.- Principal-grade, in-depth technical mastery - able to reason from ...
India, Gurugram
ConnectWise
45k
... giving you the choice of how YOU make a difference. The Principal Software Engineer I is responsible for developing high-quality, innovative, fully performing software in compliance with coding standards. This individual works in partnership with cross-functional teams to ensure that software deliverables, including designs, ...
India, Pune
About the Role We are hiring a Principal/Senior Software Engineer to lead the design and evolution of our high-frequency, large-scale AdTech platform. This pivotal role blends deep expertise in Java backend systems with cutting-edge Generative AI applications. You'll own complex software systems end-to-end, shape the organization's ...
India, Pune
Mig Staffing
Role Overview : We are looking for a Principal Engineer to own the semantic model architecture at the heart of our data platform. This role sits at the intersection of data modeling, platform engineering, and product https://jobeax.com/link/1gXrtZ4TydNBW4pC You will Do : - Design and evolve the semantic modeling layer that ...
India, Bengaluru
... the team that's helping to secure the AI age, we invite you to bring your talents to Zscaler and help shape the future of cybersecurity. We are looking for a Principal Software Development Engineer to join our team. This is a Hybrid role, reporting to the Senior Director, Software Engineering in the ZPA department. You will ...
India, Bengaluru
... the team that’s helping to secure the AI age, we invite you to bring your talents to Zscaler and help shape the future of cybersecurity. We are looking for a Principal Software Development Engineer to join our team. This is a Hybrid role, reporting to the Senior Director, Software Engineering in the ZPA department. You will ...
India, Bengaluru
Hitachi Energy
... transmit electricity over long distances and for power transmission via submarine cables. HVDC is also used to connect power systems. We are looking for an engineer with a keen interest in technology who is willing to learn and develop. Various technical areas need to be considered and the willingness and ability to grasp ...
India, Chennai
Exponent Energy
3k
Role: Tech Support Engineer Department: Operation Location: Bengaluru, India Experience: 3–8 Years Reporting To: Service Manager - Battery Your Team: We are looking for a Technical Support Engineer with strong expertise in electric vehicles, particularly in battery systems and vehicle diagnostics. The role involves providing ...
India, Bengaluru
mcdonald's global office in india
... Includes prompt engineering, instruction tuning, retrieval-augmented generation (RAG), and reinforcement learning with human feedback (RLHF). Collaborate with AI Engineers, LLMOps/MLOps engineers, and product teams to translate multimodal data into scalable NLP solutions. Develop Agentic workflows and deployment workflows using ...
India, Rāniganj
The Principal Full Stack Engineer is a technology leader responsible for end-to-end design, backend/frontend integration, and system scalability . This role requires deep expertise in C#/.NET, Angular, SQL, and AWS platform . Full Stack Architecture & Technical Leadership Own and drive the full-stack design for scalable ...
India, Bengaluru
Funic Tech
... Cloud/Infra: Azure, AKS, Docker, Helm- ML/Data: Databricks ML, Delta Lake, MLflow, PySpark, PostgreSQL, Redis, ADLS Gen2Required Skills:- 4+ years of ML/AI engineering or DevOps experience.- Strong production MLOps pipeline experience.- Strong Jenkins and Azure DevOps experience.- Knowledge of Azure/AWS/GCP. (ref:hirist.tech)
India, Bengaluru
Amazon Alliance
You are a sharp, passionate engineer with strong problem-solving skills and solid software testing foundation. You are a talented, detail, oriented and enthusiastic tester who is passionate about quality and is enthusiastic about the new technology offered to consumers. You will design, plan, execute and automate tests ...
India, Bengaluru