2,359 monitoring and evaluation jobs in India.

... training, evaluating, and optimizing machine learning models / or LLMs. • Experience with data preprocessing, feature engineering, exploratory data analysis (EDA), and model evaluation. • Ability to define evaluation metrics, conduct experiments, and interpret model performance. • Familiarity with Git, APIs, and deploying models ...

... LangChain, LangGraph/LlamaIndex, Prompt Engineering, AI Agents- MLOps: Model Serving, CI/CD, Monitoring, Docker, Kubernetes- Cloud: AWS / Azure / GCP- Strong understanding of ML lifecycle, model evaluation, optimization, explainability, bias mitigation, AI governance, and responsible https://jobeax.com/link/j2wYDhLFedXkNTfL :- ...

... use/function calling and enterprise AI integrations. - Experience with MCP (Model Context Protocol) or similar AI integration approaches. - Experience with model evaluation, observability, and AI application monitoring. - Knowledge of fine-tuning, model adaptation, embeddings, and NLP techniques. - Experience integrating AI solutions ...

... deployment of courses and learning based projects across Talent Development. The role includes managing the end-to-end deployment process, supporting learning budgets and monitoring compliance and attendance. Providing oversight of learning administration activities working alongside Senior Learning Associates and Learning Program ...

... Infrastructure and MLOps: Build and improve the infrastructure required to operate models reliably, including model versioning, CI/CD pipelines, observability, and production monitoring. - Experimentation and Evaluation: Design and run experiments, including A/B tests, to evaluate model performance and determine whether ...

... Models (LLMs), and model evaluation techniques.- Hands-on experience with Retrieval-Augmented Generation (RAG), context engineering, vector databases, embeddings, and knowledge engineering.- Experience designing and developing AI agents, multi-agent systems, agent frameworks, and AI copilots.- Strong understanding of backend ...

... interfaces. - Define and implement AI and agent observability, including tracing, logging, evaluation, alerting, and dashboards for quality, latency, task success, handoff rate, adoption, cost, safety, and user feedback. - Establish AI platform capabilities for prompt and model management, evaluation, monitoring, governance, ...

... through production deployment.- Guide architecture for consumer applications, backend services and integrations.- Ensure platform reliability, performance, security and responsible handling of sensitive health data.- Establish evaluation and monitoring practices for AI features.- Hire, mentor and develop engineers and engineering ...

... APIs, security, monitoring, and deployment.- Evaluate and recommend LLMs, embedding models, vector databases, retrieval approaches, orchestration frameworks, and deployment architectures based on business requirements.- Establish enterprise patterns for RAG architecture, prompt engineering, LLM evaluation, model selection, ...

... backend, infrastructure, and product teams to develop reusable GenAI infrastructure covering model serving, prompt versioning, logging, evaluation systems, monitoring, and feedback loops. - Establish rigorous evaluation and experimentation processes to monitor agent performance, hallucination rates, reliability, and real-world ...

... Strong attention to detail and ability to meet strict deadlines. Preferred Qualifications - Experience in IoT, Climate-Tech, Smart Cities, SaaS, Environmental Monitoring, or technical solutions. - Knowledge of QCBS evaluation, BOQ preparation, and financial bid formats. - Graduate/Postgraduate in Engineering, Business Administration, ...

... across model versions - Implement continuous monitoring scripts to detect data and concept drift on live inference endpoints Automation Engineering & CI/CD - Build and maintain scalable test automation frameworks for APIs, backend services, and model endpoints - Embed AI evaluation and data QA suites into MLOps and CI/CD pipelines ...

... development and deployment of production-grade NLP and ML models.- Work with large language models (LLMs), RoBERTa, GPT APIs, and hybrid architectures.- Guide and review the work of junior scientists and interns.- Develop pipelines for training, evaluation, and continuous model monitoring.- Collaborate with cross-functional ...

... answer-writing evaluation, personalised study aids and voice/vision-enabled learning; and internal automation that accelerates content creation, data pipelines and business operations. You will own the full stack of an AI feature: data, retrieval, models, serving, evaluation and monitoring. Key Responsibilities - LLM & RAG ...

... observability, evaluation, and auditability.- Implement human approval, deterministic validation, and rollback controls for consequential engineering actions.- Design evaluation frameworks using representative Intel Design Quality and Reliability use cases.- Establish automated testing, CI/CD, secure configuration, monitoring, documentation, ...

... documentation to support team collaboration and knowledge sharing. - Apply prompt engineering techniques and utilize AI evaluation frameworks to refine model outputs and accuracy. - Oversee the complete lifecycle of machine learning models, from initial concept to final deployment and monitoring. - Collaborate effectively with ...

... and Healthcare Compliance programs within Life Sciences businesses. The role involves conducting audits, monitoring controls, performing third-party reviews, and tracking remediation efforts across India-based operations. Responsibilities - Execute ABAC and HCC auditing and monitoring procedures including transaction review, ...

... and Healthcare Compliance programs within Life Sciences businesses. The role involves conducting audits, monitoring controls, performing third-party reviews, and tracking remediation efforts across India-based operations. Responsibilities - Execute ABAC and HCC auditing and monitoring procedures including transaction review, ...

... training, mentoring, job and education placements, and post-placement support. - Oversee programme monitoring and evaluation, performance reporting, regional budgets, and achievement of programme outcomes and indicators. - Develop partnerships with vocational training institutes and specialist livelihoods organisations to enable ...

... degradation in production environments. - Assess RAG-Based Solutions - Understand retrieval pipelines and be able to evaluate retrieval quality, citation accuracy, and response grounding. - Work with AI Observability Platforms - Experience with AI monitoring, tracing, evaluation logging, dashboards, and observability tools such ...