2,345 monitoring and evaluation jobs in India.

... pings, check calls, carrier data) rather than clean, pre-processed datasets - Diagnose gaps between offline evaluation performance and live production accuracy, and drive fixes - Build and maintain automated training/retraining pipelines using orchestration tools such as Airflow - Set up and maintain model monitoring and ...

... pings, check calls, carrier data) rather than clean, pre-processed datasets - Diagnose gaps between offline evaluation performance and live production accuracy, and drive fixes - Build and maintain automated training/retraining pipelines using orchestration tools such as Airflow - Set up and maintain model monitoring and ...

... red-teaming, and production quality monitoring in the AI ADLC model Technical Skills - Deep hands-on experience with LLM evaluation — familiarity with frameworks and libraries such as LangSmith, DeepEval,LLM as a Judge, Promptfoo, RAGAS, Hugging Face evaluation tooling, custom eval harnesses - Strong understanding of agentic ...

... MCP-based tools and expose internal APIs/Databricks functions to agents.- Manage production AI systems including CI/CD, scaling, versioning, containerization, and Human-in-the-Loop (HITL) workflows.- Implement agent observability and evaluation, including monitoring reasoning, correctness, and tool https://jobeax.com/link/Bj9LbBTRYdOcEFtM ...

... training, evaluation, and performance optimization.- Deploy machine learning models into production environments using scalable APIs and cloud infrastructure.- Build and maintain end-to-end ML pipelines, including training, inference, monitoring, and model versioning.- Work closely with product, engineering, and business teams ...

... troubleshooting and access-related queries. - Follow company policies regarding confidentiality, information security and access permissions. 2. HR Audit & Performance Monitoring - Review daily performance reports, task submissions and work records against defined evaluation criteria. - Verify the accuracy and completeness of performance ...

... Tableau, Spotfire, Qlik). Responsible AI & Governance • Define and embed Responsible AI practices: fairness, explainability, privacy, security, model risk management and human oversight. • Design governance for GenAI, including evaluation frameworks, guardrails, hallucination and prompt-injection controls, cost monitoring and ...

... monitoring, drift detection and continuous https://jobeax.com/link/riKf6u8ilNIwkEvz Skills : - Strong foundation in statistics, probability, machine learning and data analysis.- Strong hands-on programming skills in Python and common data science libraries.- Experience with Pandas, NumPy, scikit-learn and relevant ML frameworks.- ...

... Maintenance of rooftop and ground-mounted Solar PV power plants . The candidate should have strong electrical troubleshooting skills, knowledge of solar equipment, and a valid Wireman / Supervisor Licence . The role involves preventive and corrective maintenance, plant monitoring, troubleshooting, safety compliance, and travel ...

... Databricks, or Snowflake.- Understanding of Python, REST APIs, microservices, cloud-native architectures, and enterprise data integration.- Experience with LLM evaluation, prompt engineering, guardrails, monitoring, and production deployment practices.- Strong understanding of AI security, data privacy, governance, scalability, ...

... line style in vehicle layout for resp system to refer to. Overall vehicle and passenger compartment hard point finalization and tracking Driver Controls layout and monitoring conformance of controls for ergonomic reqt’ s with Ergonomics team Preparation of Seating Buck for internal/external Jury Evaluation Collate benchmark ...

... personalization, and next-generation entertainment workflows. Your work will help researchers and engineers move from early exploration to validated, reproducible, and product-relevant AI systems, with clear quality standards, evaluation discipline, responsible AI practices, and practical adoption paths built in. Key Responsibilities ...

... technical oversight for AI/ML solution design, implementation, and optimization. - Lead the evaluation, selection, and integration of AI/ML tools, frameworks, and cloud services (e.g., Azure AI, AWS SageMaker, Google Vertex AI). - Establish and maintain monitoring, logging, and observability standards for AI/ML systems ...

... to handle 500K+ claims and hundreds of millions of text https://jobeax.com/link/meJ8vd0TLnD73f4u Deployment & Quality :- Deploy and version models using MLflow and Databricks.- Manage schema evolution and migrations using Liquibase on Aurora PostgreSQL.- Instrument pipelines with logging, monitoring, and evaluation scoring ...

... strong focus on reliability, maintainability, and performance. - Own services end-to-end, from architecture and implementation through deployment, monitoring, and ongoing operations. - Integrate LLMs, AI agents, and retrieval-based solutions into production applications. - Build and improve evaluation, monitoring, and observability ...

... retrieval augmented generation and tool integration - Strong proficiency in Python and experience developing scalable services, application programming interfaces, and reusable libraries - Experience delivering end-to-end artificial intelligence solutions including prompt design, evaluation, and monitoring - Familiarity with ...

... embedding services, training/evaluation frameworks, SDKs, and model management APIs—to simplify the end‑to‑end AI/ML lifecycle. Your work will enable researchers and engineers to move rapidly and safely from early experimentation to production, with standardized workflows, governance, observability, repeatability and reproducibility, ...

... maintenance teams, and customer SMEs to understand failure modes and operational constraints.- Deploy models into production using MLOps best practices, ensuring monitoring, drift detection, automated retraining, and high system reliability.- Build reusable feature engineering frameworks and model evaluation pipelines.- Contribute ...

... compliance, and other control partners through conceptualization and problem framing; development and testing; review/validation support and documentation; deployment and model usage; and ongoing model monitoring and maintenance. - Embed AI and generative AI into core workflows (responsibly) to improve speed and quality of delivery, ...

... like Thermoforming / Compression Molding, Fabric Lamination & Wrapping, Adhesive Bonding Processes, Cutting and Trimming Operations. • Supplier Performance monitoring, evaluation & drive performance improvement through systemic approach. • Monitor & improve non-performing suppliers and organize periodic Quality reviews as ...