Manager/Senior Manager - Lead AI Platform Engineer in Bombay, भारत

AI Platform Engineer Innovation LabSector : Leading Financial Markets Infrastructure OrganisationLocation : MumbaiExperience : 6+ yearsGrade : Manager / Senior ManagerRole Overview :This is a specialist AI platform engineering role distinct from generic Data Science or application development. The position demands deep expertise in MLOps/LLMOps, distributed inference, and GPU based AI infrastructure, within regulated financial https://jobeax.com/link/D97KR0fNczjlIZqw Responsibilities :- Architect and scale production AI systems for mission-critical financial applications.- Lead MLOps/LLMOps pipelines and distributed model inference frameworks.- Engineer GPU infrastructure across sovereign/private cloud and on-premise environments.- Implement enterprise AI gateways, semantic routing, failover mechanisms, observability, and guardrails.- Drive GPU performance tuning, production troubleshooting, and CI/CD automation.- Collaborate with cross-functional teams to deliver secure, scalable AI innovation.Non-Negotiable Requirements :Education : BE/BTech/MCA in Computer Science, IT, Data Science, or related disciplineExperience : 6 - 8 years in software engineering or DevOps, including:i. 3+ years of hands-on production MLOps/LLMOps and distributed inference.ii. 3+ years architecting and scaling production AI systems.iii. Proven expertise in AI platform engineering, distributed systems, GPU infrastructure.Hands-on proficiency with :- Languages/Frameworks : Python, FastAPI, AsyncIO, gRPC- Inference Platforms : vLLM, NVIDIA Triton, TensorRTLLM, Ray Serve, Hugging Face TGI, llama.cpp- Containers/Orchestration : Kubernetes, Docker, Helm, NVIDIA GPU Operator, KEDA- Strong background in enterprise AI gateways, semantic routing, failover, observability, and guardrails.- Expertise in GPU performance tuning, production troubleshooting, GitOps/CICD. (ref:hirist.tech)