Vacancy description
sarvam
India, Bengaluru
Infrastructure SRE - HPC in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
About Sarvam
Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.
About the Role
Sarvam runs a large, multi-vendor GPU fleet that serves two demanding workloads on the same physical infrastructure: training jobs that span hundreds of GPUs and must run uninterrupted for weeks, and inference services that must hold a flat p99 under production load. Keeping both healthy at once is a hard, specialized reliability problem, and it is the problem this team exists to solve.
This is not a Kubernetes administration role. We assume Kubernetes fluency as a baseline. The difficulty lies above and below it - in parallel filesystems under heavy checkpoint load, in RDMA fabrics that degrade quietly, in NCCL hangs whose root cause may be the network or the kernel, in driver and firmware drift across heterogeneous hardware, and in distributed training failures that masquerade as infrastructure faults.
We are hiring a team of specialists rather than a set of identical generalists. This posting covers five areas of focus. We expect candidates to bring genuine depth in one and working fluency across the others, because on a shared fleet a storage problem often first appears as a training hang, and the engineer on call must route an incident correctly before anyone can resolve it.
When you apply, please indicate the area of focus that best matches your experience. Strong generalists are welcome; we will place you where your depth is most useful.
What You’ll Do
Operate the GPU fleet end to end across training and serving - provisioning, observability, capacity, and fleet health.
Hold a meaningful on-call rotation, write runbooks that hold up under pressure, and drive postmortems that produce durable fixes.
Build the internal tooling the team relies on, rather than operating off-the-shelf systems alone.
Partner with ML and platform teams to keep large runs alive and serving latency predictable.
What We're Looking For
5+ years in infrastructure or site reliability engineering, including 2+ years operating GPU clusters at scale.*
Demonstrated on-call ownership of infrastructure that mattered, with a track record of postmortems that led to real change.
Proficiency in Python or Go, used to build and maintain internal tooling.
Working fluency across all five areas of focus below - enough to recognize, triage, and route a problem outside your specialty, even if the fix belongs to a teammate.
* For the Storage and Fabric areas of focus, we will weigh deep domain expertise against the GPU-cluster requirement; exceptional specialists with less direct GPU-fleet time are encouraged to apply.
Bring depth in one of the five areas below; expect to be conversational across the rest.Distributed high-performance storage — operate a parallel filesystem (Lustre, GPFS, WEKA, or BeeGFS) at scale and keep it from stalling under checkpoint-write storms.
Fabric & RDMA networking — InfiniBand or RoCE health, NVLink/NVSwitch topology, and RDMA debugging that catches degradation before the workload feels it.
GPU systems reliability — NCCL debugging, driver and firmware lifecycle across a mixed fleet, and DCGM-based node health at scale.
Kubernetes platform reliability — the GPU operator stack, scheduling (Slurm-on-k8s or pure k8s), multi-tenant isolation, and cost/SLO primitives.
Training & inference workload reliability — hang and straggler detection, checkpoint/restart, and protecting serving p99 with HA and DR.
Bonus Points
Slurm and Kubernetes hybrid environments.
On-premise GPU deployment, including coordination with datacenter operations on power, cooling, and InfiniBand cabling.
Experience with Indian NCPs, DGX SuperPOD, Lambda, CoreWeave, NeevCloud etc.
Multi-tenant GPU isolation (MIG, MPS, time-slicing) in production.
Why Sarvam?
Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.
Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar
High ownership and high impact, from day one
Everything we do is AI-first, from the way we build and ship to the way we think about problems
You can work on problems that could change how an entire country learns, works, and communicates
If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.
Similar vacancies
... problem: how do you connect hundreds of chips, deliver clean power at scale, and move terabits of data without melting the package TylSemi builds the chiplet infrastructure IP — the IO, power delivery, and interconnect building blocks — that makes AI/HPC systems actually work at scale. The semiconductor industry is going through ...
India, Bengaluru
Siemens PLM Software
377k
... minimize downtime and prevent recurrence Proactively identify and resolve reliability risks before they impact end users Maintain scalable, fault-tolerant infrastructure for data pipelines, ML workflows and data workflows Handle cloud infrastructure (Azure) using Infrastructure as Code (IaC) tools such as Terraform Oversee ...
India, Pune
secninjaz technologies llp
... Location: NSP, New Delhi – On-site Experience Required: 2–5 Years We are looking for professionals with hands-on experience in DevOps Engineering, Cloud Infrastructure, Platform Engineering, Site Reliability Engineering (SRE), Infrastructure Automation, or related areas. About SecNinjaz Technologies SecNinjaz Technologies ...
India, Delhi
recrew ai
1500
... a pager and made structural changes to reduce alert volume or MTTR - Hands-on Linux administration and container operations in production environments - Infrastructure-as-Code experience managing cloud resources at production scale - Proficiency with at least one major cloud provider at an infrastructure operations level ...
India, Bengaluru
... Support highly available, large-scale cloud environments as part of an on-call rotation. Engineering & Automation Design, build, and operate large-scale cloud infrastructure and production services. Develop software, automation, and infrastructure using Go, Python, Terraform, and related technologies. Eliminate operational toil ...
India, Bengaluru
JioSaavn
... self-service platforms for developers. Manage source control (Bitbucket/GitHub), code quality gates (SonarQube), and artifact repositories (Sonatype Nexus). Infrastructure as Code (IaC) & Cloud Engineering: Provision, configure, and manage cloud infrastructure on AWS/Azure using Infrastructure as Code (IaC) tools such as Terraform, ...
India, Mumbai
... focus on virtualization, clustering, storage, security, resiliency and automation. Your key responsibilities The I&O Platform Infrastructure Hyperconverged Infrastructure Specialist provides technical support and engineering of complex nature for the firm's Azure Stack HCI platforms and associated infrastructure services. ...
India, Kochi
Velodata Global Pvt Ltd
We are seeking a Site Reliability Engineer (SRE) to support and maintain a 24×7 Azure cloud environment, ensuring high availability, reliability, and performance of infrastructure and hosted services. This role requires the engineer to operate across L1 and L2 support responsibilities, combining proactive monitoring with ...
India, Kochi
As a Core Infrastructure Engineer, you will design and deliver major features while leveraging AI to improve engineering productivity, operational excellence, and business outcomes. You will build secure, scalable, and maintainable systems, lead feature and subsystem design, and ensure operational readiness through automation, ...
India, Bengaluru
Accenture
Project Role : Infrastructure Engineer Project Role Description : Assist in defining requirements, designing and building data center technology components and testing efforts. Must have skills : Google Cloud Platform Architecture Good to have skills : Google Cloud Security Services Minimum 7.5 Year(s) Of Experience Is ...
India, Indore
8900
... level relationships and partnering with all business disciplines, other MI teams, outsourcing vendors, and external suppliers to define and implement the Network SRE DDI roadmap, building and enforcing the standards defined in it. Develop complex global distributed infrastructure monitoring, management, and automation solutions ...
India, Rāniganj
Mig Staffing
... correlate production telemetry, diagnose failure patterns, recommend or execute remediation, and participate safely in deployment decisions.- Partner with Infrastructure Engineering on deployment safety - progressive delivery, canary analysis, and AI-assisted promotion decisions.- Mentor Staff and Senior SREs, raising the ...
India
TRH Consultancy Services
Role Overview : We are seeking a seasoned IT Infrastructure Manager to lead our technology operations in Gurugram. In this role, you will be the backbone of our digital environment, overseeing the end-to-end management of our server, network, and security ecosystems. You will collaborate closely with cross-functional leadership ...
India, Delhi
... operational reliability throughout the software development lifecycle. To be successful as a Software Engineer – Infrastructure, you should have experience with: Infrastructure design and implementation. Cloud automation and platform engineering. Cybersecurity best practices and secure infrastructure delivery. Linux, Bash, and PowerShell. ...
India, Pune
... is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed ...
India, Bengaluru
Oracle Cloud Infrastructure (OCI) builds foundational Infrastructure-as-a-Service technologies for a large-scale, distributed, multi-tenant cloud. Our customers rely on OCI to run critical workloads, and our mission is to provide secure, highly available, and high-performance cloud infrastructure. The Virtual Cloud Networking ...
India, Bengaluru
MOVEINSYNC TECHNOLOGY SOLUTIONS PRIVATE LIMITED
... Python | Bash | Linux | Prometheus | Grafana | OpenTelemetry | AWS IAM | VPC | EC2 | RDS | Redis | GitRequirements : - 5+ years of hands-on experience in DevOps / SRE / Platform Engineering / Cloud Infrastructure.- 3+ years of experience managing production Kubernetes/EKS environments.- Strong AWS, Terraform and CI/CD experience.- ...
India, Bengaluru
... provisioning for lab build projects. - Audio Visual system and Network Infrastructure from design to delivery for new programs - Audio Visual system and Network Infrastructure from design to delivery for Day 2 programs - Audio Visual system and Network Infrastructure from design to delivery for replacement programs - Audio Visual ...
India, Bengaluru
Sonata Software Limited
Role :Driven by the passion to improve quality of people's lives, Sonata Software continues to grow as market leader in the industry. We want to accelerate our business transformation in order to reach more people, more effectively. Join our IT organization supporting Sonata Software operations across India.
India, Bengaluru