- Hybrid
- On-site
128k
... interact with the scheduler. - Multi-tenant serving: model co-location and MIG / MPS isolation. - Profiling fluency with Nsight Systems, framework tracing, and py-spy / perf. - C++ and CUDA at a read-and-modify level. - On-call ownership of an inference SLO. Strong pluses - Upstream contributions to SGLang, vLLM, Dynamo, llm-d, ...
India, Bengaluru