Senior Engineer - AI Inference & Kernel Optimization in Bangalore, भारत

Description : Position : Sr Engineer AI Inference & Kernel OptimizationLocation : Bangalore, India (On-site / Hybrid)Compensation : ?7090 LPA (Base) + ESOPs + Performance Variable(Compensation aligned with experience and technical depth)About the Role : We are building next-generation AI inference processors optimized for ultra-low latency, high-throughput workloads. As a Senior / Principal Engineer, you will play a critical role in designing and optimizing low-level software and compute kernels that extract maximum performance from GPUs and custom https://jobeax.com/link/E9YWQYPqVNR08j7F role is ideal for engineers who thrive close to hardware, enjoy performance tuning, and want to influence the software stack of cutting-edge AI https://jobeax.com/link/aDQMni1djXtTbYZd Responsibilities : - Design, implement, and optimize high-performance compute kernels for GPUs and/or custom AI accelerators- Develop low-level software in C/C++ and CUDA, targeting inference workloads for deep learning models- Apply advanced code optimization techniques, including : a. Vectorization (SIMD)b. Memory hierarchy optimization (registers, shared memory, caches)c. Parallelization strategies- Cache utilization and memory bandwidth optimization- Drive profiling, benchmarking, and performance tuning to achieve optimal resource utilization and minimal inference latency- Collaborate closely with architecture, compiler, and hardware teams to co-design performant solutions- Analyze bottlenecks across compute, memory, and interconnects, and propose architectural or software improvements- Mentor junior engineers and contribute to technical direction (for Principal-level candidates)Required Qualifications : - Strong expertise in C and C++, with deep understanding of low-level programming- Hands-on experience with CUDA and GPU programming- Proven experience developing high-performance kernels - Deep knowledge of performance optimization techniques, including : a. Vectorization and instruction-level optimizationb. Threading and parallel execution modelsc. Memory hierarchies and cache behavior- Experience with profiling and performance analysis tools (e.g., Nsight, VTune, perf, custom profilers)- Strong understanding of AI inference workloads (CNNs, Transformers, GEMM, attention, activation functions, etc.)Preferred / Nice-to-Have : - Experience working on AI inference frameworks, runtimes, or compilers- Background in computer architecture or microarchitecture- Experience optimizing for latency-critical systems- Exposure to custom silicon bring-up or hardware-software co-design- Contributions to performance-critical open-source projectsLevel Expectations : Senior Engineer : - Own complex kernel implementations- Independently drive optimization and tuning- Deliver production-quality, high-performance codePrincipal Engineer : - Define performance strategy and best practices- Influence architecture and software stack decisions- Lead complex, cross-functional technical initiativesWhy Join Us : - Work on cutting-edge AI inference silicon- Own performance-critical parts of the stack, close to hardware- High-impact role with strong technical ownership- Competitive compensation with meaningful ESOP upside (ref:hirist.tech)