Skip to content
DevOps & Cloud

Performance Engineer, Kernels

Sarvam AI

  • Bengaluru · On-site
  • Full-time · Mid level

Check my ATS match for this job →

Source: Sarvam AI careers page. You apply on the employer's own website.

About this job

Performance Engineer, Kernels

Part of Sarvam's Performance Engineering team. We are hiring two specialized performance roles - Kernels (this posting) and Inference (companion posting). They are a vertical stack: the kernels team authors the µs-level GPU code, and the inference team integrates it into a running serving stack and owns the system-level numbers. If your depth genuinely spans both, apply to either and tell us - but most candidates are strongest in one, and we hire for that depth.

Location: [Bengaluru / Chennai / Hybrid / On-site] · Team: Performance Engineering · Level: Senior

About the team

Sarvam serves multiple model families - small and large LLMs, Mixture-of-Experts, streaming Indic ASR, and multimodal - across a multi-node, multi-tenant fleet on H100 / H200 / B200. The Performance Engineering team owns the numbers the rest of the company plans against: how fast we serve, how much it costs, and how much we get out of every GPU. This team works at the intersection of the serving runtime, the kernel layer, and the SRE org that keeps the fleet alive.


About the role

You will own the kernel layer. Where stock libraries - cuBLAS, cuDNN, FlashAttention, out-of-the-box Triton - leave performance on the table, you will author the custom CUDA, DSL-based, and PTX kernels that close the gap.

This is a hard, narrow, high-leverage role. We hire engineers who have shipped kernels that beat published baselines on real workloads, not engineers who have used kernels. When your code lands, production p99 moves, and you own the explanation of why.

What we're looking for

  • 5+ years in ML systems, with 2+ years authoring production CUDA kernels. You have a kernel in production that beat the prior baseline by a measurable margin.

  • CUDA at kernel-authoring level: thread-block sizing, shared-memory layout, warp primitives, async copies (cp.async, TMA), and MMA selection.

  • CUTLASS / CuTe DSL at a modify-and-extend level, with comfort in the layout algebra.

  • PTX at a debug-and-modify level - you have inserted hand-written PTX where the compiler missed.

  • Nsight Compute and Systems fluency: you read a roofline plot and propose the fix.

  • Attention kernels: you have authored or modified at least one (FlashAttention-family, paged, MLA, sliding-window, or sparse).

  • Multi-architecture awareness: what changes from Hopper to Blackwell (TMA, WGMMA, tcgen05).


Strong pluses

  • Communication kernels - NCCL / NVSHMEM authoring, custom collectives, expert-parallel dispatch (DeepEP-style), AFD bipartite comms (StepMesh-style), KV transfer (DualPath / Mooncake). Strongly desired; dedicated comms-specialist headcount is expected later.

  • Open-source kernel contributions - FlashAttention, CUTLASS examples, vLLM / SGLang kernels, DeepEP, Mooncake, or non-trivial Triton work. For this role, the GitHub filter is the highest-yield signal.

  • tcgen05, TMA, CTA-cluster launch and distributed shared memory, async pipelining, and the FP4/microscaling paths

  • Grace-side host-path optimization on GH200 / GB200.

Similar jobs

See all jobs →
New On-site Senior

Cybersecurity development

Bosch

  • Location:Bengaluru
  • Experience:6+ yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description JD for Cybersecurity Development: Development, test of HSM and AR Cryptostack Hands-on experience in embedded software development using C/C++, with basic knowledge of scripting languages such as Python for automation and analysis tasks Experience in implementing and supporting au...

  • C++
  • Python
  • Agile
  • Scrum

Bosch careers page

Apply now
New On-site Senior

Sr. Product Owner – DevOps and Software Delivery

Bosch

  • Location:Bengaluru
  • Experience:14–15 yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description Own the product roadmap, backlog, and release planning for enterprise software delivery platforms.Drive end-to-end software delivery across development, testing, deployment, and operations.Lead stakeholder management across business units, engineering teams, architects, operations...

  • Stakeholder Management
  • CI/CD
  • Agile
  • Scrum
  • Azure
  • Kubernetes
  • +7 more

Bosch careers page

Apply now
On-site Lead / Manager

Staff DevOps Engineer

Zscaler

  • Location:Bengaluru
  • Employment type:Full-time
  • Salary not disclosed

Zscaler (NASDAQ: ZS) accelerates digital transformation so customers can be more agile, efficient, resilient, and secure. The Zscaler Zero Trust Exchange platform protects thousands of customers from cyberattacks and data loss by securely connecting users, devices, and applications in any locatio...

  • AWS
  • GCP
  • Kubernetes
  • Terraform
  • CI/CD
  • Ansible
  • +3 more

Zscaler careers page

Apply now
On-site Entry level

IT System Administrator I

Rubrik

  • Location:Bengaluru
  • Experience:5+ yrs
  • Employment type:Full-time
  • Salary not disclosed

About The Team: Come join our growing team to deliver amazing technology support experiences that fuel the vision of Dynamic Work for our employees. As a System Administrator, you will focus on delivering world-class technology support for both our employees and our workspaces, driven by the impo...

  • SaaS
  • Jira
  • Onboarding
  • Python
  • Confluence

Rubrik careers page

Apply now
On-site Lead / Manager

OT Security Consultant and Cybersecurity Solution Architect

Bosch

  • Location:Bengaluru
  • Experience:10–14 yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description Roles & Responsibilities : OT Asset Discovery and Validation: Discover OT assets, connected devices and communication protocols across all in-scope plants, including unmanaged assets. Apply a safe mix of passive and active discovery and data collection methods and validate every f...

  • Stakeholder Management

Bosch careers page

Apply now
On-site Lead / Manager

Engineering Manager, Core Infrastructure

Stripe

  • Location:Bengaluru
  • Experience:10+ yrs
  • Employment type:Full-time
  • Salary not disclosed

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase...

  • AWS
  • Kubernetes
  • Ruby
  • Java

Stripe careers page

Apply now