Skip to content
Software Development

Software Engineer - Model API Platform

Sarvam AI

  • Bengaluru · On-site
  • Full-time · Mid level

Check my ATS match for this job →

Source: Sarvam AI careers page. You apply on the employer's own website.

About this job

About Sarvam

Sarvam is building the bedrock of Sovereign AI for India. The company is developing India's full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV and Khosla Ventures. Sarvam partners with India's leading brands, including Tata Capital, SBI Life, CRED, IDFC and LIC.


About the role

Sarvam's model APIs (ASR, TTS, Vision, LLM, Translate) are how developers and enterprises ship products on our foundation models. The platform handles tens of millions of API calls every day, over HTTP and WebSockets, with metering, billing, prepaid wallets and rate-limiting all part of the same stack.

We are hiring a Software Engineer to own major parts of this platform end to end, working closely with the Staff Engineer who leads its architecture. You will take an area such as speech to text pipeline,or text to speech pipeline, and be accountable for its reliability, performance and end-to-end latencies. This role is for someone who is obsessed with latencies, optimizes services and network paths to shave off milliseconds, ships fast, reasons from first principles, and treats AI as the default way to get engineering work done.


What you will do


Own a platform area end to end

• Own one or more major parts of the platform, such as the WebSocket streaming layer, a speech recognition pipeline, or text to speech pipeline: build, operate and improve them.

• Turn loosely defined goals into RFCs, milestones and shipped results, and write down the decisions and trade-offs.

• Be accountable after launch: on-call, incident response, root-cause analysis and follow-through on fixes.

• Make the call when a decision is needed, and own the outcome.

• Obsessed with latencies, dissecting existing services to understand the system, and tuning the right knobs to optimize performance.

• Bring services across without regressions in customer-facing APIs, latency or reliability.


Build real-time and model-serving pipelines

• Build and operate streaming infrastructure: WebSocket connections, long-lived sessions queue-based batch processing, backpressure and low-latency model invocation.

• Engineer audio pipelines: TTS chunking around model context limits, sample-rate conversion and format encoding, and VAD-based silence detection for ASR.

• Hold your services to sub-100ms latency SLOs in a multi-tenant environment, and know where every millisecond goes.


Think in systems and from first principles

• Reasons from constraints: latency budgets per hop, throughput, cost per request, failure modes and tenant isolation.

• Use back-of-the-envelope estimates to decide what to build, what to optimize and what to leave alone.

• Prefer simple designs you can fully explain over clever ones you cannot.

• Build in observability from day one: logging, metrics and tracing that let anyone debug production quickly.


Raise the bar for the team

• Strengthen the integration testing harness so the team can ship fast without breaking customer-facing APIs.

• Partner with the Inference and MLOps teams on making model serving fast, reliable and operable.

• Mentor junior engineers through RFC reviews, code review and pairing.

• Practice design-first, documentation-first engineering: RFCs before code, no tribal knowledge.


What we are looking for

• 4–6 years of building and operating production backend systems.

• At least one service you owned end to end under real load, including what broke and what you changed.

• Strong distributed-systems fundamentals: concurrency, networking, queues, caching, consistency and failure modes.

• Experience with low-latency or high-throughput services, and comfort reasoning about p95 and p99 latency.

• Solid fundamentals with a relational database and a cache, such as PostgreSQL and Redis: schema design, query performance and caching strategy.

• Fluency in at least one backend language and willingness to work in both Python and Golang.

• Experience running services with containers, CI/CD and production monitoring.

• Daily, hands-on use of AI tools in your engineering workflow, with concrete examples of what you automated or sped up.

• A bias for action: fast on reversible decisions, careful on irreversible ones.

• Clear writing, especially RFCs and design docs that others can act on.


Good to have (not required)

• Voice AI or real-time audio experience: WebSockets, WebRTC, streaming ASR or TTS, or audio processing with FFmpeg or pyav, codecs, sample rates and VAD.

• Production experience in Go, or in Python with FastAPI.

• Experience serving LLM, ASR, TTS or vision models in production.

• Experience building metering, billing, wallet or payments infrastructure.

• Running services on Kubernetes in production.

• Time at an early- or growth-stage startup.


Why Sarvam

• A fast-moving, high talent-density team building full-stack AI for India, with real population-scale impact.

• Researchers, engineers, builders and business leaders who move fast and hold each other to a very high bar.

• High ownership and high impact from day one.

• AI-first in everything, from how we build and ship to how we think about problems

Skills mentioned

  • LLM
  • PostgreSQL
  • Redis
  • Python
  • Golang
  • CI/CD
  • FastAPI
  • Kubernetes

Have these skills? Make sure they appear on your resume in the same words.

Similar jobs

See all jobs →
New On-site Lead / Manager

SW Architect CICD_EPS1

Bosch

  • Location:Bengaluru
  • Experience:8–10 yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description Must Have Skills Architectural Design Process: Mastery of systematic architectural design, including the ability to translate requirements into viable system designs (e.g., C4 model), design for critical quality attributes (scalability, reliability), and document decisions effecti...

  • CI/CD
  • Jenkins
  • Python
  • Linux
  • Docker
  • Kubernetes
  • +1 more

Bosch careers page

Apply now
New On-site Senior

Airbag - Senior Developer

Bosch

  • Location:Bengaluru
  • Experience:3–8 yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description Job Description Experience in programming Embedded C applications with strong background in C inheritance, templates and pointers. Strong development experience in embedded C and RTOS Strong communication and interpersonal skills. Must be a self-starter. Ability to work as part of...

  • Git
  • Jenkins
  • Python
  • Agile
  • C++
  • Scrum

Bosch careers page

Apply now
New On-site Senior

Senior Engineer - Data Modelling and Data Backend

Bosch

  • Location:Bengaluru
  • Experience:8–10 yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description Design scalable, technology-agnostic data models for enterprise software developmentDevelop MongoDB schemas, graph data structures, Python backend services, REST APIs, and data-processing solutions.Translate business, domain, and compliance requirements into logical and physical d...

  • MongoDB
  • Python
  • Microservices
  • Azure
  • LLM

Bosch careers page

Apply now
New On-site Senior

Senior Engineer - Data Modelling and Data Backend

Bosch

  • Location:Bengaluru
  • Experience:8–10 yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description Design scalable, technology-agnostic data models for enterprise software developmentDevelop MongoDB schemas, graph data structures, Python backend services, REST APIs, and data-processing solutions.Translate business, domain, and compliance requirements into logical and physical d...

  • MongoDB
  • Python
  • Microservices
  • Azure
  • LLM

Bosch careers page

Apply now
New On-site Mid level

Algorithm SW (ASW) Developer for Braking Systems (Hybrid Electric & Autonomous Vehicle Functions) -2026

Bosch

  • Location:Bengaluru
  • Experience:7–8 yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description Responsible for developing control algorithm SW for braking system products (ESP, ESPHev, IPB, DPB and BWA). Application software development in compliance with ASPICE requirementsTechnical Skills:Experience in Embedded Automotive Software Development.Hand-on experience in Program...

  • C++
  • Agile
  • Stakeholder Management

Bosch careers page

Apply now
New On-site Mid level

ServiceNow Developer – Hardware Asset Management (HAM)

Bosch

  • Location:Bengaluru
  • Experience:7–12 yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description Roles & Responsibilities : Job Description Design, develop and enhance ServiceNow Hardware Asset Management (HAM) solutions, focusing on the physical hardware asset lifecycle from request and procurement through receiving, deployment, transfer, maintenance, retirement and disposal...

  • JavaScript
  • Git
  • Python
  • CI/CD

Bosch careers page

Apply now