Skip to content
Data & AI

ML Ops Engineer, Chanakya

Sarvam AI

  • Delhi · On-site
  • Full-time · Mid level

Check my ATS match for this job →

Source: Sarvam AI careers page. You apply on the employer's own website.

About this job

About Sarvam

Sarvam is building the bedrock of Sovereign AI for India. The company is developing India's full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India's leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.

About the Role

The MLOps Engineer owns the model lifecycle across all defence and strategic sector deployments — from serving infrastructure and monitoring to evaluation pipelines and environment management. You ensure the system is always on, always accurate, and always auditable.

You will work across both layers: supporting Strategic Deployment Engineers in the field, and owning the model deployment infrastructure for new products being built by the product engineering team. The standards here are uncompromising — a model failure is not a UX problem, it is an operational risk.

What You'll Do

• Design and operate model serving infrastructure across on-prem and cloud deployments

• Build and maintain CI/CD pipelines for model updates, rollbacks, and evaluation-gated deployments

• Monitor model performance in production — latency, accuracy drift, throughput, failure modes — and build systems that surface issues before clients do

• Build evaluation infrastructure: harnesses, A/B testing, and model comparison tooling for field and lab use

• Manage containerised model serving in constrained, air-gapped, and edge environments

• Collaborate with Data Scientists on eval pipelines; own the infrastructure layer underneath

• Create runbooks and operational playbooks that Strategic Deployment Engineers can use in the field

• Own incident response for model-layer failures across all active deployments

What We're Looking For

• 3–5 years in ML engineering or MLOps with at least one production LLM or ML system in continuous operation

• Deep expertise in model serving: vLLM, TGI, Triton Inference Server, or equivalent; experience with quantised model formats (GGUF, AWQ, GPTQ)

• Experience fine-tuning and adapting models in constrained, on-prem, or air-gapped environments, including managing data pipelines and compute limitations specific to the environment

• Containerisation experience with Docker, Kubernetes, or lightweight alternatives (K3s, K0s) for constrained and edge environments; familiarity with deploying across heterogeneous hardware and infrastructure configurations

• Monitoring and observability using Prometheus, Grafana, or equivalent; ability to build custom eval dashboards

• Python fluency; familiarity with fine-tuning workflows and model evaluation frameworks

• Hands-on experience with CI/CD tooling for ML pipelines: GitHub Actions, ArgoCD, DVC, or similar

Signals We Look For

• You've kept a production ML system running under load — and debugged it when it broke

• You don't wait for things to fail; you build systems that tell you when they're about to

• You write documentation that actually gets used, by people who aren't you

Who You Are

• You treat uptime and correctness as equally non-negotiable

• You understand that operational reliability is a form of trust-building

• You're as comfortable optimising inference throughput as you are writing a field runbook for a deployment engineer

• You take ownership of model and stack health across every active deployment — not just the ones you set up

Why Sarvam?

Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.

• Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar

• High ownership and high impact, from day one

• Everything we do is AI-first, from the way we build and ship to the way we think about problems

• You can work on problems that could change how an entire country learns, works, and communicates

If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.

Skills mentioned

  • CI/CD
  • LLM
  • Docker
  • Kubernetes
  • Prometheus
  • Grafana
  • Python

Have these skills? Make sure they appear on your resume in the same words.

Similar jobs

See all jobs →
On-site Mid level

Embedded Data Scientist, Chanakya

Sarvam AI

  • Location:Delhi
  • Experience:2–5 yrs
  • Employment type:Full-time
  • Salary not disclosed

About Sarvam Sarvam is building the bedrock of Sovereign AI for India. The company is developing India's full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enter...

  • Machine Learning
  • Data Analysis
  • Python
  • Pandas
  • NumPy
  • NLP
  • +1 more

Sarvam AI careers page

Apply now
Hybrid Lead / Manager

Applied AI Architect

OpenAI

  • Location:Delhi
  • Employment type:Full-time
  • Salary not disclosed

About the Team The AI Architect team partners with organizations to turn OpenAI's most capable models into meaningful, real-world impact. We work with customers across industries and digital-native businesses to identify where AI can create value, design secure and scalable solutions, and help th...

  • LLM
  • Python
  • JavaScript

OpenAI careers page

Apply now
New On-site Entry level

Software Engineer - Big Data Engineer (Spark, Databricks, PySpark , Snowflake)

NielsenIQ

  • Location:Pune
  • Experience:2–5 yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description Our NielsenIQ Technology teams are working on revamping multiple platform, a unified, global, open data ecosystem powered by Microsoft Azure. Our clients around the world rely on NielsenIQ’s data and insights to innovate and grow. As a Big Data Software Engineer, you’ll be part of...

  • Spark
  • Databricks
  • Snowflake
  • Azure
  • Prototyping
  • CI/CD
  • +9 more

NielsenIQ careers page

Apply now
New On-site Mid level

Data Engineer

NielsenIQ

  • Location:Chennai
  • Experience:3–6 yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description Our NielsenIQ Technology teams are working on revamping multiple platform, a unified, global, open data ecosystem powered by Microsoft Azure. Our clients around the world rely on NielsenIQ’s data and insights to innovate and grow. As a Big Data Software Engineer, you’ll be part of...

  • Azure
  • Prototyping
  • Spark
  • Scala
  • Databricks
  • CI/CD
  • +7 more

NielsenIQ careers page

Apply now
New On-site Senior

AI Analyst, BI

NielsenIQ

  • Location:Pune
  • Experience:6–8 yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description Job Summary We are looking for an experienced AI & BI Automation Technical Lead to design, enhance and scale AI-powered Business Intelligence automation solutions. The role combines hands-on Microsoft Power Platform, Python, Azure and Generative AI engineering with technical owner...

  • Python
  • Azure
  • Generative AI
  • Onboarding
  • Pandas
  • SQL
  • +9 more

NielsenIQ careers page

Apply now
New On-site Mid level

Data Engineering & Agentic AI

Bosch

  • Location:Bengaluru
  • Experience:8+ yrs
  • Employment type:Full-time
  • Salary not disclosed

Job Description Key Responsibilities:Design and develop scalable and reliable data pipelines and data processing solutions.Read data sets from enterprise-wide applications and data lakes, deploy them into data warehouse, which can be accessed via spreadsheets, Power BI or other analytical platfor...

  • Power BI
  • Python
  • ETL
  • SQL
  • MySQL
  • Jenkins
  • +2 more

Bosch careers page

Apply now