Platform Engineer - AI Infrastructure

Sarvam AI · Bengaluru, Chennai · posted 29 Jun 2026
Full-timeIT & Software

About the job

Platform Engineer - AI Infrastructure About Sarvam Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC. About the Role Sarvam runs a large, multi-vendor GPU fleet that serves two demanding workloads on the same physical infrastructure: training jobs that span hundreds of GPUs, and inference services that must hold a flat p99 under production load. This role builds the platform that sits on top of that fleet - the scheduling, scaling, multi-tenancy, serving, and self-service layers that let our ML teams use thousands of GPUs without a human in the loop for every job. This is the build side of infrastructure, not the operate side. Our SREs keep the fleet reliable and carry the pager; you build the systems that make the fleet usable - and that make it break less in the first place. The work is heavy software engineering: you will design and ship control-plane services, scheduler integrations, autoscaling controllers, the inference-serving platform, RBAC and quota systems, observability and cost tooling, and the CLI and APIs ML engineers touch every day. You will treat the platform as a product and its internal users as customers. You should be a strong systems engineer who is fluent in Kubernetes at the controller and internals level, comfortable in Go or Python, and literate in the GPU-specific constraints - MIG and GPU sharing, gang scheduling, topology-aware placement, RDMA - that make this different from a generic cloud platform. What You’ll Do This is the surface area of the platform. You won't own all of it at once - you'll take a…

Read the full description on Sarvam AI's site ↗

Skills

Upload your CV on LitCareer to see which of these you match.

Similar jobs

S
Staff Engineer - Physical Design
SiFive India · Bengaluru, Karnataka, India · 15 Nov 2026
S
Full-Stack Staff Engineer
SiFive India · Hyderabad, India · 15 Nov 2026
S
Staff Engineer, Physical Design
SiFive India · Bengaluru, Karnataka, India · 15 Nov 2026
S
Staff Engineer, Physical Design
SiFive India · Bengaluru, Karnataka, India · 15 Nov 2026
S
Sr. Staff Engineer - Design Verification
SiFive India · Hyderabad, India · 15 Nov 2026
S
Senior Staff Engineer, Physical Design - NoC
SiFive India · Bengaluru, Karnataka, India · 15 Nov 2026

Collected from Sarvam AI's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.