Platform Engineer - AI Infrastructure
Sarvam AI · Bengaluru, Chennai · posted 29 Jun 2026
Full-timeIT & Software
About the job
Platform Engineer - AI Infrastructure
About Sarvam
Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.
About the Role
Sarvam runs a large, multi-vendor GPU fleet that serves two demanding workloads on the same physical infrastructure: training jobs that span hundreds of GPUs, and inference services that must hold a flat p99 under production load. This role builds the platform that sits on top of that fleet - the scheduling, scaling, multi-tenancy, serving, and self-service layers that let our ML teams use thousands of GPUs without a human in the loop for every job.
This is the build side of infrastructure, not the operate side. Our SREs keep the fleet reliable and carry the pager; you build the systems that make the fleet usable - and that make it break less in the first place. The work is heavy software engineering: you will design and ship control-plane services, scheduler integrations, autoscaling controllers, the inference-serving platform, RBAC and quota systems, observability and cost tooling, and the CLI and APIs ML engineers touch every day. You will treat the platform as a product and its internal users as customers.
You should be a strong systems engineer who is fluent in Kubernetes at the controller and internals level, comfortable in Go or Python, and literate in the GPU-specific constraints - MIG and GPU sharing, gang scheduling, topology-aware placement, RDMA - that make this different from a generic cloud platform.
What You’ll Do
This is the surface area of the platform. You won't own all of it at once - you'll take a…
Similar jobs
S
Staff Engineer - Physical Design
SiFive India · Bengaluru, Karnataka, India · 15 Nov 2026
S
Full-Stack Staff Engineer
SiFive India · Hyderabad, India · 15 Nov 2026
S
Staff Engineer, Physical Design
SiFive India · Bengaluru, Karnataka, India · 15 Nov 2026
S
Staff Engineer, Physical Design
SiFive India · Bengaluru, Karnataka, India · 15 Nov 2026
S
Sr. Staff Engineer - Design Verification
SiFive India · Hyderabad, India · 15 Nov 2026
S
Senior Staff Engineer, Physical Design - NoC
SiFive India · Bengaluru, Karnataka, India · 15 Nov 2026
Collected from Sarvam AI's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.