Staff Engineer, API Platform

Sarvam AI · Bengaluru · posted 21 May 2026
Full-timeIT & Software

About the job

About Sarvam Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC. About the Role Sarvam's model APIs (ASR, TTS, Vision, LLM, Translate) are how developers and enterprises ship products on our foundation models. The platform handles tens of millions of API calls every day, over HTTP and WebSockets, with metering, billing, prepaid wallets, and rate-limiting all part of the same stack. Today it's FastAPI and Python; we're in the middle of rewriting it in Go. We're hiring a Staff Engineer to own this platform end-to-end. The architecture. The reliability. The performance. The standards. This is an IC role. What You’ll Do - The end-to-end design and evolution of the platform, from the moment a request hits the edge to the response that goes back out - The Python→Go rewrite: leading the architecture, setting the patterns, and bringing the platform across without compromising reliability - Audio pipeline engineering: TTS chunking around model context limits, sample-rate adjustments and format encoding, VAD-based silence detection for ASR - Vision pipelines: orchestrating OCR, layout detection, and VLM harnesses for structured data extraction - Streaming infrastructure: WebSocket connections, queue-based batch processing, back pressure, low-latency model invocation - The commercial layer: metering, billing, prepaid wallet management, and rate-limiting, engineered to the same bar as the model APIs themselves - Performance and reliability for a multi-tenant platform operating at sub-second latency SLOs - Observability (logging, metrics,…

Read the full description on Sarvam AI's site ↗

Skills

Upload your CV on LitCareer to see which of these you match.

Similar jobs

STAFF, SOFTWARE ENGINEER
Walmart · IN KA BANGALORE Home Office PTPP2 · 14 Nov 2026
STAFF, SOFTWARE ENGINEER
Walmart · IN KA BANGALORE Home Office PTPP2 · 14 Nov 2026
STAFF, SOFTWARE ENGINEER
Walmart · IN TN CHENNAI Home Office Capita Land · 14 Nov 2026
STAFF, SOFTWARE ENGINEER
Walmart · IN KA BANGALORE Home Office PTPP1 · 14 Nov 2026
PRINCIPAL, SOFTWARE ENGINEER
Walmart · IN KA BANGALORE Home Office Building 10 · 14 Nov 2026
STAFF, SOFTWARE ENGINEER
Walmart · IN KA BANGALORE Home Office PW II · 14 Nov 2026

Collected from Sarvam AI's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.