Senior Software Engineer, AI Infrastructure Solutions

Nvidia · India, Pune · posted 5 Nov 2026
Full-timeIT & Software25+ years

About the job

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. NVIDIA is seeking an outstanding Senior Software Engineer to join our AI Infrastructure Solutions team in Pune. This is your opportunity to work on groundbreaking technologies and help build the future of computing! NVIDIA is a global leader in innovation, offering a dynamic and inclusive work environment in Pune or equivalent experience. We value diversity and provide equal opportunities to all candidates. If you’re passionate about building scalable AI platforms and autonomous agent solutions that impact industries worldwide, we want to hear from you! What You’ll Be Doing: • Design, build, and operate AI infrastructure solutions that power LLM-based applications and autonomous agents across the enterprise. • Develop agentic AI workflows and multi-agent systems, including tool calling, planning, memory, retrieval-augmented generation (RAG), and orchestration using frameworks such as LangChain, LangGraph, or similar. • Integrate and serve LLMs through APIs and inference endpoints, optimizing for latency, throughput, cost, and reliability. • Containerize applications with Docker and deploy and scale them on Kubernetes, including Helm charts, autoscaling, and GPU-enabled workloads. • Take applications to L3 level: own production readiness, advanced troubleshooting, root-cause analysis, performance tuning, and escalation support for complex issues beyond L1/L2. • Define and maintain observability for AI systems, including logging, metrics, tracing, and monitoring of agent behavior, LLM quality, and system health. • Build and maintain CI/CD pipelines for automated build, test, and deployment of AI applications and infrastructure. • Develop high-performance backend services and RESTful APIs (Python and/or .NET Core) that expose AI capabilities to internal applications. What…

Read the full description on Nvidia's site ↗

Skills

Upload your CV on LitCareer to see which of these you match.

Similar jobs

AWS Cloud Engineer
Nemetschek India · Bangalore, Karnataka · 17 Nov 2026
(IND) STAFF, SOFTWARE ENGINEER
Walmart · IN KA BANGALORE Home Office Building 11 · 16 Nov 2026
SENIOR, SOFTWARE ENGINEER
Walmart · IN KA BANGALORE Home Office Building 11 · 16 Nov 2026
STAFF, PRODUCT MANAGER
Walmart · IN KA BANGALORE Home Office PTPP1 · 16 Nov 2026
Principal, Product Manager
Walmart · IN KA BANGALORE Home Office PTPP1 · 16 Nov 2026
SYSTEMS AND INFRASTRUCTURE ENGINEER III, INFORMATION SECURITY
Walmart · IN KA BANGALORE Home Office Building 11 · 16 Nov 2026

Collected from Nvidia's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.