Senior System Software Engineer - Local AI Automation
Nvidia · India, Pune · posted 16 Oct 2026
Full-timeIT & Software
About the job
The Local AI Automation team is seeking a Senior System Software Engineer passionate about building and maintaining robust system-level software and infrastructure for deploying, benchmarking, and qualifying high-quality AI applications and models. You will collaborate with a team of highly qualified engineers dedicated to creating top-tier infrastructure for Local AI automation. If you have a real passion for building reliable, scalable automation systems in the AI ecosystem, this could be an excellent opportunity for us to work together!
What you'll be doing:
• Design, implement, and maintain robust system software and infrastructure to efficiently run various AI workloads through different inference backends such as Llama.cpp, Ollama, PyTorch, vLLM, WinML, TRT-RTX, and others.
• Scope out system requirements for deploying various AI applications, benchmarks, and models in automation, and develop solutions to measure correctness, functionality, reliability, and overall system performance.
• Develop infrastructure to download AI models from various sources, efficiently manage a local model repository, and create automated synchronization mechanisms to keep the repository up to date.
• Analyze large datasets and system workload metrics, implement data processing infrastructure to transform raw data into actionable information for developers, and design useful visualizations.
• Collaborate with internal Local AI developers to identify and implement system-level instrumentation, diagnostics, and debugging capabilities that help quickly debug and isolate issues.
• Design, implement, and maintain robust infrastructure for automated build, integration, deployment, and qualification across different inference frameworks and environments.
• Understand existing infrastructure and system software architecture, debug issues in current frameworks, identify performance bottlenecks, and devise solutions to enhance system efficiency and scalability.
What we need to see:
•…
Skills
Upload your CV on LitCareer to see which of these you match.
Similar jobs
W
QA Engineer
Weekday AI · India · 15 Nov 2026
0
Staff Engineer, Software
0100 Invitrogen Holdings · Bangalore, India · 15 Nov 2026
0
Engineer III, Software
0100 Invitrogen Holdings · Bangalore, India · 15 Nov 2026
0
Engineer III, Software
0100 Invitrogen Holdings · Bangalore, India · 15 Nov 2026
0
Staff Engineer, Software
0100 Invitrogen Holdings · Bangalore, India · 15 Nov 2026
Principal Software Engineer
Microsoft · India · 14 Nov 2026
Collected from Nvidia's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.