Senior System Software Engineer, DGX Cloud AI Infrastructure
Nvidia · US, CA, Santa Clara · posted 6 Nov 2026
Full-timeIT & Software
About the job
NVIDIA’s DGX Cloud team builds the infrastructure behind large-scale AI training for NVIDIA’s own training workloads and for our customers. We build services, tools and open-source software that make ML workloads more efficient and resilient.
We’re looking for a Senior Software Engineer for the NVIDIA Recovery and Resilience team. You’ll own our AI infrastructure services, tools and open-source projects to support resilient and efficient training from design through production. You’ll also mentor engineers and decide how the team runs what it builds.
What You Will Be Doing:
• Drive the design, build, launch and operation of our services, tools and open-source projects.
• Plan and assign the team’s work, mentor junior engineers and review designs.
• Build resilient AI infrastructure on Kubernetes and Slurm for NVIDIA’s own training workloads and customer workloads. This includes supercomputers at major cloud providers and on-premises clusters.
• Build APIs that connect to NVIDIA’s resiliency systems: telemetry, break/fix automation, and checkpoint and execution systems.
• Build a job submission layer that hides infrastructure failures from users and restarts long-running training jobs automatically.
• Build agentic tools that help customers improve training efficiency by finding bottlenecks, diagnosing failures and recommending fixes.
• Drive our open-source work. Release components so customers and the community can use them, and work with them to improve those components.
• Set up how the team runs its services: support, monitoring, alerts, CI/CD, integration test gates and on-call plans.
What We Need To See:
• BS, MS or PhD in Computer Science or a related field (or equivalent experience), plus 12+ years of experience.
• Proven experience who has taken large systems from design through production.
• Strong experience with Kubernetes and/or Slurm at scale.
• Hands-on experience with PyTorch, TensorFlow, JAX or Ray.
• Strong understanding of NVIDIA GPUs and…
Similar jobs
G
Senior Software Engineer
Green Dot · Los Angeles, CA | San Francisco, CA · 14 Nov 2026
G
Sr. Engineer, Software Development
Green Dot · Los Angeles, CA | San Francisco, CA · 14 Nov 2026
G
Sr. Engineer, Software Development
Green Dot · Los Angeles, CA | San Francisco, CA · 14 Nov 2026
G
Sr. Engineer, Software Development
Green Dot · Los Angeles, CA | San Francisco, CA · 14 Nov 2026
G
Sr. Engineer, Software Development
Green Dot · Los Angeles, CA | San Francisco, CA · 14 Nov 2026
G
Senior Software Engineer
Green Dot · Los Angeles, CA | San Francisco, CA · 14 Nov 2026
Collected from Nvidia's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.