C

Staff Software Engineer, Inference

Coreweaveu · London · posted 18 Nov 2026

✓ Checked open today on Coreweaveu's careers site

Full-timeIT & Software8+ years

About the job

CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at www.coreweave.com. We're proud to be a Living Wage accredited Employer. What You'll Do: CoreWeave’s Inference team builds and operates the core cloud platform powering massive-scale GPU workloads for AI/ML, VFX, rendering, and real-time inference. Our stack is engineered for speed, scale, and cost efficiency—providing a powerful alternative to traditional hyperscalers where infrastructure is our core product operated at massive scale. About the role: As a Staff Software Engineer on the Inference team, you will operate as a technical leader across multiple teams and services, driving architecture, performance, and reliability for CoreWeave’s Kubernetes-native inference platform. You will define and lead complex, cross-cutting design initiatives spanning request routing, adaptive scheduling, GPU resource management, and cost-per-token optimisation under strict P99 SLAs. In this high-impact role, you will implement advanced inference optimisations—such as speculative decoding and KV-cache reuse—while establishing performance benchmarking frameworks, guiding cross-functional alignment across infrastructure boundaries, and raising the bar for engineering rigour and observability practices across the organisation. Who You Are: • Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience). • 8+ years of experience building large-scale distributed systems or cloud platforms, with a proven track record of…

Read the full description on Coreweaveu's site ↗

Get your application ready

Most CVs are filtered out by screening software before a person reads them. Our team of PhDs and industry professionals can help with this one.

Free revision within 7 days, and a full refund if it isn't delivered on time or doesn't match the description.

Skills

Upload your CV on LitCareer to see which of these you match.

Similar jobs

Software Engineer II (Full-Stack) - Growth
Deliveroo · London, England, United Kingdom · 18 Nov 2026
✓ Checked open today
Senior Director, ML Software
Graphcore · Bristol · 18 Nov 2026
✓ Checked open today
F
Staff Platform Engineer, Infrastructure - Core UK & Ireland
Fanaticsfbg · Leeds; London · 18 Nov 2026
✓ Checked open today
E
Software Engineer - EMS (London based)
Elwoodtechnologies · London · 18 Nov 2026
✓ Checked open today
H
AI Engineer, Growth
Hrtechx · London · 18 Nov 2026
✓ Checked open today
H
AI Engineer
Hrtechx · London · 18 Nov 2026
✓ Checked open today

Collected from Coreweaveu's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.