Senior Machine Learning Engineer, LLM Inference Optimization
Nebius · London · posted 13 Nov 2026
Full-timeIT & Software
About the job
About Nebius:
Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.
Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.
Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.
The role
As a Senior Machine Learning Engineer on the Applied AI team at Nebius Token Factory, you will own model and endpoint optimization from model artifacts through production deployment. Your work will span model internals, quantization and model compression, speculative decoding, KV-cache optimization, inference engines, serving architecture, and benchmarking to improve latency, throughput, memory efficiency, GPU utilization, and cost per token while preserving quality and reliability.
You will work with kernel and platform engineers to investigate serving problems, compare configurations, and resolve performance and quality regressions. You will evaluate model- and engine-level optimizations together with distributed inference designs, including request routing, scheduling, prefill/decode coordination, and multi-node GPU execution. Your improvements will be validated through reproducible benchmarks and safe production rollouts under real-world workloads.
Your responsibilities
• Own optimization projects for specific model families, customer endpoints, or serving backends.
• Compare inference engines and recommend serving configurations suited to individual workloads.
• Diagnose model-quality and…
Similar jobs
Z
Data Scientist
Zego · London · 16 Nov 2026

ML Data & Platform Engineer
Speechmatics · London · 16 Nov 2026
Senior Data Analyst, Marketing Measurement
Airalo · United Kingdom · 16 Nov 2026
Software Developer - Senior Consultant (Contract)
Opencast · Hybrid - Newcastle, Edinburgh, Glasgow, Leeds, Manchester, Birmingham, Bristol, London · 16 Nov 2026
Software Developer - Senior Consultant
Opencast · Hybrid - Newcastle, Edinburgh, Glasgow, Leeds, Manchester, Birmingham, Bristol, London · 16 Nov 2026
Software Developer - Consultant
Opencast · Hybrid - Newcastle, Edinburgh, Glasgow, Leeds, Manchester, Birmingham, Bristol, London · 16 Nov 2026
Collected from Nebius's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.