Senior Machine Learning Engineer, LLM Inference Optimization

Nebius · Zurich · posted 17 Nov 2026

✓ Checked open today on Nebius's careers site

Full-timeIT & Software

About the job

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI. Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D. The role As a Senior Machine Learning Engineer on the Applied AI team at Nebius Token Factory, you will own model and endpoint optimization from model artifacts through production deployment. Your work will span model internals, quantization and model compression, speculative decoding, KV-cache optimization, inference engines, serving architecture, and benchmarking to improve latency, throughput, memory efficiency, GPU utilization, and cost per token while preserving quality and reliability. You will work with kernel and platform engineers to investigate serving problems, compare configurations, and resolve performance and quality regressions. You will evaluate model- and engine-level optimizations together with distributed inference designs, including request routing, scheduling, prefill/decode coordination, and multi-node GPU execution. Your improvements will be validated through reproducible benchmarks and safe production rollouts under real-world workloads. Your responsibilities • Own optimization projects for specific model families, customer endpoints, or serving backends. • Compare inference engines and recommend serving configurations suited to individual workloads. • Diagnose model-quality and…

Read the full description on Nebius's site ↗

Get your application ready

Most CVs are filtered out by screening software before a person reads them. Our team of PhDs and industry professionals can help with this one.

Free revision within 7 days, and a full refund if it isn't delivered on time or doesn't match the description.

Skills

Upload your CV on LitCareer to see which of these you match.

Similar jobs

Senior Security Engineer, Software
Scopely · CH - Zurich · 18 Nov 2026
✓ Checked open today
Sr. Forward Deployed Engineer - FDE (Fullstack)
databricks · Zürich · 18 Nov 2026
✓ Checked open today
Solutions Architect - CPG and Manufacturing
databricks · Zürich · 18 Nov 2026
✓ Checked open today
Senior Staff Software Engineer - Delta
databricks · Zürich · 18 Nov 2026
✓ Checked open today
S
Senior .NET Developer
SwissPeak Partners · Luzern, Luzern, Switzerland · 18 Nov 2026
✓ Checked open today
S
Senior Java Developer (Performance Focused)
SwissPeak Partners · Zurich, Zürich, Switzerland · 18 Nov 2026
✓ Checked open today

Collected from Nebius's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.