U
Senior Inference Engineer
Uniphore Technologies North America · USA - CA - Palo Alto · posted 26 Oct 2026
Full-timeEngineering
About the job
Uniphore is the Business AI company. Our sovereign, composable and secure AI platform connects enterprise data, fine-tunes AI models and deploys agentic AI across the enterprise. We empower every worker to boost productivity and help businesses grow faster, operate smarter and reduce costs. Trusted by more than 2,000 businesses globally, and recognized on the Deloitte Fast 500, Uniphore delivers on the promise of AI as a transformative force for business.
Job Description:
Senior Inference Engineer –
Uniphore is building an enterprise AI platform where agents operate across voice, video, text, and structured data in real time. We are looking for a Senior or Staff Inference Engineer to own the inference layer — combining deep model inference expertise with systems engineering to deliver a context-aware runtime serving finetuned SLMs across cloud, on-premises, and widely used GPU platforms.
This is a hands-on individual contributor role working closely with Uniphore’s research, model engineering, knowledge systems, agent, and pla4orm teams.
What You Will Build Context-aware runtime: Integrate context selection, compression, conversation compaction, and persistent task state with model execution. Adapt context budgets, model selection, and reasoning effort to each task.
KV-cache and computation optimization: Build paged KV-cache and prompt-prefix-cache management, cache-aware routing, retention, eviction, and offloading. Preserve correctness as context, permissions, model versions, and adapters change.
Inference performance: Implement and tune speculative decoding, aQention kernels, continuous batching, quantization, chunked prefill, and multi-GPU parallel execution.
SLM and adapter lifecycle: Build model and adapter lifecycle management, multi-adapter serving, zero-downtime hot swapping, and resource scheduling.
Production reliability: Implement observability (DCGM, Prometheus, Grafana), tenant isolation, overload protection, failure recovery, and safe rollout and…
Read the full description on Uniphore Technologies North America's site ↗
Similar jobs
G
Project Engineer
Greystar Management Services · City Office Austin, Austin, TX · 15 Nov 2026
G
DataOps Engineer
Greystar Management Services · Remote, United States · 15 Nov 2026
R
Network Engineer IV
Rackspace US · Seattle, Washington · 15 Nov 2026
6
Data Engineer, VP - Systems and Data Engineering
65016 Blackstone Life Sciences Advisors L L C · New York · 15 Nov 2026
Sr. Functional Safety Engineer
Dana India · Boucherville, Quebec, CA, Canada · 15 Nov 2026
0
Engineer/Principal Systems Engineer (Electrical Engineering - Digital Signal Processing)
0090 CORP-Corporate Office · United States-Illinois-Rolling Meadows · 15 Nov 2026
Collected from Uniphore Technologies North America's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.