Senior Machine Learning Engineer, LLM Inference Optimization

As a Senior Machine Learning Engineer on the Applied AI team at Nebius Token Factory, you will own model and endpoint optimization from model artifacts through production deployment. Your work will span model internals, quantization and model compression, speculative decoding, KV-cache optimization, inference engines, serving architecture, and benchmarking to improve latency, throughput, memory efficiency, GPU…

Nebius has 374 open roles right now, 95 of them remote. Most are in Engineering, Data & Research and Security. The median advertised salary across its roles with a published range is $170K. See all its roles