Staff Software Engineer - GenAI inference

Own and drive the architecture, design, and implementation of the inference engine, and collaborate on model-serving stack optimized for large-scale LLMs inference Partner closely with researchers to bring new model architectures or features (sparsity, activation compression, mixture-of-experts) into the engine Lead the end-to-end optimization for latency, throughput, memory efficiency, and hardware utilization…

Databricks has 896 open roles right now, 81 of them remote. Most are in Engineering, Sales & Business Development and Product. The median advertised salary across its roles with a published range is $216K. See all its roles