Home / Engineering / Senior Staff LLM Inference Engineer

Senior Staff LLM Inference Engineer

D Matrix · Santa Clara
Hybrid$195K - $285KLead and abovePythonC++LLMAICUDA

Senior Staff LLM Inference Engineer is open at D Matrix in Santa Clara (hybrid). The posting gives a salary of $195K - $285K. Posted on Aug 18, 2026, and still on D Matrix’s careers page when we last checked, on Nov 15, 2026.

About the role

Identify and prototype emerging LLM inference use cases suited to heterogeneous hardware deployments. - Build compelling proof-of-concept systems that demonstrate D-Matrix capabilities to customers, partners, and internal stakeholders. - Develop and tune custom kernels and operator-level optimizations to maximize throughput and minimize latency. - Drive quantization, sparsity, and batching strategies tailored to the…

The opening lines of the posting. The rest is on D Matrix’s careers page.

Hiring at D Matrix

D Matrix has 37 open roles right now, 2 of them remote. Most are in Engineering, People & Recruiting and Sales & Business Development. The median advertised salary across its roles with a published range is $222K. See all its roles

Similar Engineering jobs

All Engineering jobs
Apply on company site