Home / Engineering / ML Engineer, Inference Optimization

ML Engineer, Inference Optimization

Build Ai · San Francisco

ML Engineer, Inference Optimization is open at Build Ai in San Francisco. The posting gives a salary of $200K - $320K. Posted on Aug 30, 2026, and still on Build Ai’s careers page when we last checked, on Nov 14, 2026.

About the role

Inference is about 90% of compute spend. Economics are heavily driven by inference optimization. We’re hiring someone to make inference cheaper, faster, and good enough that we can scale the data engine and the product without the GPU bill eating the company. KEY RESPONSIBILITIES - Own inference performance: latency, throughput, and cost per unit of work (tokens, frames, or jobs) - Cut the 90% compute line: kernels…

The opening lines of the posting. The rest is on Build Ai’s careers page.

Hiring at Build Ai

Build Ai has 29 open roles right now. Most are in Engineering, Data & Research and Design. The median advertised salary across its roles with a published range is $240K. See all its roles

Similar Engineering jobs

All Engineering jobs
Apply on company site