Home / Engineering / Software Engineer, Model Runtime

Software Engineer, Model Runtime

OpenAI · San Francisco
Hybrid$266K - $445KRustPythonC++LLM

Software Engineer, Model Runtime is open at OpenAI in San Francisco (hybrid). The posting gives a salary of $266K - $445K. Posted on Aug 24, 2026, and still on OpenAI’s careers page when we last checked, on Nov 14, 2026.

About the role

You will build the model runtime within the inference engine that executes complex, frontier models at scale on OpenAI’s custom silicon. The runtime will sit between models running on the hardware and the upper layers of the cluster serving software stack, translating demanding inference workloads into efficient execution while optimizing for throughput, latency, utilization, and reliability. You will work across…

The opening lines of the posting. The rest is on OpenAI’s careers page.

Hiring at OpenAI

OpenAI has 838 open roles right now, 31 of them remote. Most are in Engineering, Sales & Business Development and Data & Research. The median advertised salary across its roles with a published range is $308K. See all its roles

Similar Engineering jobs

All Engineering jobs
Apply on company site