Home / Engineering / [Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering

[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering

Together AI · San Francisco
$160K - $280KOpen 121 daysLeadRustGoPythonKafkaCI/CDKubernetesCUDAAnsible

[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering is open at Together AI in San Francisco. The posting gives a salary of $160K - $280K. Posted on Jul 16, 2026, and still on Together AI’s careers page when we last checked, on Nov 14, 2026.

About the role

We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest-driven API where the inference team declares what they need, whether that's a cluster, a model deployment, or a capacity change, and our controllers handle the reconciliation, provider/runtime selection, and lifecycle management underneath, so the inference…

The opening lines of the posting. The rest is on Together AI’s careers page.

Hiring at Together AI

Together AI has 80 open roles right now, 2 of them remote. Most are in Engineering, Marketing & Community and Data & Research. The median advertised salary across its roles with a published range is $220K. See all its roles

Similar Engineering jobs

All Engineering jobs
Apply on company site