Software Engineer, Training/Inference (C++) is open at xAI in Palo Alto, CA; Seattle, WA. The posting gives a salary of $160K - $250K. Posted on Oct 4, 2024, and still on xAI’s careers page when we last checked, on Nov 14, 2026.
About the role
Architect and implement scalable distributed infrastructure for model serving (load balancing, auto-scaling, batch scheduling, global KV cache) Optimize latency and throughput of model inference under real production workloads Build and operate high-concurrency serving systems with excellent tail latency and high reliability at the scale required to serve millions of users Benchmark, fine-tune, and accelerate…
The opening lines of the posting. The rest is on xAI’s careers page.
Hiring at xAI
xAI has 296 open roles right now, 20 of them remote. Most are in Engineering, Manufacturing & Trades and Operations. The median advertised salary across its roles with a published range is $205K. See all its roles
