Software Engineer, Inference Systems is open at River AI Inc. in Palo Alto, CA. The posting gives a salary of $200K - $420K. Posted on Sep 11, 2026, and still on River AI Inc.’s careers page when we last checked, on Nov 14, 2026.
About the role
We are looking for exceptional inference systems engineers to build the engines that serve large models through the River API. Your goal is to deliver fast, reliable inference while making efficient use of GPU compute and memory. You will take ownership of the serving runtime, from request scheduling and continuous batching to KV-cache management, distributed model execution, and checkpoint loading. Your work will…
The opening lines of the posting. The rest is on River AI Inc.’s careers page.
Hiring at River AI Inc.
River AI Inc. has 24 open roles right now. Most are in Engineering, Data & Research and Operations. The median advertised salary across its roles with a published range is $310K. See all its roles
Similar Engineering jobs
All Engineering jobs- Design Verification Emulation, HardwareRiver AI Inc. · 🇺🇸Austin, TX, Palo Alto, CA$200K - $420KPythonC++CI/CD
- Robotics Data ResearcherClera · 🇪🇸Barcelona—Machine Learning
- Sr. Software Engineer, Machine Learning & Data InfrastructureOKX · 🇺🇸San Jose, California, United States$179K - $268KSeniorGoPythonJava
