LLM Inference Systems Engineer is open at Hippocratic AI in Menlo Park, CA. The posting gives no salary; similar roles in the United States advertise a median of $194K. Posted on Oct 7, 2026, and still on Hippocratic AI’s careers page when we last checked, on Nov 14, 2026.
About the role
We’re seeking an inference systems engineer to build the distributed serving and high-performance networking layer behind our large language models. You will own the path from model server to GPU fabric: prefill/decode disaggregation, KV-cache transfer, multi-node execution, and the observability and benchmarks needed to make those systems reliable in production. This role sits in the Inference team within the…
The opening lines of the posting. The rest is on Hippocratic AI’s careers page.
Hiring at Hippocratic AI
Hippocratic AI has 51 open roles right now, 16 of them remote. Most are in Engineering, Data & Research and Consulting & Solutions. See all its roles
