LLM Inference Engineer (Mid, Sr, Staff) is open at Hippocratic AI in Menlo Park, CA. The posting gives no salary; similar roles in the United States advertise a median of $235K. Posted on Sep 30, 2026, and still on Hippocratic AI’s careers page when we last checked, on Nov 14, 2026.
About the role
Design and implement multi-node serving architectures for distributed LLM inference - Optimize multi-LoRA serving systems - Apply advanced quantization techniques (FP4/FP6) to reduce model footprint while preserving quality - Implement speculative decoding and other latency optimization strategies - Develop disaggregated serving solutions with optimized caching strategies for prefill and decoding phases -…
The opening lines of the posting. The rest is on Hippocratic AI’s careers page.
Hiring at Hippocratic AI
Hippocratic AI has 51 open roles right now, 16 of them remote. Most are in Engineering, Data & Research and Consulting & Solutions. See all its roles
