Distributed LLM Inference Engineer is open at Anyscale in San Francisco (hybrid). The posting gives a salary of $170K - $245K. Posted on May 27, 2026, and still on Anyscale’s careers page when we last checked, on Nov 14, 2026.
About the role
As a Distributed LLM Inference Engineer, you will help systems and optimizations that push the boundaries of performance for inference at large scale. This is an incredibly critical role to Anyscale as it allows us to achieve a market leading position for AI infrastructure. As part of this role, you will - Iterate very quickly with product teams to ship the end to end solutions for Batch and Online inference at high…
The opening lines of the posting. The rest is on Anyscale’s careers page.
Hiring at Anyscale
Anyscale has 24 open roles right now, 1 of them remote. Most are in Engineering, Sales & Business Development and Security. The median advertised salary across its roles with a published range is $240K. See all its roles
