Member of Technical Staff - ML Systems & Inference

As a Member of Technical Staff focused on ML Systems, you will build the inference systems that execute models end-to-end in production. You will work on the systems that determine how inference executes across that pipeline: how requests are batched and scheduled, how stages are placed and scaled, how KV cache and intermediate state move between accelerators, and how the system balances latency, throughput, and…

Gimlet has 17 open roles right now, 1 of them remote. Most are in Engineering, Finance & Trading and Data & Research. The median advertised salary across its roles with a published range is $270K. See all its roles