Inference Engineer – LLM & Speech AI is open at Soket in Bengaluru, India. Posted on May 10, 2026, and still on Soket’s careers page when we last checked, on Nov 21, 2026.
About the role
We are looking for an experienced Inference Engineer to build and optimize high-performance inference systems for Large Language Models (LLMs), Speech AI systems, and multimodal AI workloads.
You will work on deploying production-grade AI systems with a strong focus on:
- low latency,
- high throughput,
- GPU efficiency,
- scalable serving infrastructure,
- distributed inference,
- and cost optimization.
This role sits at the intersection of:
- systems engineering,
- deep learning infrastructure,
- distributed computing,
- and production AI deployment.
You will collaborate closely with:
- ML researchers,
- platform engineers,
- speech AI teams,
- and product engineering teams.
The employer’s own description, as published on Soket’s careers page.
Hiring at Soket
Soket has 3 open roles right now. Most are in Engineering. See all its roles

