Research Engineer, AI Evaluations is open at Karya in Bengaluru, India. Posted on Oct 21, 2026, and still on Karya’s careers page when we last checked, on Nov 14, 2026.
About the role
Benchmark design: curate representative query sets and define rubrics and metrics that score reliably and separate models meaningfully. Choose between human, automated and hybrid evaluation based on reliability, cost and validity trade-offs. Expert input: design elicitation and adjudication processes that turn domain expertise into consistent, scalable judgments. Bias evaluation: develop methods to detect gender and…
The opening lines of the posting. The rest is on Karya’s careers page.
Hiring at Karya
Karya has 19 open roles right now. Most are in Data & Research, Engineering and Operations. See all its roles
