LLM evaluation jobs
LLM evaluation: measuring how well an AI model answers, before and after changes. OpenAI, Anthropic, Snorkel AI, Wonderful and Braintrust have the most open roles mentioning LLM evaluation right now.
RSS feedMy jobs then shows how many are new each time you come back. No account, no email.
1,320 open roles · 116 posted in the last 7 days · 25% remote · 430 companies hiring · $240K median advertised salary · checked Nov 15 against employer career pages
Job titles in LLM evaluation roles
Bars show the share of these 1,320 roles; one role can count in several rows.
Newest LLM evaluation jobs
- FP&A AI Research ContributorAptura · Global—Remote, anywhereAICPAACCA
- AI Biologist - Protein Design & EngineeringLatchBio · 🇺🇸San Francisco (preferred)$140K - $180KRemotePythonAILLM evaluation
- Principal Software EngineerShowpad · 🇮🇳Pune—Lead and aboveGoPythonJava
- Certification ArchitectOpenAI · 🇺🇸San Francisco$266K - $295KHybridLLM evaluation
- Member of Product Staff, Core ProductAbridge · 🇺🇸SF Office$270K - $300KHybridLead and aboveMachine LearningGenerative AILLM evaluation
- Member of Product Staff, Foundation Models & Post-TrainingAbridge · 🇺🇸SF Office$250K - $290KHybridLead and aboveLLMAI agentsGenerative AI
- Creative Director, Brand StudioWebflow · 🇺🇸United States—RemoteLead and aboveLLM evaluationDesign systemsBrand design
- Senior DevSecOps EngineerAshby · Remote - European Union · +1 more location€108K - €145KRemoteSeniorGoPythonTypeScript
- Senior Security Platform Engineer - Secure DeliveryAshby · 🇺🇸Remote - US · +1 more location$178K - $250KRemoteSeniorGoPythonTypeScript
- Senior Software Engineer – Backend Platforms and Agentic & ML SystemsSocure · 🇺🇸Hub - San Francisco$230K - $270KHybridSeniorGoPythonTypeScript
- Research Scientist, Open Benchmarks Red TeamSnorkel AI · 🇺🇸New York City, NY (Hybrid); San Francisco, CA (Hybrid); U…$200K - $340KRemotePythonMachine LearningLLM
- Staff Software EngineerSocure · 🇺🇸Hub - San Francisco$225K - $280KHybridLead and aboveGoPythonTypeScript
- Clinical AI Research FellowshipKineticsystems · Remote—RemoteAILLM evaluationPharmacy
- Staff Software Engineer, Internal ProductsAnthropic · 🇺🇸Remote-Friendly (Travel-Required) | San Francisco, CA | S…$405K - $485KRemoteLead and aboveLLMLLM evaluationReconciliations
- Senior Machine Learning Engineer, PlatformBlock · 🇺🇸Bay Area, CA, United States of America$194K - $343KSeniorGoPythonTypeScript
- Senior Engineer - Technical StaffSavvy · 🇺🇸NYC Office$175K - $230KHybridSeniorReactPostgreSQLGCP
- Product LeadSavvy · 🇺🇸NYC Office$206K - $292KHybridLead and aboveLLMLLM evaluation
- Software Developer, CarrierTextNow, Inc. · 🇨🇦Waterloo, ON$113K - $162KGoLLMCI/CD
- AI Engineer: EvalsPhysicsX · 🇬🇧London—LLMAIOpenTelemetry
- AI Agent ArchitectBybit · 🇦🇪🇭🇰🇲🇾Abu Dhabi, UAE; Hong Kong SAR; Kuala Lumpur, Malaysia—GoNode.jsJava
- Principal Technical Product Manager, AI Growth SystemsPacaso · 🇺🇸United States, Remote$200K - $225KRemoteLead and aboveAILLM evaluationDesign systems
- AI Platform EngineerPolygon Labs · EMEA - Remote—RemoteGoPythonTypeScript
- Sr. Research Scientist - Agent FlywheelDatabricks · 🇺🇸New York City, New York$164K - $235KSeniorLLMAI agentsLLM evaluation
- Senior Software Development Engineer in Test (SDET)Thinkific · 🇨🇦Distributed - CanadaCA$88K - CA$110KSeniorReactRuby.NET
- Member of Technical Staff, ML Platform (Evals)Runway Ml · Remote$240K - $290KRemotePythonLLMPyTorch
- Staff Software Engineer, Support TechnologyAnthropic · 🇺🇸San Francisco, CA | New York City, NY | Seattle, WA$405K - $485KLead and aboveLLMZendeskAI agents
- Applied Data ResearcherFigma · 🇺🇸San Francisco, CA • New York, NY • United States$235K - $376KPythonSQLMachine Learning
- Product Manager | Bill PayRamp · 🇺🇸New York, NY (HQ)$230K - $325KHybridLLM evaluationERP
- Senior Fullstack Engineer (m/f/d) - AI Health techVoize · 🇩🇪Berlin · +1 more location—RemoteSeniorTypeScriptReactKotlin
- Research Engineer, Synthetic Data (Singapore Time)Pragmatike · 🇸🇬Singapore—RemotePythonDockerLinux
- Research Engineer, Synthetic Data (Pacific Time)Pragmatike · 🇺🇸United States—RemotePythonDockerLinux
- Staff Forward Deployed Engineer, EMEAGitLab · 🇮🇪🇦🇹🇫🇷Remote Ireland; Remote, Austria; Remote, France; Remote…—RemoteLead and aboveGoTypeScriptRuby
- Technical Program Manager, PacingAnthropic · 🇺🇸San Francisco, CA | New York City, NY$290K - $365KLLM evaluationRisk management
- Engineering Manager, Agents — SFHarvey · 🇺🇸San Francisco$260K - $330KLLMAI agentsLLM evaluation
- Marketing EngineerBasata · 🇺🇸Tempe, Arizona—PythonJavaScriptSQL
- Senior Technical Product Manager - Compliance & Recording1GLOBAL · 🇩🇪Berlin, Berlin, Germany—SeniorLLMAWSLLM evaluation
- Founding Machine Learning EngineerSolstice · 🇺🇸New York City$140K - $250KPythonMachine LearningLLM
- Product Manager, GTM AI SystemsZip · 🇺🇸San Francisco$150K - $185KHybridLLMSnowflakeAI
- Head of Engineering (Frontier Safety)Far.ai · Remote (International)$225K - $350KRemoteLead and abovePython.NETGCP
- Partner Applied AI Engineer, Oracle and Cloud ISVOpenAI · 🇺🇸San Francisco$197K - $278KPythonLLMSnowflake
- Partner Applied AI Engineer, Google CloudOpenAI · 🇺🇸San Francisco$197K - $278KHybridPythonGCPLLM
- Senior Applied AI Enginner, AI PlatformHeadway · Remote$183K - $278KRemoteSeniorPythonTypeScriptReact
- Member of Technical Staff, EvalsMagic.dev · 🇺🇸San Francisco$200K - $550KRemoteMachine LearningLLM evaluation
- Product Manager, Inference ExperienceBaseten · 🇺🇸San Francisco$200K - $400KHybridMachine LearningLLMPyTorch
- Product Manager, Training PlatformBaseten · 🇺🇸San Francisco$200K - $400KHybridMachine LearningLLM evaluationReinforcement learning
- Machine Learning Engineering Intern (Masters/PhD) - Summer 2027Riot Games · 🇺🇸Los Angeles, USA—InternPythonSQLMachine Learning
- Subject Matter Experts: Machine Learning Model EvaluationTerac · 🇺🇸United States—RemoteMachine LearningAILLM evaluation
- Senior Software EngineerSnorkel AI · 🇺🇸United States (Remote)$208K - $315KRemoteSeniorTypeScriptJavaLLM
- Staff Software EngineerFoundationhealthcareers · 🇺🇸Orlando, FL—HybridLead and aboveLLMRAGAI agents
- Senior Data ScientistEbury · 🇪🇸Madrid—SeniorPythonSQLGCP
- Conversation Quality AnalystBolna · 🇮🇳Bengaluru—SQLLLMLLM evaluation
- Staff Applied AI Engineer - Pre-SalesSnorkel AI · 🇺🇸New York City, NY (Hybrid); San Francisco, CA (Hybrid); U…$190K - $330KRemoteLead and abovePythonMachine LearningLLM
- Software Engineer II, FintechTwitch · 🇺🇸San Francisco, CA$165K - $224KPythonTypeScriptJavaScript
- Principal Product Manager, DataFigure Lending · 🇺🇸San Francisco, CA; Pittsburgh, PA$154K - $231KLead and aboveGoSQLGenerative AI
- Member of Data Staff (Data Acceleration)Perplexity · 🇺🇸San Francisco$175K - $330KLead and aboveSQLLLMdbt
- Senior SAM AnalystCoinbase · 🇬🇧Remote - UK · +1 more location£56K - £62KRemoteSeniorSQLSnowflakeGenerative AI
- Applied AI Architect, CyberOpenAI · 🇨🇦Vancouver · +1 more locationCA$236K - CA$262KHybridPythonJavaScriptCI/CD
- Founding Member of Operations Staff, GTMPreference Model · 🇺🇸San Francisco$180K - $240KLead and aboveMachine LearningLLMLLM evaluation
- Research Engineer, Real EnvironmentsMercor · 🇺🇸San Francisco$160K - $500KAI agentsLLM evaluation
- Engineering ManagerTuring · 🇺🇸United States—PythonReactNode.js
- Clinical InformaticistKnit Health · 🇺🇸San Francisco$165K - $200KPythonSQLLLM
- Research Engineering Manager, STEMTuring · 🇺🇸United States$260K - $350KPythonPostgreSQLDocker
- Senior AI Product Manager, Evals & AnnotationsArize AI · 🇺🇸United States (Remote)$200K - $250KRemoteSeniorLLMAI agentsGenerative AI
- Senior AI Application Engineer, Creator ToolsRoblox · 🇺🇸San Mateo, CA, United States$243K - $295KSeniorPythonJavaC++
- Principal Agentic Engineer, AI EcosystemLife360 · 🇺🇸Remote, USA$247K - $363KRemoteLead and aboveAIAI agentsLLM evaluation
- Cyber & AI Risk AnalystAlpaca · Remote - EMEA—RemoteGCPLLMAI
- Product Marketing Operations Manager | UK | RemoteGrafana Labs · 🇬🇧United Kingdom (Remote)£74K - £89KRemoteLLM evaluationObservabilityProject management
- Product Marketing Operations Manager | Sweden | RemoteGrafana Labs · 🇸🇪Sweden (Remote)—RemoteLLM evaluationObservabilityProject management
- Product Marketing Operations Manager | Spain | RemoteGrafana Labs · 🇪🇸Spain (Remote)€67K - €81KRemoteLLM evaluationObservabilityProject management
- Product Marketing Operations Manager | Ireland | RemoteGrafana Labs · 🇮🇪Republic of Ireland (Remote)€84K - €101KRemoteLLM evaluationObservabilityProject management
- Product Marketing Operations Manager | Germany | RemoteGrafana Labs · 🇩🇪Germany (Remote)€78K - €94KRemoteLLM evaluationObservabilityProject management
- Subject Matter Expert, LegalOpenAI · 🇺🇸San Francisco$284K - $315KHybridLLM evaluationLitigation
- Software Engineer - AI ToolingSupabase · Remote, Global—Remote, anywhereTypeScriptJavaScriptPostgreSQL
- Senior Product Manager - AI/MLClickHouse · 🇩🇪Germany · +1 more location—RemoteSeniorSQLLLMAI
- Staff AI Platform EngineerLife360 · 🇺🇸Remote, USA$149K - $272KRemoteLead and aboveLLMAIAI agents
- Senior Product Manager, Contract OrchestrationZip · 🇨🇦TorontoCA$148K - CA$210KHybridSeniorLLM evaluationUser research
- Machine Learning Engineer, Transaction RiskStripe · 🇺🇸Seattle, New York City—Machine LearningLLMAI
- Senior Security ResearcherSnyk · 🇵🇹Portugal - Lisbon Office—SeniorPythonLLMAI agents
- Senior Product ManagerRazorpay Software Private Limited · 🇮🇳Bengaluru—SeniorSQLLLMRails
- Tech Lead, Applied AI - EvalsMercor · 🇺🇸San Francisco$260K - $500KLead and aboveGoPythonTypeScript
- Forward Deployed Engineer, Applied AIPika · 🇺🇸Palo Alto HQ—AIGenerative AILLM evaluation
- Lead, Singapore Center of Excellence (Safety)xAI · 🇸🇬Singapore—Lead and abovePythonSQLLLM
- Sr. Model Engineer, RL DataCursor · 🇺🇸Palo Alto, CA$220K - $357KSeniorRustPythonC++
- Software Engineer, Research ToolingCursor · 🇺🇸Palo Alto, CA$140K - $225KPythonTypeScriptReact
- Software Engineer, Pretraining DataCursor · 🇺🇸Palo Alto, CA$160K - $250KLLM evaluationData quality
- Model Engineer, RL DataCursor · 🇺🇸Palo Alto, CA$160K - $250KRustPythonC++
- AI & Machine Learning ManagerUnison Group · 🇮🇳Bengaluru, Karnataka, India—PythonMachine LearningLLM
- AI & Machine Learning Manager (Techno-Functional)Unison Group · 🇮🇳Bengaluru, Karnataka, India—PythonGCPAzure
- Machine Learning Manager (AI)Unison Group · 🇮🇳Bengaluru, Karnataka, India—PythonGCPAzure
- Founding AI Platform EngineerZipdev · 🇺🇸United States—RemoteTypeScriptNode.jsPostgreSQL
- Associate Director, Responsible AI SolutionsFord Foundation · 🇺🇸New York, USA—Lead and abovePythonSQLGCP
- Solutions Engineer (Central Region)Braintrust · 🇺🇸Austin—RemotePythonTypeScriptGenerative AI
- Commercial Account Executive (West Region)Braintrust · 🇺🇸San Francisco—LLM evaluationObservabilitySolution selling
- Software Engineer, Applied AI- EvalsMercor · 🇺🇸San Francisco$220K - $250KGoPythonTypeScript
- Forward Deployed Engineer, Western EuropeCursor · 🇬🇧London—RemotePythonTypeScriptJavaScript
- Staff+ Software Engineer, Safeguards EvalsAnthropic · 🇺🇸New York City, NY; San Francisco, CA; Seattle, WA$320K - $485KLead and aboveLLMAI agentsLLM evaluation
- Forward Deployed Engineer - IndiaCursor · 🇮🇳Bengaluru—PythonTypeScriptJavaScript
- Forward Deployed Engineer - JapanCursor · 🇯🇵Japan—RemotePythonTypeScriptJavaScript
- Staff Software Engineer, Agentic AnalyticsCohere · 🇺🇸United States$250K - $325KHybridLead and abovePythonSQLGCP
- Head of GTM OpsBraintrust · 🇺🇸San Francisco—Lead and aboveLLM evaluationObservabilityCPQ
Showing the newest 100. See all 1,320 in search
Who is hiring for LLM evaluation roles
Where LLM evaluation roles are
- 🇺🇸United States855
- 🇺🇸California486
- 🇺🇸San Francisco Bay Area476
- 🇺🇸New York, NY201
- 🇪🇺Europe182
- 🌏Asia-Pacific117
- 🇬🇧United Kingdom72
- 🇬🇧London56
- 🇮🇳India56
- 🇨🇦Canada52
A role that lists several places is counted in each of them.
What LLM evaluation roles pay, by level
| Level in the title | Median advertised salary | Roles counted |
|---|---|---|
| No level in the title | $242K | 339 |
| Senior | $207K | 157 |
| Lead and above | $262K | 205 |
Medians of the midpoints of advertised yearly US-dollar ranges; a level needs at least 15 such roles. Advertised, not verified pay.
Jobs you can get with LLM evaluation
| Kind of work | Open jobs asking for LLM evaluation | Median advertised pay |
|---|---|---|
| Machine learning engineer | 262 | $238K |
| Software engineer | 240 | $250K |
| Applied AI and AI adoption | 147 | $250K |
| AI engineer | 139 | $233K |
| Research scientist | 112 | $306K |
| Product manager | 95 | $230K |
| Forward deployed engineer | 93 | $242K |
| Solutions engineer | 90 | $240K |
Skills asked together with LLM evaluation
LLM (65%), Python (51%), AI agents (43%), AI (39%), Machine Learning (27%), TypeScript (19%), AWS (17%), SQL (16%) of the 1,320 open postings that name LLM evaluation.
Companies hiring for LLM evaluation
LLM evaluation salariesQuestions about LLM evaluation jobs
- What is LLM evaluation?
- Measuring how well an AI model answers, before and after changes. 1,320 open roles on Jobs Every Hour ask for it as of Nov 15, 2026.
- How many LLM evaluation jobs are open right now?
- There are 1,320 open LLM evaluation jobs at 430 companies on Jobs Every Hour as of Nov 15, 2026. 116 of them were posted in the last seven days. The list is rebuilt every hour from the employers' own careers pages.
- Which companies have the most LLM evaluation jobs?
- Right now the most openings are at OpenAI (66), Anthropic (60), Snorkel AI (43), Wonderful (39) and Braintrust (32). The ranking changes as companies open and close roles.
- Are there remote LLM evaluation jobs?
- 329 of the 1,320 open LLM evaluation jobs (25%) are listed as remote. Remote roles are often limited to certain countries or time zones, so check the location line of each job.
- What do LLM evaluation jobs pay in pounds?
- 16 of the open postings state a yearly range in pounds: the median midpoint is £135,000, and the middle half advertise £115,000 to £235,000. These are advertised ranges as each employer wrote them, not verified pay.
- What do LLM evaluation jobs pay in euros?
- 19 of the open postings state a yearly range in euros: the median midpoint is €112,500, and the middle half advertise €79,000 to €126,500. These are advertised ranges as each employer wrote them, not verified pay.
- What do LLM evaluation jobs pay?
- The median advertised salary is $240K, based on 708 open roles that publish a yearly US-dollar range. The middle half of those roles advertise between $200K and $286K. These are advertised ranges, not verified pay. Most employers here are technology companies, so the figures run above the wider market for the same work.
- Is it hard to get an LLM evaluation job?
- 35 of the 1,320 open LLM evaluation jobs (3%) are for beginners: junior roles and internships. Of the 598 postings that state experience, the median asks for 5 years. 430 companies are hiring and 116 roles were posted in the last seven days. Matching your resume to the skills each posting names helps most; the free resume builder shows the match.
- How is AI changing LLM evaluation jobs?
- 1,089 of the 1,320 open LLM evaluation jobs (82%) ask for AI or machine-learning skills, most often LLM, AI, Machine Learning. Employers still list 1,320 such roles today at 430 companies. Counted from the postings' own text on Nov 15, 2026.
- What skills do LLM evaluation jobs ask for?
- Most often LLM evaluation (100%), LLM (65%), Python (51%), AI agents (43%), AI (39%) of the 1,320 open postings, counted from their own text on Nov 15, 2026.
- Which job titles come up most in LLM evaluation jobs?
- Software Engineer (60), Forward Deployed Engineer (54), Senior Software Engineer (44), Applied AI Architect (40), Staff Software Engineer (39): the most common titles among the 1,320 open roles, without the level and place notes in brackets.
- Are LLM evaluation jobs in demand in 2026?
- 1,320 LLM evaluation jobs are open on Jobs Every Hour today at 430 companies, 0.9% of all 148,162 open jobs here; 116 were posted in the last seven days. The median advertised salary is $240K. 329 (25%) can be done remotely.
- How do I apply for LLM evaluation jobs?
- Open a job and press “Apply on company site”. You go straight to the employer's own careers page and apply there. Jobs Every Hour needs no account and charges nothing for applying.
Narrow down LLM evaluation jobs
By place
- LLM evaluation jobs in the United States 855
- LLM evaluation jobs in California 486
- LLM evaluation jobs in New York, NY 201
- LLM evaluation jobs in Europe 182
- 🌏LLM evaluation jobs in Asia-Pacific 117
- LLM evaluation jobs in India 56
- LLM evaluation jobs in London 56
- LLM evaluation jobs in Canada 52
- LLM evaluation jobs in Seattle, WA 48
- LLM evaluation jobs in Bangalore 33
- LLM evaluation jobs in Germany 30
- LLM evaluation jobs in Washington, DC 27
- LLM evaluation jobs in Boston, MA 25
- LLM evaluation jobs in Singapore 22
- LLM evaluation jobs in Toronto 18
- LLM evaluation jobs in Chicago, IL 16
- LLM evaluation jobs in Texas 16
- LLM evaluation jobs in Ireland 12
- LLM evaluation jobs in Spain 12
- 🌎LLM evaluation jobs in Latin America 11
- LLM evaluation jobs in Austin, TX 11
- LLM evaluation jobs in France 10
- LLM evaluation jobs in Berlin 10
- LLM evaluation jobs in Japan 9
- LLM evaluation jobs in Poland 8
- LLM evaluation jobs in Hong Kong 8
- LLM evaluation jobs in Hyderabad 8
- LLM evaluation jobs in the United Kingdom
- LLM evaluation jobs in San Francisco Bay Area








































