🇺🇸LLM evaluation jobs in Boston, MA
25 open roles mentioning LLM evaluation in Boston, MA as of Nov 15, 2026. Klaviyo, LangChain, Motional, Suno and Anduril Industries have the most. 1 is remote.
My jobs then shows how many are new each time you come back. No account, no email.
Skills asked for in LLM evaluation roles in Boston, MA
Bars show the share of these 25 roles; one role can count in several rows.
- Senior / Staff Software Engineer, Data InfrastructureSuno · 🇺🇸Boston$229K - $364KLead and abovePythonTerraformMachine Learning
- Lead Product Data Scientist, ForecastingKlaviyo · 🇺🇸Boston—Lead and abovePythonSQLMachine Learning
- Software Engineering Manager, AI Observability & Evals Platform (Boston)LangChain · 🇺🇸Boston, MA$220K - $270KGoPythonTypeScript
- Principal Software Engineer, Team Lead - Perception PlatformsMotional · 🇺🇸Boston, Massachusetts, United States; Las Vegas, Nevada…$240K - $330KRemoteLead and abovePythonC++Machine Learning
- Sr. Lead Software EngineerKlaviyo · 🇺🇸Boston—Lead and abovePythonLLMDjango
- Deployed Engineer (Boston)LangChain · 🇺🇸Boston, MA$185K - $300KPythonJavaScriptGCP
- Lead Engineer, Applied AI (Customer Agent)Klaviyo · 🇺🇸Boston · +2 more locations—Lead and aboveLLMAIAI agents
- Engineering Manager, Amplify Engineering & AI AgentsKlaviyo · 🇺🇸Boston—PythonTypeScriptReact
- Lead Security Compliance EngineerKlaviyo · 🇺🇸Boston · +1 more location—Lead and abovePythonSQLTerraform
- Senior Fullstack Engineer, AI Observability & Evals PlatformLangChain · 🇺🇸Boston, MA$175K - $240KSeniorGoPythonTypeScript
- Senior Backend Software Engineer, AI Observability & Evals Platform (LangSmith)LangChain · 🇺🇸Boston, MA$170K - $235KSeniorPythonPostgreSQLGCP
- Staff Engineer, Applied AI (Customer Agent)Klaviyo · 🇺🇸Boston—Lead and aboveLLMAIAI agents
- Machine Learning Scientist — Large Multimodal Models (Post-Training)Iambic Therapeutics · 🇺🇸Boston Office—HybridPythonDockerMachine Learning
- Sr. Staff Engineer, Applied AI (Customer Agent)Klaviyo · 🇺🇸Boston · +1 more location—Lead and aboveLLMAILLM evaluation
- Sr. Lead Engineer, Applied AI (Customer Agent)Klaviyo · 🇺🇸Boston · +1 more location—Lead and aboveLLMAILLM evaluation
- Forward Deployed Product Manager – AIIterative Health · 🇺🇸Cambridge, Massachusetts, United States, New York, New Yo…$170K - $250KPythonLLMAI
- AI Solutions Engineer, Talent AcquisitionAnduril Industries · 🇺🇸Boston, Massachusetts, United States$161K - $212KPythonLLMCI/CD
- Full Stack Agentic DeveloperCharles River Associates · 🇺🇸Boston, MA, United States; Chicago, IL, United States; Da…$150K - $230KPythonTypeScriptReact
- Data Scientist (AI Quality & Evaluation)Bioscope AI · 🇺🇸Boston Office—HybridPythonMachine LearningLLM
- Manager, Machine LearningLayer Health · 🇺🇸Boston or NYC$250K - $275KPythonMachine LearningLLM
Who is hiring for LLM evaluation roles in Boston, MA
Questions about LLM evaluation jobs in Boston, MA
- How many LLM evaluation jobs in Boston, MA are open right now?
- There are 25 open LLM evaluation jobs in Boston, MA at 10 companies on Jobs Every Hour as of Nov 15, 2026. 0 of them were posted in the last seven days. The list is rebuilt every hour from the employers' own careers pages.
- Which companies have the most LLM evaluation jobs in Boston, MA?
- Right now the most openings are at Klaviyo (13), LangChain (4), Suno (1), Motional (1) and Iambic Therapeutics (1). The ranking changes as companies open and close roles.
- Are there remote LLM evaluation jobs in Boston, MA?
- 1 of the 25 open LLM evaluation jobs in Boston, MA (4%) are listed as remote. Remote roles are often limited to certain countries or time zones, so check the location line of each job.
- Is it hard to get one of the LLM evaluation jobs in Boston, MA?
- 0 of the 25 open LLM evaluation jobs in Boston, MA (0%) are for beginners: junior roles and internships. Of the 11 postings that state experience, the median asks for 5 years. 10 companies are hiring and 0 roles were posted in the last seven days. Matching your resume to the skills each posting names helps most; the free resume builder shows the match.
- How is AI changing LLM evaluation jobs in Boston, MA?
- 23 of the 25 open LLM evaluation jobs in Boston, MA (92%) ask for AI or machine-learning skills, most often LLM, AI, Machine Learning. Employers still list 25 such roles today at 10 companies. Counted from the postings' own text on Nov 15, 2026.
- What skills do LLM evaluation jobs in Boston, MA ask for?
- Most often LLM evaluation (100%), LLM (84%), Python (68%), AI (64%), AI agents (36%) of the 25 open postings, counted from their own text on Nov 15, 2026.
- Which job titles come up most in LLM evaluation jobs in Boston, MA?
- Lead Engineer (3), Lead Security Compliance Engineer (2), Sr. Staff Engineer (2), Sr. Lead Engineer (2): the most common titles among the 25 open roles, without the level and place notes in brackets.
- Are LLM evaluation jobs in Boston, MA in demand in 2026?
- 25 LLM evaluation jobs in Boston, MA are open on Jobs Every Hour today at 10 companies, 0.0% of all 148,162 open jobs here; 0 were posted in the last seven days. 1 (4%) can be done remotely.
- How do I apply for LLM evaluation jobs in Boston, MA?
- Open a job and press “Apply on company site”. You go straight to the employer's own careers page and apply there. Jobs Every Hour needs no account and charges nothing for applying.
More like LLM evaluation jobs in Boston, MA
- Jobs in Boston, MA 2,529
- LLM evaluation jobs 1,320
Next to it
- Python jobs in Boston, MA 585
- LLM jobs in Boston, MA 295
- Machine Learning jobs in Boston, MA 270
- AWS jobs in Boston, MA 262
- SQL jobs in Boston, MA 257
- CI/CD jobs in Boston, MA 203
- GCP jobs in Boston, MA 159
- AI jobs in Boston, MA 146
- Agile jobs in Boston, MA 141
- Kubernetes jobs in Boston, MA 140
- C++ jobs in Boston, MA 137
- Azure jobs in Boston, MA 131



