Inference engineer jobs in the United States
160 open roles for inference engineers in the United States as of Nov 15, 2026. Cerebras, CoreWeave, Anthropic, Together AI and Baseten have the most. 13 are remote and the median advertised salary is $256K.
My jobs then shows how many are new each time you come back. No account, no email.
Skills asked for in inference engineer roles in the United States
Bars show the share of these 160 roles; one role can count in several rows.
- Senior Software Engineer II, InferenceCoreWeave · 🇺🇸Sunnyvale, CA / Bellevue, WA$182K - $242KSeniorGoPythonC++
- Senior Software Engineer, ML Serving PlatformDoorDash USA · 🇺🇸San Francisco, CA; Sunnyvale, CA; Seattle, WA$168K - $247KSeniorGoPythonJava
- Product Manager, Inference ExperienceBaseten · 🇺🇸San Francisco$200K - $400KHybridMachine LearningLLMPyTorch
- Product Manager, Inference PlatformBaseten · 🇺🇸San Francisco$200K - $400KHybridMachine LearningLLMPyTorch
- Inference EngineerAdaption · 🇺🇸San Francisco—HybridRustPythonC++
- Principal Solutions Specialist, InferenceCoreWeave · 🇺🇸Bellevue, WA / Dallas, TX / Livingston, NJ / Manhattan, N…$177K - $237KLead and aboveMachine LearningLLMKubernetes
- Staff Technical Program Manager, InferenceCoreWeave · 🇺🇸Livingston, NJ / New York City, NY / Sunnyvale, CA / Bell…$177K - $237KLead and aboveObservabilityServerlessCustomer onboarding
- Sr. Software Engineer, Training/Inference (C++)xAI · 🇺🇸Palo Alto, CA$220K - $357KSeniorRustC++LLM
- Partner Manager, InferenceMistral.ai · 🇺🇸Palo Alto—
- Senior Inference Optimization ML EngineerRhoda Ai · 🇺🇸Mountain View—SeniorLLMPyTorchAWS
- Forward Deployed Engineer, InferenceCohere · 🇺🇸United States$240K - $415KGoPythonC++
- (Senior/Junior AI Inference Reliability Engineer, Compute InfraTogether AI · 🇺🇸San Francisco$160K - $280KSeniorMachine LearningKubernetesCUDA
- Associate Director/Director, Inference EngineeringLila Sciences · 🇺🇸Cambridge, MA USA; San Francisco, CA USA$204K - $348KLead and aboveLLM
- Senior Machine Learning Engineer, Inference - USAInworld AI · 🇺🇸Mountain View, California, USA$250K - $300KSeniorRustPythonC++
- Senior Backend Engineer, Inference CloudCerebras · 🇺🇸Sunnyvale, CA—HybridSenior.NETPostgreSQLGraphQL
- Software Engineer Intern, InferenceRhoda Ai · 🇺🇸Mountain View—InternPythonC++PyTorch
- (Staff / Senior Staff) AI Inference Reliability Engineer, Compute InfraTogether AI · 🇺🇸San Francisco$250K - $320KLead and aboveMachine LearningKubernetesCUDA
- AI Inference Core - Senior SDET, Release Integration TestingCerebras · 🇺🇸Sunnyvale, CA—HybridSeniorGoPython.NET
- Staff Applied Scientist, Experimentation and Causal InferenceDoorDash USA · 🇺🇸California, CA; San Francisco, CA; Seattle, WA; New York,NY$194K - $285KLead and aboveSQLMachine Learning
- Research Engineer - InferencePrimeIntellect · 🇺🇸San Francisco—PythonPyTorchCUDA
- Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference CloudZyphra · 🇺🇸San Francisco—PythonDockerTerraform
- Senior Staff Inference Performance EngineerD Matrix · 🇺🇸Santa Clara$175K - $265KHybridLead and aboveRustPythonC++
- Staff Test & Release Engineer, Inference CloudD Matrix · 🇺🇸Santa Clara$155K - $235KHybridLead and aboveRustGoPython
- Technical Program Manager, InferenceAnthropic · 🇺🇸San Francisco, CA | New York City, NY | Seattle, WA$290K - $435KLLMCI/CDKubernetes
- Senior Cloud Support Engineer - Managed InferenceCrusoe · 🇺🇸Denver, CO - US · +1 more location$125K - $150KSeniorTerraformGCPAzure
- Research Scientist - Decentralized Training and Inference VerificationPluralis Research · 🇺🇸San Francisco—RemoteEnglishThreat modelingCryptography
- Research Scientist - Geo-Distributed InferencePluralis Research · 🇺🇸San Francisco—RemoteLLMEnglishReinforcement learning
- Strategic Finance Lead, OpenAI for InferenceOpenAI · 🇺🇸San Francisco$293K - $325KHybridLead and aboveContract negotiationFinancial modelingASIC
- Engineering Manager, Inference RouterCerebras · 🇺🇸Sunnyvale, CA—HybridC++.NETMachine Learning
- Staff Product Manager, AI InferenceCoreWeave · 🇺🇸Bellevue, WA / Sunnyvale, CA$207K - $275KLead and aboveLLMKubernetesAI
- Inference Optimization EngineerHedra · 🇺🇸San Francisco—PythonC++PyTorch
- Software Engineer, ML Serving PlatformDoorDash USA · 🇺🇸San Francisco, CA; Sunnyvale, CA; • Seattle, WA$131K - $192KGoPythonJava
- Forward Deployed Engineer - AI InferenceFriendliai · 🇺🇸San Francisco—HybridDockerTerraformGCP
- LLM Inference Systems EngineerHippocratic AI · 🇺🇸Menlo Park, CA—PythonC++LLM
- Engineering Manager, Inference PerformanceBaseten · 🇺🇸San Francisco$240K - $270KHybridMachine LearningLLMPyTorch
- Software Engineer, InferenceSierra · 🇺🇸San Francisco, CA$230K - $390KLLMMLOpsvLLM
- Software Engineer - Inference PlatformBaseten · 🇺🇸San Francisco$180K - $360KHybridMachine LearningLLMCI/CD
- Software Engineer - Inference PerformanceBaseten · 🇺🇸San Francisco$180K - $360KHybridGoPythonC++
- Manager II, Engineering, Serving InfrastructurePinterest · 🇺🇸Palo Alto, CA, US; San Francisco, CA, US$208K - $365KGoPythonJava
- Member of Technical Staff - Inference RuntimeModal · 🇺🇸San Francisco$220K - $300KRustGoLinux
- ML Research Scientist - Inference MLCerebras · 🇺🇸🇨🇦United States and Canada—PythonC++.NET
- LLM Inference Engineer (Mid, Sr, Staff)Hippocratic AI · 🇺🇸Menlo Park, CA—Lead and abovePythonC++LLM
- Staff + Sr. Software Engineer, Cloud InferenceAnthropic · 🇺🇸San Francisco, CA | Seattle, WA$320K - $485KLead and aboveRustPythonGCP
- Staff + Sr. Software Engineer, Cloud Inference Launch EngineeringAnthropic · 🇺🇸San Francisco, CA | Seattle, WA$320K - $485KLead and aboveRustPythonGCP
- Senior Product Marketing Manager- InferenceWEKA · 🇺🇸U.S. Remote—RemoteSeniorKubernetes
- Researcher, Efficient InferenceMakermaker.ai · 🇺🇸San Francisco—Machine LearningPyTorch
- Software Engineer, InferenceCoreWeave · 🇺🇸Sunnyvale, CA / Bellevue, WA$120K - $160KGoPythonLLM
- Senior Manager, Engineering - AI InferenceCrusoe · 🇺🇸San Francisco, CA - US$250K - $300KSeniorPythonC++Docker
- Staff Software Engineer, Inference APICerebras · 🇺🇸Sunnyvale, CA—HybridLead and aboveRustGoPython
- Staff Tech Lead, ML Data Infrastructure and Inference PlatformWaymo · 🇺🇸Mountain View, CA, USA$251K - $310KLead and aboveC++Machine LearningData quality
Showing the newest 50. See all 160 in search
Who is hiring for inference engineer roles in the United States
Where inference engineer roles in the United States are
- 🇺🇸United States160
- 🇺🇸California140
- 🇺🇸San Francisco Bay Area139
- 🇺🇸Seattle, WA24
- 🇺🇸New York, NY15
- 🇨🇦Canada2
- 🇺🇸Los Angeles, CA2
- 🇺🇸Boston, MA2
- 🇺🇸Dallas, TX1
- 🇺🇸Texas1
A role that lists several places is counted in each of them.
What inference engineer roles in the United States pay, by level
| Level in the title | Median advertised salary | Roles counted |
|---|---|---|
| No level in the title | $270K | 51 |
| Senior | $216K | 20 |
| Lead and above | $265K | 37 |
Medians of the midpoints of advertised yearly US-dollar ranges; a level needs at least 15 such roles. Advertised, not verified pay.
Questions about inference engineer jobs in the United States
- How many inference engineer jobs in the United States are open right now?
- There are 160 open inference engineer jobs in the United States at 70 companies on Jobs Every Hour as of Nov 15, 2026. 6 of them were posted in the last seven days. The list is rebuilt every hour from the employers' own careers pages.
- Which companies have the most inference engineer jobs in the United States?
- Right now the most openings are at Cerebras (17), CoreWeave (9), Together AI (8), Anthropic (8) and Baseten (7). The ranking changes as companies open and close roles.
- Are there remote inference engineer jobs in the United States?
- 13 of the 160 open inference engineer jobs in the United States (8%) are listed as remote. Remote roles are often limited to certain countries or time zones, so check the location line of each job.
- What do inference engineer jobs in the United States pay?
- The median advertised salary is $256K, based on 108 open roles that publish a yearly US-dollar range. The middle half of those roles advertise between $220K and $300K. These are advertised ranges, not verified pay. Most employers here are technology companies, so the figures run above the wider market for the same work.
- Is it hard to get one of the inference engineer jobs in the United States?
- 4 of the 160 open inference engineer jobs in the United States (2%) are for beginners: junior roles and internships. Of the 76 postings that state experience, the median asks for 5 years. 70 companies are hiring and 6 roles were posted in the last seven days. Matching your resume to the skills each posting names helps most; the free resume builder shows the match.
- How is AI changing inference engineer jobs in the United States?
- 136 of the 160 open inference engineer jobs in the United States (85%) ask for AI or machine-learning skills, most often LLM, Machine Learning, PyTorch. Employers still list 160 such roles today at 70 companies. Counted from the postings' own text on Nov 15, 2026.
- What skills do inference engineer jobs in the United States ask for?
- Most often LLM (67%), Python (58%), C++ (43%), Kubernetes (38%), CUDA (37%) of the 160 open postings, counted from their own text on Nov 15, 2026.
- Which job titles come up most in inference engineer jobs in the United States?
- Member of Technical Staff (20), Software Engineer (19), Senior Software Engineer (6), Staff Software Engineer (6), AI Inference Core (5): the most common titles among the 160 open roles, without the level and place notes in brackets.
- Are inference engineer jobs in the United States in demand in 2026?
- 160 inference engineer jobs in the United States are open on Jobs Every Hour today at 70 companies, 0.1% of all 148,162 open jobs here; 6 were posted in the last seven days. The median advertised salary is $256K. 13 (8%) can be done remotely.
- How do I apply for inference engineer jobs in the United States?
- Open a job and press “Apply on company site”. You go straight to the employer's own careers page and apply there. Jobs Every Hour needs no account and charges nothing for applying.














