Inference engineer jobs
Inference engineer: a person in this job makes trained AI models answer fast and cheaply for millions of users. Cerebras, Together AI, Nebius, Anthropic and CoreWeave have the most open roles with “Inference engineer” or a close variant in the title right now.
230 open roles · 9 posted in the last 7 days · 13% remote · 93 companies hiring · $258K median advertised salary · checked Nov 15 against employer career pages
| Period | Count |
|---|---|
| under $75K | 0 |
| $75K to $100K | 0 |
| $100K to $125K | 0 |
| $125K to $150K | 2 |
| $150K to $175K | 5 |
| $175K to $200K | 8 |
| $200K to $250K | 33 |
| $250K to $300K | 33 |
| $300K and more | 30 |
Skills asked for in inference engineer roles
Bars show the share of these 230 roles; one role can count in several rows.
Newest inference engineer jobs
- Senior Software Engineer II, InferenceCoreWeave · 🇺🇸Sunnyvale, CA / Bellevue, WA$182K - $242KSeniorGoPythonC++
- Senior Software Engineer, ML Serving PlatformDoorDash USA · 🇺🇸San Francisco, CA; Sunnyvale, CA; Seattle, WA$168K - $247KSeniorGoPythonJava
- Product Manager, Inference ExperienceBaseten · 🇺🇸San Francisco$200K - $400KHybridMachine LearningLLMPyTorch
- Product Manager, Inference PlatformBaseten · 🇺🇸San Francisco$200K - $400KHybridMachine LearningLLMPyTorch
- Inference EngineerAdaption · 🇺🇸San Francisco—HybridRustPythonC++
- Inference Engineer - Member of Technical StaffDesignworkstalent · Bellevue—HybridMachine LearningLLMKubernetes
- Strategic Account Executive Inference IndiaTogether AI · 🇮🇳India—Reinforcement learningProspecting
- Principal Solutions Specialist, InferenceCoreWeave · 🇺🇸Bellevue, WA / Dallas, TX / Livingston, NJ / Manhattan, N…$177K - $237KLead and aboveMachine LearningLLMKubernetes
- Senior AI Research Engineer - LLM Training & Inference InfrastructureDatadog · 🇫🇷Paris, France—SeniorRustGoPython
- Staff Technical Program Manager, InferenceCoreWeave · 🇺🇸Livingston, NJ / New York City, NY / Sunnyvale, CA / Bell…$177K - $237KLead and aboveObservabilityServerlessCustomer onboarding
- Sr. Software Engineer, Training/Inference (C++)xAI · 🇺🇸Palo Alto, CA$220K - $357KSeniorRustC++LLM
- Product Manager, Inference PlatformCohere · 🇨🇦Toronto$205K - $320KRemoteGCPAzureAWS
- Partner Manager, InferenceMistral.ai · 🇺🇸Palo Alto—
- [AI Frontier Div.] AI Inference Platform & Operations Lead (10년 이상)KRAFTON · 🇰🇷Seoul; Seoul, South Korea—Lead and abovePythonLLMKubernetes
- Senior Inference Optimization ML EngineerRhoda Ai · 🇺🇸Mountain View—SeniorLLMPyTorchAWS
- Forward Deployed Engineer, InferenceCohere · 🇺🇸United States$240K - $415KGoPythonC++
- Senior Software Engineer, ML API – AI InferenceCerebras · 🇨🇦Toronto, CAN—HybridSeniorRustGoPython
- (Senior/Junior AI Inference Reliability Engineer, Compute InfraTogether AI · 🇺🇸San Francisco$160K - $280KSeniorMachine LearningKubernetesCUDA
- Associate Director/Director, Inference EngineeringLila Sciences · 🇺🇸Cambridge, MA USA; San Francisco, CA USA$204K - $348KLead and aboveLLM
- Senior Machine Learning Engineer, Inference - USAInworld AI · 🇺🇸Mountain View, California, USA$250K - $300KSeniorRustPythonC++
- Senior Backend Engineer, Inference CloudCerebras · 🇺🇸Sunnyvale, CA—HybridSenior.NETPostgreSQLGraphQL
- Technical Product Manager - InferenceFundamental · EU, Remote—RemoteIAM
- Staff Software Engineer, GPU InferenceCerebras · 🇨🇦Toronto, CAN—HybridLead and abovePythonC++.NET
- Staff Machine Learning Engineer, LLM Inference OptimizationNebius · 🇳🇱🇩🇪🇬🇧Amsterdam, Netherlands; Berlin, Germany; London, United K…—Lead and abovePythonMachine LearningLLM
- [AI Frontier Div.] AI Inference Platform & Operations Engineer (5년 이상)KRAFTON · 🇰🇷Seoul; Seoul, South Korea—LLMCI/CDKubernetes
- Software Engineer Intern, InferenceRhoda Ai · 🇺🇸Mountain View—InternPythonC++PyTorch
- (Staff / Senior Staff) AI Inference Reliability Engineer, Compute InfraTogether AI · 🇺🇸San Francisco$250K - $320KLead and aboveMachine LearningKubernetesCUDA
- AI Inference Core - Senior SDET, Release Integration TestingCerebras · 🇺🇸Sunnyvale, CA—HybridSeniorGoPython.NET
- Staff Applied Scientist, Experimentation and Causal InferenceDoorDash USA · 🇺🇸California, CA; San Francisco, CA; Seattle, WA; New York,NY$194K - $285KLead and aboveSQLMachine Learning
- Senior IA Inference Engineer (x/f/m)Doctolib · 🇫🇷Paris—HybridSeniorRustGoPython
- Research Engineer - InferencePrimeIntellect · 🇺🇸San Francisco—PythonPyTorchCUDA
- Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference CloudZyphra · 🇺🇸San Francisco—PythonDockerTerraform
- Senior Staff Inference Performance EngineerD Matrix · 🇺🇸Santa Clara$175K - $265KHybridLead and aboveRustPythonC++
- Staff Test & Release Engineer, Inference CloudD Matrix · 🇺🇸Santa Clara$155K - $235KHybridLead and aboveRustGoPython
- Senior/Staff Software Engineer (Back-End), InferenceCohere · 🇨🇦Canada$205K - $315KRemoteLead and aboveRustGoPython
- Technical Program Manager, InferenceAnthropic · 🇺🇸San Francisco, CA | New York City, NY | Seattle, WA$290K - $435KLLMCI/CDKubernetes
- Senior Cloud Support Engineer - Managed InferenceCrusoe · 🇺🇸Denver, CO - US · +1 more location$125K - $150KSeniorTerraformGCPAzure
- Research Scientist - Decentralized Training and Inference VerificationPluralis Research · 🇺🇸San Francisco—RemoteEnglishThreat modelingCryptography
- Research Scientist - Geo-Distributed InferencePluralis Research · 🇺🇸San Francisco—RemoteLLMEnglishReinforcement learning
- VP Product, Cloud & InferenceMistral.ai · 🇫🇷Paris—HybridLead and aboveKubernetes
- Strategic Finance Lead, OpenAI for InferenceOpenAI · 🇺🇸San Francisco$293K - $325KHybridLead and aboveContract negotiationFinancial modelingASIC
- Engineering Manager, Inference RouterCerebras · 🇺🇸Sunnyvale, CA—HybridC++.NETMachine Learning
- Staff Product Manager, AI InferenceCoreWeave · 🇺🇸Bellevue, WA / Sunnyvale, CA$207K - $275KLead and aboveLLMKubernetesAI
- Senior Applied Scientist, Efficient LLM Inference & Model OptimizationNebius · 🇩🇪Berlin, Germany · +4 more locations—SeniorPythonMachine LearningLLM
- Forward Deployed Engineer AI InferenceLyceum · 🇩🇪Berlin—LLMAI
- Inference Optimization EngineerHedra · 🇺🇸San Francisco—PythonC++PyTorch
- Software Engineer, ML Serving PlatformDoorDash USA · 🇺🇸San Francisco, CA; Sunnyvale, CA; • Seattle, WA$131K - $192KGoPythonJava
- Staff Software Engineer, Console GPU InferencePlayStation Global · 🇬🇧United Kingdom, London—Lead and aboveC++Machine Learning
- Forward Deployed Engineer – AI Inference (Intern)Lyceum · 🇩🇪Berlin—InternLLMAI
- Forward Deployed Engineer - AI InferenceFriendliai · 🇺🇸San Francisco—HybridDockerTerraformGCP
- LLM Inference Systems EngineerHippocratic AI · 🇺🇸Menlo Park, CA—PythonC++LLM
- Engineering Manager, Inference PerformanceBaseten · 🇺🇸San Francisco$240K - $270KHybridMachine LearningLLMPyTorch
- Senior Java Software Engineer - Search Inference - PlatformElastic · 🇵🇹Portugal · +4 more locations€56K - €88KSeniorJavaMachine LearningElasticsearch
- Research Engineer, Inference FoundationMistral.ai · 🇩🇪Munich—HybridRustPythonC++
- Software Engineer, InferenceSierra · 🇺🇸San Francisco, CA$230K - $390KLLMMLOpsvLLM
- Software Engineer - Inference PlatformBaseten · 🇺🇸San Francisco$180K - $360KHybridMachine LearningLLMCI/CD
- Software Engineer - Inference PerformanceBaseten · 🇺🇸San Francisco$180K - $360KHybridGoPythonC++
- Manager II, Engineering, Serving InfrastructurePinterest · 🇺🇸Palo Alto, CA, US; San Francisco, CA, US$208K - $365KGoPythonJava
- Member of Technical Staff - Inference RuntimeModal · 🇺🇸San Francisco$220K - $300KRustGoLinux
- ML Research Scientist - Inference MLCerebras · 🇺🇸🇨🇦United States and Canada—PythonC++.NET
- Senior ML Performance Engineer, Inference OptimisationWayve · 🇬🇧London, United Kingdom—HybridSeniorPythonC++CUDA
- LLM Inference Engineer (Mid, Sr, Staff)Hippocratic AI · 🇺🇸Menlo Park, CA—Lead and abovePythonC++LLM
- Lead Product Manager, InferenceMistral.ai · 🇫🇷Paris—HybridLead and above
- Staff + Sr. Software Engineer, Cloud InferenceAnthropic · 🇺🇸San Francisco, CA | Seattle, WA$320K - $485KLead and aboveRustPythonGCP
- Staff + Sr. Software Engineer, Cloud Inference Launch EngineeringAnthropic · 🇺🇸San Francisco, CA | Seattle, WA$320K - $485KLead and aboveRustPythonGCP
- Senior Product Marketing Manager- InferenceWEKA · 🇺🇸U.S. Remote—RemoteSeniorKubernetes
- Researcher, Efficient InferenceMakermaker.ai · 🇺🇸San Francisco—Machine LearningPyTorch
- Senior Inference Reliability EngineerParasail · San Mateo—SeniorRustGoPython
- Software Engineer, InferenceCoreWeave · 🇺🇸Sunnyvale, CA / Bellevue, WA$120K - $160KGoPythonLLM
- Senior Machine Learning Engineer, LLM Inference OptimizationNebius · 🇨🇭Zurich, Switzerland · +3 more locations—SeniorPythonMachine LearningLLM
- Senior Manager, Engineering - AI InferenceCrusoe · 🇺🇸San Francisco, CA - US$250K - $300KSeniorPythonC++Docker
- Staff Software Engineer, Inference APICerebras · 🇺🇸Sunnyvale, CA—HybridLead and aboveRustGoPython
- Staff Tech Lead, ML Data Infrastructure and Inference PlatformWaymo · 🇺🇸Mountain View, CA, USA$251K - $310KLead and aboveC++Machine LearningData quality
- Member of Technical Staff | Inference PlatformAvra · 🇧🇷São Paulo—RemotePythonGCPKubernetes
- Senior Staff Applied AI Inference EngineerCrusoe · 🇺🇸San Francisco, CA - US$250K - $300KLead and aboveGoPythonC++
- Senior/Staff System Research Engineer – LLM Inference OptimizationSnowflake · 🇺🇸US-WA-Bellevue$236K - $330KHybridLead and aboveMachine LearningLLMTensorFlow
- Member of Technical Staff, Local Inference & KernelsSonder · 🇺🇸New York City$250K - $300KC++CUDAmacOS
- Research Intern, Inference (Summer 2027)Together AI · 🇺🇸San Francisco—InternPythonMachine LearningPyTorch
- Inference Engineering and Product LeadModal · 🇺🇸San Francisco$300K - $350KLead and aboveLLMLinuxFine-tuning
- Inference Engineering, Co-opInferact · 🇺🇸San Francisco—InternRustGoPython
- AI Inference Core - Senior Infrastructure Software EngineerCerebras · 🇺🇸Sunnyvale, CA—HybridSeniorPython.NETKubernetes
- (MSc/PhD) AI Research Intern - LLMs, Causal Inference & Decision MakingProsus · 🇳🇱Amsterdam—InternPythonMachine LearningLLM
- Senior/Staff Data Scientist - Measurement, Experimentation & Causal InferencePlayStation Global · 🇬🇧United Kingdom, London—Lead and abovePythonSQLMachine Learning
- Strategic Account Executive Inference EMEATogether AI · 🇬🇧London—Reinforcement learningProspecting
- Software Engineer, Inference SystemsRiver AI Inc. · 🇺🇸Palo Alto, CA$200K - $420KRustPythonC++
- Software Engineer, AI Infrastructure - LVM Inference & EvaluationAmbient.ai · 🇺🇸Redwood City$168K - $205KHybridPythonMachine LearningLLM
- 2027 Internship Onboard Infrastructure Engineer, ML InferenceBedrock Robotics · 🇺🇸San Francisco, CA—InternRustC++LLM
- Staff GPU Inference SDETCerebras · 🇺🇸Sunnyvale, CA—HybridLead and abovePythonC++.NET
- Staff+ Software Engineer, ML Inference PathAnthropic · 🇺🇸San Francisco, CA$320K - $485KLead and abovePythonMachine LearningLLM
- Member of Technical Staff - InferenceHyperbolic · 🇺🇸San Francisco, CA—Kubernetes
- Staff Applied AI Inference EngineerCrusoe · 🇺🇸San Francisco, CA - US$215K - $260KLead and aboveGoPythonC++
- Member of Technical Staff, InferenceInferact · Remote · +2 more locations—RemotePythonLLMPyTorch
- AI Inference Core - Senior Senior Software Engineer for DevOpsCerebras · 🇺🇸Sunnyvale, CA—HybridSeniorPython.NETTerraform
- AI Inference Core - Technical Lead Manager, Release Qual & IntegrationCerebras · 🇺🇸Sunnyvale, CA—HybridLead and aboveGoPython.NET
- Member of Technical Staff (TPM, Inference)Perplexity · 🇺🇸San Francisco$170K - $265KLLMAgile
- Engineering Manager, Inference InfrastructureAnthropic · 🇺🇸San Francisco, CA | New York City, NY | Seattle, WA$405K - $625KMachine LearningLLMKubernetes
- Research Engineer - Decentralized Training and Inference VerificationPluralis Research · 🇺🇸San Francisco—RemoteEnglishThreat modelingCryptography
- Research Engineer - Geo-Distributed InferencePluralis Research · 🇺🇸San Francisco—RemoteLLMEnglishReinforcement learning
- Senior Software Engineer (AI Inference & Runtime Platform)Careers.azx.io · 🇺🇸Seattle$140K - $230KRemoteSeniorRustGoPython
- ML Engineer, Inference OptimizationBuild Ai · 🇺🇸San Francisco$200K - $320KRustPythonC++
Showing the newest 100 of 212. The search looks through all of them by title, place and pay.
Who is hiring for inference engineer roles
Where inference engineer roles are
- 🇺🇸United States160
- 🇺🇸San Francisco Bay Area140
- 🇺🇸California140
- 🇪🇺Europe48
- 🇺🇸Seattle, WA25
- 🇬🇧United Kingdom21
- 🇬🇧London17
- 🇺🇸New York, NY15
- 🌏Asia-Pacific11
- 🇩🇪Germany10
A role that lists several places is counted in each of them.
What inference engineer roles pay, by level
| Level in the title | Median advertised salary | Roles counted |
|---|---|---|
| No level in the title | $270K | 52 |
| Senior | $216K | 20 |
| Lead and above | $262K | 39 |
Medians of the midpoints of advertised yearly US-dollar ranges; a level needs at least 15 such roles. Advertised, not verified pay.
Kinds of work close to this one
Roles where employers ask for the same skills. The bar shows how much the skill lists overlap; the text names the shared skills and, where 30 postings state pay, the median advertised pay there.
Companies hiring inference engineers
Inference engineer salaryQuestions about inference engineer jobs
- What is an inference engineer job?
- In an inference engineer job, a person makes trained AI models answer fast and cheaply for millions of users. 230 such roles are open on Jobs Every Hour as of Nov 15, 2026.
- How many inference engineer jobs are open right now?
- There are 230 open inference engineer jobs at 93 companies on Jobs Every Hour as of Nov 15, 2026. 9 of them were posted in the last seven days. The list is rebuilt every hour from the employers' own careers pages.
- Which companies have the most inference engineer jobs?
- Right now the most openings are at Cerebras (19), Together AI (15), Nebius (14), CoreWeave (9) and Anthropic (9). The ranking changes as companies open and close roles.
- Are there remote inference engineer jobs?
- 30 of the 230 open inference engineer jobs (13%) are listed as remote. Remote roles are often limited to certain countries or time zones, so check the location line of each job.
- What do inference engineer jobs pay?
- The median advertised salary is $258K, based on 111 open roles that publish a yearly US-dollar range. The middle half of those roles advertise between $220K and $300K. These are advertised ranges, not verified pay. Most employers here are technology companies, so the figures run above the wider market for the same work.
- Is it hard to get an inference engineer job?
- 6 of the 230 open inference engineer jobs (3%) are for beginners: junior roles and internships. Of the 98 postings that state experience, the median asks for 5 years. 93 companies are hiring and 9 roles were posted in the last seven days. Matching your resume to the skills each posting names helps most; the free resume builder shows the match.
- How is AI changing inference engineer jobs?
- 189 of the 230 open inference engineer jobs (82%) ask for AI or machine-learning skills, most often LLM, Machine Learning, PyTorch. Employers still list 230 such roles today at 93 companies. Counted from the postings' own text on Nov 15, 2026.
- What skills do inference engineer jobs ask for?
- Most often LLM (65%), Python (61%), C++ (39%), Kubernetes (39%), CUDA (39%) of the 230 open postings, counted from their own text on Nov 15, 2026.
- Which job titles come up most in inference engineer jobs?
- Member of Technical Staff (27), Software Engineer (20), Staff Software Engineer (10), Research Engineer (8), Senior Software Engineer (7): the most common titles among the 230 open roles, without the level and place notes in brackets.
- Are inference engineer jobs in demand in 2026?
- 230 inference engineer jobs are open on Jobs Every Hour today at 93 companies, 0.2% of all 148,162 open jobs here; 9 were posted in the last seven days. The median advertised salary is $258K. 30 (13%) can be done remotely.
- How do I apply for inference engineer jobs?
- Open a job and press “Apply on company site”. You go straight to the employer's own careers page and apply there. Jobs Every Hour needs no account and charges nothing for applying.
Narrow down Inference engineer jobs
By place
- Inference engineer jobs in California 140
- Inference engineer jobs in Europe 48
- Inference engineer jobs in Seattle, WA 25
- Inference engineer jobs in the United States
- Inference engineer jobs in San Francisco Bay Area



















