Inference engineer jobs in California
140 open roles for inference engineers in California as of Nov 15, 2026. Cerebras, CoreWeave, Anthropic, Together AI and Baseten have the most. 5 are remote and the median advertised salary is $260K.
My jobs then shows how many are new each time you come back. No account, no email.
Skills asked for in inference engineer roles in California
Bars show the share of these 140 roles; one role can count in several rows.
- Senior Software Engineer II, InferenceCoreWeave · 🇺🇸Sunnyvale, CA / Bellevue, WA$182K - $242KSeniorGoPythonC++
- Senior Software Engineer, ML Serving PlatformDoorDash USA · 🇺🇸San Francisco, CA; Sunnyvale, CA; Seattle, WA$168K - $247KSeniorGoPythonJava
- Product Manager, Inference ExperienceBaseten · 🇺🇸San Francisco$200K - $400KHybridMachine LearningLLMPyTorch
- Product Manager, Inference PlatformBaseten · 🇺🇸San Francisco$200K - $400KHybridMachine LearningLLMPyTorch
- Inference EngineerAdaption · 🇺🇸San Francisco—HybridRustPythonC++
- Principal Solutions Specialist, InferenceCoreWeave · 🇺🇸Bellevue, WA / Dallas, TX / Livingston, NJ / Manhattan, N…$177K - $237KLead and aboveMachine LearningLLMKubernetes
- Staff Technical Program Manager, InferenceCoreWeave · 🇺🇸Livingston, NJ / New York City, NY / Sunnyvale, CA / Bell…$177K - $237KLead and aboveObservabilityServerlessCustomer onboarding
- Sr. Software Engineer, Training/Inference (C++)xAI · 🇺🇸Palo Alto, CA$220K - $357KSeniorRustC++LLM
- Partner Manager, InferenceMistral.ai · 🇺🇸Palo Alto—
- Senior Inference Optimization ML EngineerRhoda Ai · 🇺🇸Mountain View—SeniorLLMPyTorchAWS
- (Senior/Junior AI Inference Reliability Engineer, Compute InfraTogether AI · 🇺🇸San Francisco$160K - $280KSeniorMachine LearningKubernetesCUDA
- Associate Director/Director, Inference EngineeringLila Sciences · 🇺🇸Cambridge, MA USA; San Francisco, CA USA$204K - $348KLead and aboveLLM
- Senior Machine Learning Engineer, Inference - USAInworld AI · 🇺🇸Mountain View, California, USA$250K - $300KSeniorRustPythonC++
- Senior Backend Engineer, Inference CloudCerebras · 🇺🇸Sunnyvale, CA—HybridSenior.NETPostgreSQLGraphQL
- Software Engineer Intern, InferenceRhoda Ai · 🇺🇸Mountain View—InternPythonC++PyTorch
- (Staff / Senior Staff) AI Inference Reliability Engineer, Compute InfraTogether AI · 🇺🇸San Francisco$250K - $320KLead and aboveMachine LearningKubernetesCUDA
- AI Inference Core - Senior SDET, Release Integration TestingCerebras · 🇺🇸Sunnyvale, CA—HybridSeniorGoPython.NET
- Staff Applied Scientist, Experimentation and Causal InferenceDoorDash USA · 🇺🇸California, CA; San Francisco, CA; Seattle, WA; New York,NY$194K - $285KLead and aboveSQLMachine Learning
- Research Engineer - InferencePrimeIntellect · 🇺🇸San Francisco—PythonPyTorchCUDA
- Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference CloudZyphra · 🇺🇸San Francisco—PythonDockerTerraform
- Senior Staff Inference Performance EngineerD Matrix · 🇺🇸Santa Clara$175K - $265KHybridLead and aboveRustPythonC++
- Staff Test & Release Engineer, Inference CloudD Matrix · 🇺🇸Santa Clara$155K - $235KHybridLead and aboveRustGoPython
- Technical Program Manager, InferenceAnthropic · 🇺🇸San Francisco, CA | New York City, NY | Seattle, WA$290K - $435KLLMCI/CDKubernetes
- Research Scientist - Decentralized Training and Inference VerificationPluralis Research · 🇺🇸San Francisco—RemoteEnglishThreat modelingCryptography
- Research Scientist - Geo-Distributed InferencePluralis Research · 🇺🇸San Francisco—RemoteLLMEnglishReinforcement learning
- Strategic Finance Lead, OpenAI for InferenceOpenAI · 🇺🇸San Francisco$293K - $325KHybridLead and aboveContract negotiationFinancial modelingASIC
- Engineering Manager, Inference RouterCerebras · 🇺🇸Sunnyvale, CA—HybridC++.NETMachine Learning
- Staff Product Manager, AI InferenceCoreWeave · 🇺🇸Bellevue, WA / Sunnyvale, CA$207K - $275KLead and aboveLLMKubernetesAI
- Inference Optimization EngineerHedra · 🇺🇸San Francisco—PythonC++PyTorch
- Software Engineer, ML Serving PlatformDoorDash USA · 🇺🇸San Francisco, CA; Sunnyvale, CA; • Seattle, WA$131K - $192KGoPythonJava
- Forward Deployed Engineer - AI InferenceFriendliai · 🇺🇸San Francisco—HybridDockerTerraformGCP
- LLM Inference Systems EngineerHippocratic AI · 🇺🇸Menlo Park, CA—PythonC++LLM
- Engineering Manager, Inference PerformanceBaseten · 🇺🇸San Francisco$240K - $270KHybridMachine LearningLLMPyTorch
- Software Engineer, InferenceSierra · 🇺🇸San Francisco, CA$230K - $390KLLMMLOpsvLLM
- Software Engineer - Inference PlatformBaseten · 🇺🇸San Francisco$180K - $360KHybridMachine LearningLLMCI/CD
- Software Engineer - Inference PerformanceBaseten · 🇺🇸San Francisco$180K - $360KHybridGoPythonC++
- Manager II, Engineering, Serving InfrastructurePinterest · 🇺🇸Palo Alto, CA, US; San Francisco, CA, US$208K - $365KGoPythonJava
- Member of Technical Staff - Inference RuntimeModal · 🇺🇸San Francisco$220K - $300KRustGoLinux
- LLM Inference Engineer (Mid, Sr, Staff)Hippocratic AI · 🇺🇸Menlo Park, CA—Lead and abovePythonC++LLM
- Staff + Sr. Software Engineer, Cloud InferenceAnthropic · 🇺🇸San Francisco, CA | Seattle, WA$320K - $485KLead and aboveRustPythonGCP
- Staff + Sr. Software Engineer, Cloud Inference Launch EngineeringAnthropic · 🇺🇸San Francisco, CA | Seattle, WA$320K - $485KLead and aboveRustPythonGCP
- Researcher, Efficient InferenceMakermaker.ai · 🇺🇸San Francisco—Machine LearningPyTorch
- Software Engineer, InferenceCoreWeave · 🇺🇸Sunnyvale, CA / Bellevue, WA$120K - $160KGoPythonLLM
- Senior Manager, Engineering - AI InferenceCrusoe · 🇺🇸San Francisco, CA - US$250K - $300KSeniorPythonC++Docker
- Staff Software Engineer, Inference APICerebras · 🇺🇸Sunnyvale, CA—HybridLead and aboveRustGoPython
- Staff Tech Lead, ML Data Infrastructure and Inference PlatformWaymo · 🇺🇸Mountain View, CA, USA$251K - $310KLead and aboveC++Machine LearningData quality
- Senior Staff Applied AI Inference EngineerCrusoe · 🇺🇸San Francisco, CA - US$250K - $300KLead and aboveGoPythonC++
- Research Intern, Inference (Summer 2027)Together AI · 🇺🇸San Francisco—InternPythonMachine LearningPyTorch
- Inference Engineering and Product LeadModal · 🇺🇸San Francisco$300K - $350KLead and aboveLLMLinuxFine-tuning
- Inference Engineering, Co-opInferact · 🇺🇸San Francisco—InternRustGoPython
Showing the newest 50. See all 140 in search
Who is hiring for inference engineer roles in California
Where inference engineer roles in California are
- 🇺🇸United States140
- 🇺🇸California140
- 🇺🇸San Francisco Bay Area137
- 🇺🇸Seattle, WA22
- 🇺🇸New York, NY10
- 🇺🇸Los Angeles, CA2
- 🇺🇸Dallas, TX1
- 🇺🇸Texas1
- 🇺🇸Boston, MA1
A role that lists several places is counted in each of them.
What inference engineer roles in California pay, by level
| Level in the title | Median advertised salary | Roles counted |
|---|---|---|
| No level in the title | $280K | 45 |
| Senior | $220K | 16 |
| Lead and above | $261K | 36 |
Medians of the midpoints of advertised yearly US-dollar ranges; a level needs at least 15 such roles. Advertised, not verified pay.
Questions about inference engineer jobs in California
- How many inference engineer jobs in California are open right now?
- There are 140 open inference engineer jobs in California at 58 companies on Jobs Every Hour as of Nov 15, 2026. 6 of them were posted in the last seven days. The list is rebuilt every hour from the employers' own careers pages.
- Which companies have the most inference engineer jobs in California?
- Right now the most openings are at Cerebras (16), CoreWeave (9), Together AI (8), Anthropic (8) and Baseten (7). The ranking changes as companies open and close roles.
- Are there remote inference engineer jobs in California?
- 5 of the 140 open inference engineer jobs in California (4%) are listed as remote. Remote roles are often limited to certain countries or time zones, so check the location line of each job.
- What do inference engineer jobs in California pay?
- The median advertised salary is $260K, based on 97 open roles that publish a yearly US-dollar range. The middle half of those roles advertise between $220K and $300K. These are advertised ranges, not verified pay. Most employers here are technology companies, so the figures run above the wider market for the same work.
- Is it hard to get one of the inference engineer jobs in California?
- 4 of the 140 open inference engineer jobs in California (3%) are for beginners: junior roles and internships. Of the 67 postings that state experience, the median asks for 5 years. 58 companies are hiring and 6 roles were posted in the last seven days. Matching your resume to the skills each posting names helps most; the free resume builder shows the match.
- How is AI changing inference engineer jobs in California?
- 124 of the 140 open inference engineer jobs in California (89%) ask for AI or machine-learning skills, most often LLM, Machine Learning, PyTorch. Employers still list 140 such roles today at 58 companies. Counted from the postings' own text on Nov 15, 2026.
- What skills do inference engineer jobs in California ask for?
- Most often LLM (69%), Python (59%), C++ (44%), Kubernetes (39%), CUDA (37%) of the 140 open postings, counted from their own text on Nov 15, 2026.
- Which job titles come up most in inference engineer jobs in California?
- Software Engineer (18), Member of Technical Staff (17), Staff Software Engineer (6), Senior Software Engineer (5), AI Inference Core (5): the most common titles among the 140 open roles, without the level and place notes in brackets.
- Are inference engineer jobs in California in demand in 2026?
- 140 inference engineer jobs in California are open on Jobs Every Hour today at 58 companies, 0.1% of all 148,162 open jobs here; 6 were posted in the last seven days. The median advertised salary is $260K. 5 (4%) can be done remotely.
- How do I apply for inference engineer jobs in California?
- Open a job and press “Apply on company site”. You go straight to the employer's own careers page and apply there. Jobs Every Hour needs no account and charges nothing for applying.
More like Inference engineer jobs in California
- Inference engineer jobs 230
- Jobs in California 28,322













