ML infrastructure and MLOps jobs
ML infrastructure and MLOps: a person in this job builds the computers and pipelines AI models are trained and run on. Together AI, SpaceX, Cerebras, CoreWeave and Anthropic have the most open roles with “ML infrastructure and MLOps” or a close variant in the title right now.
382 open roles · 17 posted in the last 7 days · 13% remote · 119 companies hiring · $242K median advertised salary · checked Nov 14 against employer career pages
Skills asked for in ML infrastructure and MLOps roles
Bars show the share of these 382 roles; one role can count in several rows.
Newest ML infrastructure and MLOps jobs
- Senior Software Engineer II, InferenceCoreWeave · 🇺🇸Sunnyvale, CA / Bellevue, WA$182K - $242KSeniorGoPythonC++
- Senior Software Engineer – Backend Platforms and Agentic & ML SystemsSocure · 🇺🇸Hub - San Francisco$230K - $270KSeniorGoPythonTypeScript
- Policy Lead, AI InfrastructureStripe · 🇺🇸US-Remote—RemoteLeadAI
- AI Platform EngineerPolygon Labs · EMEA - Remote—RemotePythonTypeScriptLLM
- Senior Software Engineer, AI/ML PlatformAgility Robotics · 🇺🇸Hybrid- Any Office (Fremont, CA, Salem, OR, or Pittsburgh…$197K - $307KSeniorTerraformGCPAzure
- Staff Product Manager - AI PlatformPreply · 🇺🇦Kyiv · +2 more locations—LeadLLMAI
- Product Manager, Inference ExperienceBaseten · 🇺🇸San Francisco$200K - $400KMachine LearningLLMPyTorch
- Product Manager, Training PlatformBaseten · 🇺🇸San Francisco$200K - $400KMachine Learning
- Product Manager, Inference PlatformBaseten · 🇺🇸San Francisco$200K - $400KMachine LearningLLMPyTorch
- Strategic Account Executive Inference IndiaTogether AI · 🇮🇳India—
- Sr. Software Engineer, ML PlatformCursor · 🇺🇸Palo Alto, CA$180K - $330KSeniorMachine LearningOpenTelemetry
- Software Engineer, ML PlatformCursor · 🇺🇸Palo Alto, CA$140K - $225KMachine LearningOpenTelemetry
- Principal Solutions Specialist, InferenceCoreWeave · 🇺🇸Bellevue, WA / Dallas, TX / Livingston, NJ / Manhattan, N…$177K - $237KLeadMachine LearningLLMKubernetes
- Senior AI Research Engineer - GPU Systems & KernelsDatadog · 🇫🇷Paris, France—SeniorRustPythonC++
- Senior AI Research Engineer - LLM Training & Inference InfrastructureDatadog · 🇫🇷Paris, France—SeniorRustGoPython
- Senior Software Engineer, AI Platform - PrismSoFi · 🇺🇸CA - San Francisco; WA - Seattle—SeniorGoPythonJava
- Staff Technical Program Manager, InferenceCoreWeave · 🇺🇸Livingston, NJ / New York City, NY / Sunnyvale, CA / Bell…$177K - $237KLead
- Software Engineer, ML OpsCohere · 🇬🇧London—RemoteGoPythonLinux
- Software Engineer, GPU InfrastructureCohere · 🇺🇸Seattle$175K - $325KRemoteGoPythonLinux
- Sr. Software Engineer, Training/Inference (C++)xAI · 🇺🇸Palo Alto, CA$220K - $357KSeniorRustC++LLM
- Partnerships Lead, AI Infrastructure & Post-TrainingMercor · Mercor HQ, 181 Fremont Street$300K - $400KLeadAI
- Director, AI Infrastructure & Strategic PartnershipsSingleStore · 🇺🇸United States$120K - $175KLeadSQLKubernetesAI
- Manager, Technical Program Manager, AI PlatformNuro · 🇺🇸Mountain View, California (HQ)$176K - $265KAI
- Staff Machine Learning Engineer, AI InfrastructureWaymo · 🇺🇸Mountain View, CA, USA; San Francisco, CA, USA; New York…$251K - $310KLeadPythonC++Machine Learning
- Product Manager, Inference PlatformCohere · 🇨🇦Toronto$205K - $320KRemoteGCPAzureAWS
- Forward Deployed Engineer - AI/ML PlatformsAnyscale · 🇺🇸San Francisco$250K - $275KGoPythonJava
- Principal AI Infrastructure Engineer, Build PlatformRoblox · 🇺🇸San Mateo, CA, United States$345K - $399KLeadLLMAI
- Staff Software Engineer - GPU System Software, Onboard ExecutionZoox · 🇺🇸Foster City, CA$290,000 - $322,000 a weekLead
- Senior Machine Learning Infrastructure Engineer, MatchmakingRoblox · 🇺🇸San Mateo, CA, United States$243K - $295KSeniorMachine LearningKafkaRedis
- AML Ops AnalystNubank · 🇲🇽Ciudad de México—PythonSQLLooker
- Senior Software Engineer, AI PlatformVanta · 🇺🇸Remote U.S.$224K - $263KRemoteSeniorLLMAI
- Member of Technical Staff (Software Engineer, Training Infrastructure)Perplexity · 🇺🇸San Francisco$220K - $405KRustGoPython
- Software Engineering Manager, AI Platform EngineeringSoFi · 🇺🇸CA - San Francisco; WA - Seattle—LLMAIRAG
- Senior Software Engineer, Backend (AI Platform)Affirm · 🇨🇦Remote Canada · +1 more locationCA$153K - CA$213KRemoteSeniorPythonKotlinLLM
- AI Platform EngineerJustMarkets · Europe—RustGoPython
- Senior Software Engineer, AI Infrastructure Development PlatformSkydio · 🇺🇸San Mateo, California, United States$190K - $250KSeniorGoPythonTypeScript
- Forward Deployed Engineer, InferenceCohere · 🇺🇸United States$240K - $415KGoPythonC++
- Senior Software Engineer, Machine Learning PlatformAirwallex · 🇺🇸US - Seattle · +1 more location—SeniorPythonJavaC++
- Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)Perplexity · 🇺🇸San Francisco$250K - $485KRustGoC++
- Principal Software Engineer, GenAI PlatformRoblox · 🇺🇸San Mateo, CA, United States$329K - $362KLeadRustGoPython
- Sr. Engineering Manager, AI PlatformIllumio · 🇺🇸Sunnyvale, California - HQ$233K - $280KSeniorGoPythonJava
- Senior Software Engineer, ML API – AI InferenceCerebras · 🇨🇦Toronto, CAN—SeniorRustGoPython
- (Senior/Junior AI Inference Reliability Engineer, Compute InfraTogether AI · 🇺🇸San Francisco$160K - $280KSeniorMachine LearningKubernetesCUDA
- Sr. ML Ops Engineer, Forward-Deployed6sense · 🇺🇸San Francisco, California, United States$191K - $261KSeniorPythonSQLAirflow
- ML Infrastructure Engineer - New GradSambaNova · 🇺🇸Austin, Texas, United States; San Jose, California, Unite…$131K - $197KJuniorPythonMachine LearningLLM
- AI Infrastructure EngineerMercor · 🇺🇸San Francisco$200K - $400KPythonC++GCP
- ML Ops Engineer, AI PlatformMatch Group · 🇯🇵Tokyo—PythonDockerTerraform
- Product Cost Management Lead - AI InfrastructureOpenAI · 🇺🇸San Francisco$226K - $300KLead
- Senior Software Engineer - AI PlatformHinge Health · 🇺🇸San Francisco-HQ$188K - $257KSeniorPythonTypeScriptReact
- Staff Software Engineer, AI Platform & InfrastructureOkta · 🇺🇸San Francisco, California$194K - $267KLeadPythonReactSQL
- Sr. Software Engineer, AI Platform & InfrastructureOkta · 🇺🇸San Francisco, California$165K - $227KSeniorPythonReactSQL
- Senior Engineering Manager, AI PlatformSemgrep · 🇺🇸San Francisco Office$197K - $288KSeniorLLMAgileAI
- Principal Engineer, AI PlatformEpic Games · BLANK,BLANK,Multiple Locations · +1 more location$223K - $327KLeadKubernetesAIUnreal Engine
- Technical Program Manager II - AI PlatformsSmartsheet · 🇮🇳Bangalore, INDIA—LLMJiraAI
- Senior Machine Learning Engineer, Inference - USAInworld AI · 🇺🇸Mountain View, California, USA$250K - $300KSeniorRustPythonC++
- Senior Staff/Principal Software Engineer - GPU System Software, Onboard ExecutionZoox · 🇺🇸Foster City, CA$339K - $455KLeadC++LinuxCUDA
- Senior Backend Engineer, Inference CloudCerebras · 🇺🇸Sunnyvale, CA—Senior.NETPostgreSQLGraphQL
- Senior Machine Learning Platform EngineerKlaviyo · 🇺🇸Boston—SeniorGoPythonJava
- Staff Software Engineer, GPU InferenceCerebras · 🇨🇦Toronto, CAN—LeadPythonC++.NET
- Senior Software Engineer - ML InfrastructureLatitude AI · 🇺🇸Pittsburgh, PA, Palo Alto, CA, Detroit, MI$184K - $276KSeniorPythonSQLMachine Learning
- (Staff / Senior Staff) AI Inference Reliability Engineer, Compute InfraTogether AI · 🇺🇸San Francisco$250K - $320KLeadMachine LearningKubernetesCUDA
- Engineering Manager, AI PlatformHarvey · 🇺🇸San Francisco$272K - $355KLLMAI
- Senior / Staff AI Platform EngineerSuno · 🇺🇸San Francisco$228K - $363KLeadPythonLLMAI
- Staff Product Manager, Generative AI PlatformDeliveroo · 🇬🇧London, United Kingdom—LeadLLMAI
- Manager, Software Engineering - AI InfrastructureFigma · 🇺🇸San Francisco, CA • New York, NY • United States$258K - $376KLLMAI
- AI Inference Core - Senior SDET, Release Integration TestingCerebras · 🇺🇸Sunnyvale, CA—SeniorGoPython.NET
- Software Engineer, CI/CD & ML InfrastructureOpenAI · 🇺🇸San Francisco$318K - $485KRustGoPython
- Staff Software Engineer - AI Compute, Together CloudTogether AI · 🇳🇱Amsterdam · +1 more location—LeadGoTerraformGCP
- Product Finance Director, AI Products & GPU Investment StrategyDatabricks · 🇺🇸Mountain View, California; San Francisco, California; Sea…$201K - $308KLeadPythonSQLAI
- Senior Software Engineer – AI InfrastructureKraken · 🇺🇸United States · +1 more location$127K - $254KRemoteSeniorRustPythonLLM
- Senior/Staff Software Engineer (Back-End), InferenceCohere · 🇨🇦Canada$205K - $315KRemoteLeadRustGoPython
- Senior Machine Learning Systems Engineer, ML PlatformReddit · 🇺🇸Remote - United States$217K - $303KRemoteSeniorMachine LearningAI
- Technical Program Manager, InferenceAnthropic · 🇺🇸San Francisco, CA | New York City, NY | Seattle, WA$290K - $435KLLMCI/CDKubernetes
- Senior Cloud Support Engineer - Managed InferenceCrusoe · 🇺🇸Denver, CO - US · +1 more location$125K - $150KSeniorTerraformGCPAzure
- Product Manager, AI Infrastructure (Managed Services)Lightning AI · 🇺🇸New York, New York, United States; San Francisco, Califor…$160K - $275KPyTorch
- Software Engineer, AI/ML Infrastructure (US-Based)Thumbtack · 🇺🇸Remote, United States$145K - $188KRemoteGoPythonPostgreSQL
- (2027 Talent Pool) Software Engineer, AI/ML InfrastructureThumbtack · 🇨🇦Remote, OntarioCA$123K - CA$160KRemoteGoPythonPostgreSQL
- Strategic Finance Lead, OpenAI for InferenceOpenAI · 🇺🇸San Francisco$293K - $325KLead
- Senior ML Platform Engineer (Agentic Platform)Preply · 🇪🇸Barcelona · +2 more locations—SeniorPythonMachine LearningAWS
- Senior ML Platform Engineer (GenAI Platform)Preply · 🇬🇧London · +2 more locations—SeniorPythonMachine LearningCI/CD
- Senior Senior Technical Program Manager, Driverless Readiness & AI Platform ReliabilityNuro · 🇺🇸Mountain View, California (HQ)$160K - $241KSeniorPythonC++Jira
- Engineering Manager, Inference RouterCerebras · 🇺🇸Sunnyvale, CA—C++.NETMachine Learning
- Software Engineer, AI PlatformChai Discovery · 🇺🇸San Francisco office—
- Principal Machine Learning Platform Engineer, Foundation AIRoblox · 🇺🇸San Mateo, CA, United States$295K - $345KLeadMachine LearningCI/CDAI
- Staff Product Manager, AI InferenceCoreWeave · 🇺🇸Bellevue, WA / Sunnyvale, CA$207K - $275KLeadLLMKubernetesAI
- Staff Product Manager, AI Infrastructure (Fleet Management)Crusoe · 🇺🇸San Francisco, CA - US$215K - $260KLeadKubernetesAI
- Lead Technical Product Manager — Machine Learning PlatformN26 · 🇪🇸Barcelona · +1 more location—LeadMachine LearningKafkaCI/CD
- Research Scientist / Engineer – Training InfrastructureLuma AI · 🇬🇧London, UK · +2 more locations—PyTorchLinuxCUDA
- Senior Systems Engineer - Enterprise AI PlatformsLambda · 🇺🇸San Francisco Office (Fremont St)$206K - $275KSeniorGoGCPMachine Learning
- Engineering Manager, Inference PerformanceBaseten · 🇺🇸San Francisco$240K - $270KMachine LearningLLMPyTorch
- Sr. Staff Software Engineer, AI PlatformPinterest · 🇺🇸Palo Alto, CA, US; Remote, US$209K - $429KRemoteLeadPythonAI
- Senior Java Software Engineer - Search Inference - PlatformElastic · 🇵🇹Portugal · +4 more locations€56K - €88KSeniorJavaMachine LearningElasticsearch
- Senior Software Engineer, GenAI PlatformDeliveroo · 🇬🇧London, United Kingdom - Deliveroo—SeniorPythonGCPMachine Learning
- Software Engineer, InferenceSierra · 🇺🇸San Francisco, CA$230K - $390KLLM
- Software Engineer - Inference PlatformBaseten · 🇺🇸San Francisco$180K - $360KMachine LearningLLMCI/CD
- Software Engineer - Inference PerformanceBaseten · 🇺🇸San Francisco$180K - $360KGoPythonC++
- 2027 Summer Intern, MS/PhD, ML Systems & Behavior DiscoveryWaymo · 🇺🇸Mountain View, CA, USA—InternPythonC++Machine Learning
- Member of Technical Staff - Inference RuntimeModal · 🇺🇸San Francisco$220K - $300KRustGoLinux
- Lead Technical Program Manager, AI PlatformWayve · 🇬🇧London, United Kingdom—LeadPythonDockerAzure
- Senior Technical Program Manager, AI PlatformSentry · 🇺🇸San Francisco, California$150K - $240KSeniorLLMAI
Showing the newest 100 of 333. The search looks through all of them by title, place and pay.
Who is hiring for ML infrastructure and MLOps roles
Where ML infrastructure and MLOps roles are
- 🇺🇸United States292
- 🇺🇸California229
- 🇺🇸San Francisco Bay Area219
- 🇪🇺Europe55
- 🇺🇸Seattle41
- 🇺🇸New York34
- 🇬🇧London & the UK26
- 🌏Asia-Pacific21
- 🇮🇳India14
- 🇨🇦Canada13
A role that lists several places is counted in each of them.
What ML infrastructure and MLOps roles pay, by level
| Level in the title | Median advertised salary | Roles counted |
|---|---|---|
| No level in the title | $248K | 99 |
| Senior | $218K | 71 |
| Lead | $280K | 80 |
Medians of the midpoints of advertised yearly US-dollar ranges; a level needs at least 15 such roles. Advertised, not verified pay.
Questions about ML infrastructure and MLOps jobs
- What is an ML infrastructure and MLOps job?
- In an ML infrastructure and MLOps job, a person builds the computers and pipelines AI models are trained and run on. 382 such roles are open on Hiring Right Now as of Nov 14, 2026.
- How many ML infrastructure and MLOps jobs are open right now?
- There are 382 open ML infrastructure and MLOps jobs at 119 companies on Hiring Right Now as of Nov 14, 2026. 17 of them were posted in the last seven days. The list is rebuilt every hour from the employers' own careers pages.
- Which companies have the most ML infrastructure and MLOps jobs?
- Right now the most openings are at Together AI (29), SpaceX (24), Cerebras (21), CoreWeave (15) and Nuro (14). The ranking changes as companies open and close roles.
- Are there remote ML infrastructure and MLOps jobs?
- 50 of the 382 open ML infrastructure and MLOps jobs (13%) are listed as remote. Remote roles are often limited to certain countries or time zones, so check the location line of each job.
- What do ML infrastructure and MLOps jobs pay?
- The median advertised salary is $242K, based on 253 open roles that publish a yearly US-dollar range. The middle half of those roles advertise between $212K and $285K. These are advertised ranges, not verified pay.
- How do I apply for ML infrastructure and MLOps jobs?
- Open a job and press “Apply on company site”. You go straight to the employer's own careers page and apply there. Hiring Right Now needs no account and charges nothing for applying.
Kinds of work close to this one
Roles where employers ask for the same skills. The bar shows how much the skill lists overlap; the text names the shared skills and, where 30 postings state pay, the median advertised pay there.


























































