Home / Engineering / Principal Systems Software Engineer - AI Inference & Hardware/Software Co-Design

Principal Systems Software Engineer - AI Inference & Hardware/Software Co-Design

Micron Technology · Richardson, TX

Principal Systems Software Engineer - AI Inference & Hardware/Software Co-Design is open at Micron Technology in Richardson, TX. The posting gives no salary; similar roles in the United States advertise a median of $222K. Posted on Nov 17, 2026, and still on Micron Technology’s careers page when we last checked, on Nov 18, 2026.

About the role

Our vision is to transform how the world uses information to enrich life for all.

Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.

Micron’s Storage and Memory Systems Pathfinding team explores how emerging AI workloads are reshaping the future of memory, storage, and heterogeneous computing. We work across software and hardware boundaries to identify new system opportunities and turn forward-looking concepts into measurable, practical innovations.

In this role, you will help shape next-generation AI infrastructure by architecting and optimizing inference software stacks and collaborating closely with hardware teams on hardware/software co-design. You will lead technical initiatives, build proof-of-concept solutions, evaluate emerging technologies, and influence platform capabilities before hardware is available.

Responsibilities:

  • Architect and optimize AI inference software stacks to enable proof-of-concept hardware capabilities and quantify the value of proposed system features
  • Lead software development and technical initiatives independently and with small teams, partnering with hardware teams on system architecture and hardware/software co-design
  • Develop Linux applications, libraries, and emulation solutions for heterogeneous computing systems using C, C++, Python, Rust, CUDA, SYCL, or related technologies
  • Research emerging AI software and system architectures, identifying memory, storage, performance, and scalability opportunities
  • Debug sophisticated system-level issues, collaborate across organizations and external partners, mentor engineers, and communicate technical findings to collaborators

Minimum Qualifications:

  • Bachelor’s or Master’s degree with 10+ years of relevant experience, or PhD with 7+ years of relevant experience, in Computer Science, Software Engineering, Computer Engineering, or a related field
  • Hands-on experience across multiple layers of end-to-end AI inference software stacks, such as frameworks, inference engines, ML compilers, compiler infrastructure, hardware runtimes, or hardware abstraction layers
  • Proficiency in C, C++, and Python development on Linux, including experience with multithreading, IPC, ioctl, GDB, /proc, and /sys
  • Experience programming GPUs or other accelerators using CUDA, SYCL, OpenCL, or a comparable model, with solid understanding of heterogeneous compute architectures, memory hierarchies, NUMA, caching, and high-speed interconnects
  • Experience debugging across applications, libraries, operating systems, kernels, networks, and hardware/software interfaces, with demonstrated ability to lead technical initiatives without supervisory authority

Preferred Qualifications:

  • Experience with LLM serving internals, including KV-cache management and offloading, Prefill and decode phases, and disaggregated serving
  • Experience with inference engines or distributed serving frameworks such as SGLang, vLLM, NVIDIA Dynamo, or TensorRT-LLM
  • Technical leadership experience in a systems-focused pathfinding, advanced development, or research organization
  • Knowledge of HBM, DRAM, emerging memory technologies, NVMe SSDs, NAND, and next-generation storage architectures

As a world leader in the semiconductor industry, Micron is dedicated to your personal wellbeing and professional growth. Micron benefits are designed to help you stay well, provide peace of mind and help you prepare for the future. We offer a choice of medical, dental and vision plans in all locations enabling team members to select the plans that best meet their family healthcare needs and budget. Micron also provides benefit programs that help protect your income if you are unable to work due to illness or injury, and paid family leave. Additionally, Micron benefits include a robust paid time-off program and paid holidays. For additional information regarding the Benefit programs available, please see the Benefits Guide posted on micron.com/careers/benefits.

Micron is proud to be an equal opportunity workplace and is an affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, citizenship status, disability, protected veteran status, gender identity or any other factor protected by applicable federal, state, or local laws.

To learn about your right to work click here.

To learn more about Micron, please visit micron.com/careers

For US Sites Only: To request assistance with the application process and/or for reasonable accommodations, please contact Micron’s People Organization at [email protected] or 1-800-336-8918 (select option #3)

Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.

Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.

AI alert: Candidates are encouraged to use AI tools to enhance their resume and/or application materials. However, all information provided must be accurate and reflect the candidate's true skills and experiences. Misuse of AI to fabricate or misrepresent qualifications will result in immediate disqualification.

Fraud alert: Micron advises job seekers to be cautious of unsolicited job offers and to verify the authenticity of any communication claiming to be from Micron by checking the official Micron careers website in the About Micron Technology, Inc.

The employer’s own description, as published on Micron Technology’s careers page.

Hiring at Micron Technology

Micron Technology has 358 open roles right now. Most are in Engineering, Manufacturing & Trades and Supply Chain & Logistics. The median advertised salary across its roles with a published range is $204K. See all its roles

✓ Actively hiring 351 roles posted in the last 7 days✓ Few old postings 0% open 90 days or moreWhat the marks mean

Similar Engineering jobs

All Engineering jobs
Apply on company site