Research Intern - AI Compiler GPU Optimization

Redmond, Washington, United States
  • 1515058
  • Jan 20, 2023
  • None
  • Research, Applied, & Data Sciences
  • Individual Contributor
  • Internship
  • Up to 50% work from home

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers. Our researchers and engineers pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.

Come design and build the next generation of AI Compiler technologies as a Research Engineering Intern in Microsoft Research at Redmond, WA.

The Accera team in Microsoft Research is looking for highly motivated Research Engineering Interns. Accera is an open-source AI compiler by Microsoft Research, whose goal is to enable developers to easily create highly optimized AI compute kernels for different target platforms. The Accera team is specifically looking for highly motivated Research Engineering Interns to innovate and improve Accera’s code generation for high-end GPU targets. During your internship, you will design and build code optimization techniques that squeeze out every last bit of performance from high-end GPUs running AI workloads.

This is a great opportunity to gain valuable experience in AI engineering in a research environment, and to make significant contributions to the advancement of AI technologies. If you are eager to bring your skillset to the forefront of AI, GPU code optimization, and compilers research, then this opportunity is perfect for you.

Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, interns learn, collaborate, and network for life. Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, students are paired with mentors and expected to collaborate with other interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.

Additional Responsibilities

  • Implement compiler optimization techniques that generate highly performant GPU kernels for AI workloads on AMD and Nvidia GPUs.
  • Benchmark and enhance existing kernels for performance optimization.
  • Use the Accera compiler to implement end-to-end AI models running on GPU.

Required Qualifications

In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.

  • Must have a bachelor's degree in Computer Science or related field.
  • Must have 2 years of programming experience in C/C++.

Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.

Preferred Qualifications

  • Prior experience or projects showing basic understanding of GPUs and parallel programming.
  • Working knowledge of CUDA, C++ and Python.
  • Advanced understanding of internal GPU architecture (Nvidia and AMD).
  • Familiarity with the AMD ROCm software stack.
  • Familiarity with MLIR and LLVM.
  • Pursuing a MS/PhD degree program in Computer Science or related field.

The base pay range for this internship is USD $5,090 - $10,120 per month. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $6,690 - $11,030 per month.

Benefits/perks listed here may vary depending on the nature of employment with Microsoft and the country work location. U.S.-based PhD, University, and Explore interns have access to medical and vision insurance, paid sick time (salaried interns accrue at 3.34 hours per pay period worked; hourly interns accrue at .03846 hour per hour worked), paid federal holidays, and software discounts. Puget Sound-based PhD, University, and Explore interns gain access to a bus pass and a fitness club membership. Discovery interns are not eligible for healthcare benefits or a fitness club membership, but they have access to paid sick time (accrued at .03846 hour per hour worked), paid federal holidays, software discounts, and a bus pass.

Our Commitment to Pay Equity

We are committed to the principle of pay equity – paying employees equitably for substantially similar work. To learn more about pay equity and our other commitments to increase representation and strengthen our culture of inclusion, check out our annual Diversity & Inclusion Report. ( https://www.microsoft.com/en-us/diversity/inside-microsoft/annual-report )

Understanding Roles at Microsoft​

The top of this page displays the role for which the base pay ranges apply – Applied Sciences IC2.

The way we define roles includes two things: discipline (the type of work) and career stage (scope and complexity). The career stage has two parts – the first identifies whether the role is a manager (M), an individual contributor (IC), an admin-technician-retail (ATR) job, or an intern. The second part identifies the relative seniority of the role – a higher number (or later letter alphabetically in the case of ATR) indicates greater scope and complexity.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

  • Industry leading healthcare
  • Giving programs
  • Opportunities to network and connect
  • Discounts on products and services