------------------->

Azalia Mirhoseini



I am a Staff Research Scientist and manager at Google Brain, and an advisor at Cmorq. My research interests include deep reinforcement learning, NLP, Vision and large-scale ML systems. I have published more than 40 peer-reviewed papers at scientific venues such as Nature, ICML, ICLR, NeurIPS, UAI, SIGMETRICS, DAC, DATE, and ICCAD. I am a co-founder/lead of Machine Learning for Systems Team at Google Brain, a larger research effort to develop advanced learning-based decision making methods that enable the design of next generation computer systems and hardware. I have a Ph.D. in Computer Engineering from Rice University. I have received MIT Technology Review 35 Innovators Under 35 Award, Best Ph.D. Thesis Award at Rice University, and Gold Medal in the National Math Olympiad in Iran. My work has been covered in various media outlets, including MIT Technology Review, IEEE Spectrum, Times, CNBC, The Verge, and WIRED.

CV, Twitter, LinkedIn

Research

Recent Highlights:

  • Our work on deep reinforcement learning for chip floorplanning was published in Nature and used in production to design next generation Google TPUs, with potential to save thousands of hours of engineering effort for each next generation. I cofounded/led this project, a larger team effort with 20+ engineers and researchers across different organizations, including Google Research and Platforms (Nature and Opinion Piece).

  • Developed FAST, a learned accelerator search framework with a broad optimization environment, including hardware datapath, software scheduling, and compiler passes such as operation fusion and tensor padding. When evaluated on vision benchmarks, designs generated by FAST optimized for single workloads show over 6x improvement in Perf/TDP in the best case and over 4x on average vs. TPU-v3 (Preprint).

  • Developed deep reinforcement learning algorithms to do model parallelism that speed up deep network training by more than 60% over top-performing baselines (ICML’17, ICLR’18, and NeurIPS’20).

  • Developed mixture-of-expert NLP models that allow efficient training of massive neural networks with over 100 billion parameters, yielding state of the art results on established language modeling and translations tasks (ICLR’17).

    • Publications:

    For a full list of publications, please take a look at my CV or Google Scholar page.

    >

    Recent Talks and Interviews

  • Keynote speaker at CVPR workshop on Dynamic Neural Networks meets Computer Vision 2021 (Slides, Video)
  • Keynote speaker at the workshop on Graph Neural Networks and Systems at MLSys, 2021
  • Invited speaker at IPAM 2021 Workshop on Deep Learning and Combinatorial Optimization
  • Invited speaker at NVIDIA GTC, 2021 (Video)
  • Panelist at IEEE Custom Integrated Circuits Conference ML for Chip Design Forum, 2021
  • Keynote Speaker at MIT EmTech China, 2020
  • Keynote Speaker at Ray summit, 2020 (Video)
  • Keynote Speaker at Open Data Science Conference, 2020
  • Keynote Speaker at International Supercomputing ML day, 2019
  • Keynote Speaker at ML in HPC Workshop at Supercomputing, 2018
  • Interviewed by MIT Technology Review, 2020
  • Interviewed by IEEE Spectrum, 2020
  • Interviewed by ACM Learning Center, 2020 (Interview)
  • Interviewed by Towards Data Science, 2019 (Interview, Video)
    • >

    Awards and Honors

  • Published in Nature Flagship Journal, 2021
  • MIT Technology Review 35 Innovators Under 35, 2019 (Article)
  • Best Thesis Award at Rice University, ECE Department, 2015
  • Fellowships and scholarships from Microsoft Research, IBM Research and Schlumberger, 2010-2015
  • Gold Medal in National Math Olympiad, Iran, 2004
    • >

    Misc

    >

    Contact

    You can reach out by sending an email to: info (at) azaliamirhoseini.com.