• Bio

    Currently, I am a Postdoctoral Scholar at IRIS Lab, Department of Computer Science, Stanford University hosted by Prof. Chelsea Finn. I am also affiliated with Stanford AI Lab, CRFM, and ML Group. I received my Ph.D. degree in 2021 at Pennsylvania State University under the advisory of Prof. Zhenhui (Jessie) Li. During my Ph.D. study, I also spent time visiting SAILING Lab, CMU hosted by Prof. Eric P. Xing. Earlier, I got my B.Eng. degree in 2016 from the University of Electronic Science and Technology of China under the advisory of Prof. Defu Lian (now in USTC) and Prof. Tao Zhou.

     

    My current research interests focus on building machine learning models that are robust and adaptable to distribution shifts and open or non-stationary environments. Revolving around this goal, I recently study the following topics:

    - Out-of-Distribution Generalization and Robustness: [LISA (ICML 2022)], [mixReg (NeurIPS 2022a)], [Wild-Time (NeurIPS 2022b)], [DivDis (arXiv 2022)]

    - Compositional Generalization and Adaptation: [OSML (NeurIPS 2020)], [ARML (ICLR 2020)], [HSML (ICML 2019)]

    - Robust Meta-Learning with Limited or Imperfect Observations: [MLTI (ICLR 2022)], [MetaMix (ICML 2021)] [ATS (NeurIPS 2021a)]

    - Data Science Applications: drug discovery [NeurIPS 2022c] [NeurIPS 2021b], transportation and smart city [WWW 2019a] [AAAI 2020d], text classification and generation [ACL 2022] [EMNLP 2021], web mining and content analysis [AAAI 2020a] [AAAI 2020b] [WSDM 2020]

     

    You can follow me on Twitter at @HuaxiuYaoML.
     

    I am on the academic job market for faculty positions! Please feel free to reach out if you have potential job opportunities in AI/ML/DS

    News

    [2022.09] Three papers were accepted by NeurIPS 2022 (two main track, one datasets & benchmarks track)

    [2022.07] We will organize the Sixth Workshop on Meta-Learning at NeurIPS 2022. Stay tuned!

    [2022.05] One paper was accepted by KDD 2022

    [2022.05] One paper was accepted by ICML 2022

    [2022.03] We will organize the First Workshop on Pre-training at ICML 2022. Stay tuned!

    [2022.02] One paper was accepted by ACL 2022

    [2022.01] One paper was accepted by ICLR 2022

    [2021.09] Two papers were accepted by NeurIPS 2021

    [2021.08] One paper was accepted by EMNLP 2021

    [2021.05] One paper was accepted by ICML 2021

    [2021.04] Join Stanford University as a Postdoctoral Scholar hosted by Prof. Chelsea Finn

    [2020.09] Remotely visit SAILING Lab hosted by Prof. Eric P. Xing starting from fall 2020

  • publicationS

    Google Scholar, DBLP, Semantic Scholar

     

    The underline authors are undergrads mentored by me

    Preprint

    [1] Yoonho Lee, Huaxiu Yao, Chelsea Finn, Diversify and Disambiguate: Learning From Underspecified Data, arXiv 2202.03418 (the short version is published in ICML 2022 Workshop on Spurious correlations, Invariance, and Stability and ICML 2022 Workshop on Principles of Distribution Shift). [Project Page] [Code] [arXiv]

     

    [2] Ying Wei, Peilin Zhao, Huaxiu Yao, Junzhou Huang, Transferable Neural Processes for Hyperparameter Optimization, arXiv 1909.03209 (the short version is published in NeurIPS 2019 Workshop on Meta-Learning). [arXiv]

     

    [3] Ali Ghadirzadeh, Petra Poklukar, Xi Chen, Huaxiu Yao, Hossein Azizpour, Mårten Björkman, Chelsea Finn, Danica Kragic, Few-Shot Learning With Weak Supervision, ICLR 2021 Workshop on Learning to Learn. [Openreview] [Poster]

    2022

    [1] Huaxiu Yao*, Yiping Wang*, Linjun Zhang, James Zou, Chelsea Finn, mixReg: A Simple Way to Improve Generalization and Out-of-Distribution Robustness in Regression, in Proceeding of the Thirty-Sixth Conference on Neural Information Processing Systems (NeurIPS 2022), New Orleans, LA, 2022.

     

    [2] Huaxiu Yao*, Caroline Choi*, Yoonho Lee, Pang Wei Koh, Chelsea Finn, Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Time, in Proceeding of the Thirty-Sixth Conference on Neural Information Processing Systems (NeurIPS 2022), New Orleans, LA, 2022. (Datasets & Benchmarks Track)

     

    [3] Yemin Yu, Ying Wei, Kun Kuang, Zhengxing Huang, Huaxiu Yao, Fei Wu, GRASP: Navigating Retrosynthetic Planning with Goal-driven Policy, in Proceeding of the Thirty-Sixth Conference on Neural Information Processing Systems (NeurIPS 2022), New Orleans, LA, 2022.

     

    [4] Huaxiu Yao*, Yu Wang*, Sai Li, Linjun Zhang, Weixin Liang, James Zou, Chelsea Finn, Improving Out-of-Distribution Robustness via Selective Augmentation, in Proceeding of the Thirty-ninth International Conference on Machine Learning (ICML 2022), Baltimore, MD, July 2022. [PDF] [Code] [Video] [Bilibili] [Slides] [Poster] [arXiv]

     

    [5] Huaxiu Yao, Linjun Zhang, Chelsea Finn, Meta-Learning with Fewer Tasks through Task Interpolation, in Proceeding of the 10th International Conference on Learning Representations (ICLR 2022), Virtual, Apr. 2022 (Oral, 54/3391). [Openreview] [PDF] [Code] [Slides] [Poster] [arXiv]

     

    [6] Yingxiu Zhao, Zhiliang Tian, Huaxiu Yao, Yinhe Zheng, Dongkyu Lee, Yiping Song, Jian Sun, Nevin Zhang, Improving Meta-learning for Low-resource Text Classification and Generation via Memory Imitation, in Proceeding of the 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022), Dublin, Ireland, May 2022 (long paper). [Openreview] [PDF] [Code] [arXiv]

     

    [7] Bin Lu, Xiaoying Gan, Weinan Zhang, Huaxiu Yao, Luoyi Fu, Xinbing Wang, Spatio-Temporal Graph Few-Shot Learning with Cross-City Knowledge Transfer, in Proceedings of the 28th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2022), Washington DC, Aug. 2022 (Research Track). [arXiv]

     

    [8] Yinjie Jiang, Yemin Yu, Ming Kong, Yu Mei, Luotian Yuan, Zhengxing Huang, Kun Kuang, Zhihua Wang, Huaxiu Yao, James Zou, Connor W. Coley, Ying Wei, Artificial Intelligence for Retrosynthesis Prediction, Engineering (Engineering), 2022 (survey).

    2021

    [9] Huaxiu Yao*, Yu Wang*, Ying Wei, Peilin Zhao, Mehrdad Mahdavi, Defu Lian, Chelsea Finn, Meta-learning with an Adaptive Task Scheduler, in Proceeding of the Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS 2021), Virtual, Dec. 2021. [PDF] [Supplementary] [Code] [Slides] [Poster] [arXiv]

     

    [10] Huaxiu Yao, Ying Wei, Longkai Huang, Ding Xue, Junzhou Huang, Zhenhui Li, Functionally Regionalized Knowledge Transfer for Low-resource Drug Discovery, in Proceeding of the Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS 2021), Virtual, Dec. 2021. [PDF] [Supplementary] [Code] [Slides]

     

    [11] Huaxiu Yao, Yingxin Wu, Maruan Al-Shedivat, Eric P. Xing, Knowledge-Aware Meta-learning for Low-Resource Text Classification, in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021), Punta Cana, Dominican Republic, Nov. 2021 (Short Paper, Oral). [PDF] [Code] [Slides] [Poster] [arXiv]

     

    [12] Huaxiu Yao*, Longkai Huang*, Linjun Zhang, Ying Wei, Li Tian, James Zou, Junzhou Huang, Zhenhui Li, Improving Generalization in Meta-learning via Task Augmentation, in Proceeding of the Thirty-eighth International Conference on Machine Learning (ICML 2021), Virtual, Jul. 2021. [PDF] [Supplementary] [Code] [Slides] [Poster] [arXiv]

     

    [13] Jiatu Shi*, Huaxiu Yao*, Xian Wu, Tong Li, Zedong Lin, Tengfei Wang, Binqiang Zhao, Relation-aware Meta-learning for E-commerce Market Segment Demand Prediction with Limited Records, in Proceeding of the 14th ACM International Conference on Web Search and Data Mining (WSDM 2021), Virtual, Mar. 2021. [PDF] [arXiv]

     

    [14] Porter Jenkins, Ahmad Farag, Stockton Jenkins, Huaxiu Yao, Suhang Wang, Zhenhui Li, Neural Utility Functions, in Proceeding of the Thirty-fifth AAAI Conference on Artificial Intelligence (AAAI 2021), Virtual, Feb. 2021. [PDF]

     

    [15] Chuxu Zhang, Huaxiu Yao, Lu Yu, Chao Huang, Dongjing Song, Haifeng Chen, Meng Jiang, Nitesh V. Chawla, Inductive Contextual Relation Learning for Personalization, ACM Transactions on Information System (TOIS) 39, no. 3 (2021): 1-22. [PDF]

    2020

    [16] Huaxiu Yao, Yingbo Zhou, Mehrdad Mahdavi, Zhenhui Li, Richard Socher, Caiming Xiong, Online Structured Meta-learning, in Proceeding of the Thirty-fourth Conference on Neural Information Processing Systems (NeurIPS 2020), Virtual, Dec. 2020. [PDF] [Supplementary] [Slides] [Poster] [arXiv]

     

    [17] Huaxiu Yao, Xian Wu, Zhiqiang Tao, Yaliang Li, Bolin Ding, Ruirui Li, Zhenhui Li, Automated Relational Meta-learning, in Proceeding of the Eighth International Conference on Learning Representations (ICLR 2020), Virtual, Apr. 2020. [Openreview] [PDF] [Code] [Slides] [arXiv]

     

    [18] Huaxiu Yao, Chuxu Zhang, Ying Wei, Meng Jiang, Suhang Wang, Junzhou Huang, Nitesh V. Chawla, Zhenhui Li, Graph Few-shot Learning via Knowledge Transfer, in Proceeding of the Thirty-fourth AAAI Conference on Artificial Intelligence (AAAI 2020), New York, NY, Feb. 2020 (the short version is published in NeurIPS 2019 Graph Representation Learning Workshop). [PDF] [Full Paper] [Code] [arXiv]

     

    [19] Chuxu Zhang, Huaxiu Yao, Chao Huang, Meng Jiang, Zhenhui Li, Nitesh V. Chawla, Few-Shot Knowledge Graph Completion, in Proceeding of the Thirty-fourth AAAI Conference on Artificial Intelligence (AAAI 2020), New York, NY, Feb. 2020. [PDF] [Code] [Poster] [arXiv]

     

    [20] Xianfeng Tang, Huaxiu Yao, Yiwei Sun, Charu Aggarwal, Prasenjit Mitra, Suhang Wang, Joint Modeling of Local and Global Temporal Dynamics for Multivariate Time Series Forecasting with Missing Values, in Proceeding of the Thirty-fourth AAAI Conference on Artificial Intelligence (AAAI 2020), New York, NY, Feb. 2020. [PDF] [arXiv]

     

    [21] Xinshi Zang, Huaxiu Yao, Guanjie Zheng, Nan Xu, Kai Xu, Zhenhui Li, MetaLight: Value-based Meta-reinforcement Learning for Online Universal Traffic Signal Control, in Proceeding of the Thirty-fourth AAAI Conference on Artificial Intelligence (AAAI 2020), New York, NY, Feb. 2020. [PDF] [Code] [Poster]

     

    [22] Xianfeng Tang, Huaxiu Yao, Yiwei Sun, Yiqi Wang, Jiliang Tang, Charu Aggarwal, Prasenjit Mitra, Suhang Wang, Investigating and Mitigating Degree-Related Biases in Graph Convolutional Networks, in Proceeding of the 29th ACM International Conference on Information and Knowledge Management (CIKM 2020), Galway, Ireland, Oct. 2020. [PDF] [arXiv]

     

    [23] Xianfeng Tang, Yandong Li, Yiwei Sun, Huaxiu Yao, Prasenjit Mitra, Suhang Wang, Transferring Robustness for Graph Neural Network Against Poisoning Attacks, in Proceeding of the 13th ACM International Conference on Web Search and Data Mining (WSDM 2020), Houston, TX, Feb. 2020. [PDF] [Code] [arXiv]

    2019

    [24] Huaxiu Yao, Ying Wei, Junzhou Huang, Zhenhui Li, Hierarchically Structured Meta-learning, in Proceeding of the 36th International Conference on Machine Learning (ICML 2019), Long Beach, CA, June 2019. [PDF] [Supplementary] [Slides] [Poster] [Code] [arXiv]

     

    [25] Huaxiu Yao, Yiding Liu, Ying Wei, Xianfeng Tang, Zhenhui Li, Learning from Multiple Cities: A Meta-Learning Approach for Spatial-Temporal Prediction, in Proceeding of The Web Conference 2019 (WWW 2019), San Francisco, CA, May 2019 (Research Track, Long Paper). [PDF] [Slides] [Poster] [Code] [arXiv with Erratum]

     

    [26] Xianfeng Tang, Boqing Gong, Yanwei Yu, Huaxiu Yao, Yandong Li, Haiyong Xie, Xiaoyu Wang, Joint Modeling of Dense and Incomplete Trajectories for Citywide Traffic Volume Inference, in Proceeding of The Web Conference 2019 (WWW 2019), San Francisco, CA, May 2019 (Research Track, Long Paper). [PDF] [arXiv]

     

    [27] Huaxiu Yao*, Xianfeng Tang*, Hua Wei, Guanjie Zheng, Zhenhui Li, Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Prediction, in Proceeding of the Thirty-third AAAI Conference on Artificial Intelligence (AAAI 2019), Honolulu, Hawaii, Jan. 2019. [PDF] [Poster] [Code] [Spotlight] [arXiv]

     

    [28] Huaxiu Yao, Defu Lian, Yi Cao, Yifan Wu, Tao Zhou, Predicting Academic Performance for College Students: A Campus Behavior Perspective, ACM Transactions on Intelligent Systems and Technology (TIST) 10.3 (2019): 24. [PDF] [arXiv]

    2018

    [29] Huaxiu Yao, Fei Wu, Jintao Ke, Xianfeng Tang, Yitian Jia, Siyu Lu, Pinghua Gong, Jieping Ye, Zhenhui Li, Deep Multi-View Spatial-Temporal Network for Taxi Demand Prediction, in Proceeding of the Thirty-second AAAI Conference on Artificial Intelligence (AAAI 2018), New Orleans, LA, Feb. 2018. [PDF] [Poster] [Code] [Spotlight] [Penn State News] [arXiv]

     

    [30] Hua Wei*, Guanjie Zheng*, Huaxiu Yao, and Zhenhui Li, IntelliLight: A Reinforcement Learning Approach for Intelligent Traffic Light Control, in Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2018), London, UK, Aug. 2018 (Research Track). [PDF] [Code] [Demo]

     

    [31] Yi Cao*, Jian Gao*, Defu Lian, Zhihai Rong, Jiatu Shi, Qing Wang, Yifan Wu*, Huaxiu Yao*, Tao Zhou*. Orderliness predicts academic performance: behavioural analysis on campus lifestyle, Journal of the Royal Society Interface (J. R. Soc. Interface), 15 (146), (2018) 20180210 (alphabetical order). [PDF] [Supplementary]

  • Teaching & mentoring

    Teaching Experience

    Guest Lecture

    • CS 5824: Advanced Machine Learning, Virginia Tech, Spring 2022
    • COSI 165B: Deep Learning, Brandeis University, Spring 2022
    • CSCI 780-04: Deep Representation Learning, William and Mary, Fall 2021

    Teaching Assistant at Penn State

    • IST 597: Reinforcement Learning, Instructor: Dr. Zihan Zhou, Fall 2019

    Mentored Students

    [2022 - now] Caroline Choi, undergrad@Stanford, Achievements: NeurIPS'22

    [2022 - now] Nathan Hu, undergrad@Stanford

    [2021 - now] Takao Yatagai, undergrad@Stanford

    [2022 - now] Yiping Wang, undergrad@ZJU, Achievements: NeurIPS'22

    [2022 - now] Xinyu Yang, undergrad@SJTU

    [2022 - now] Zhiyu Xie, undergrad@THU

    [2021 - 2022] Govind Chada, undergrad@Stanford

    [2021 - 2022] Yingxin Wu, undergrad@USTC -> Ph.D. student@Stanford, Achievement: EMNLP'21

    [2021 - 2022] Yu Wang, undergrad@USTC -> Ph.D. student@UCSD, Achievements: NeurIPS'21, ICML'22

    [2019] Xinshi Zang, undergrad@SJTU -> Ph.D. student@CUHK, Achievement: AAAI'20

  • Services

    Workshop & Tutorial Organizer

    Workshop

    Tutorial

    • Learning with Small Data. (KDD 2020 [Website] [Slides] [YouTube] [Bilibili]) (WSDM 2020 [Website]) (AAAI 2021)

    • Meta-learning and Automated Machine Learning: Approaches and Applications​. (IJCAI 2020 [Website])

    Program Committee Member/Reviewer

    Conference Area Chair/Senior Program Committee:

    • AAAI Conference on Artificial Intelligence (AAAI), 2023
    • Conference on Neural Information Processing Systems, Dataset and Benchmark Track (NeurIPS, D&B Track), 2022
    • International Conference on Automated Machine Learning (AutoML-Conf), 2022 (Senior AC)
    • Learning on Graphs Conference (LoG), 2022

    Conference Program Committee/Reviewer:

    • International Conference on Machine Learning (ICML), 2020 - 2022
    • Annual Conference on Neural Information Processing Systems (NeurIPS), 2020 - 2022
    • International Conference on Learning Representations (ICLR), 2020 - 2022
    • International Conference on Artificial Intelligence and Statistics (AISTATS), 2022
    • ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2020 - 2022
    • AAAI Conference on Artificial Intelligence (AAAI), 2020 - 2022
    • Annual Meeting of the Association for Computational Linguistics (ACL), 2021 - 2022 (ARR)

    Journal Invited Reviewer:

    • Transactions on Machine Learning Research (TMLR)
    • IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI)
    • Journal of Artificial Intelligence (AIJ)
    • ACM Transactions on Knowledge Discovery from Data (TKDD)
    • IEEE Transactions on Knowledge and Data Engineering (TKDE)
    • ACM Transaction on Intelligent System and Technology (TIST)
    • Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)
  • miscellaneous

    Invited Talks

    Actionable Machine Learning for Tackling Distribution Shift

    • University of Maryland, 2022
    • MedAI Seminar,  Stanford, 2022
    • Center for Multi-Agent Research, Peking University, 2022

    Improving Generalization in Meta-learning through Organization and Augmentation

    • StatsML Seminar, Imperial & Oxford, 2022
    • University of Fribourg, 2021

    Improving Generalization in Low-resource molecular modeling through organization and augmentation

    • M2D2 Seminar, Valence Discovery & Mila, 2022

    Learning to Learn with Structured Knowledge

    • Juniper Network, 2022
    • Carnegie Mellon University, 2020
    • Stanford University, 2020

    Honors and Awards

    • AI Rising Stars in Chinese Students, Baidu Research, 2021
    • College of IST Ph.D. Award for Research Excellence, Penn State University, 2020
    • Excellent Bachelor Thesis​ in UESTC, 2016
    • Excellent Graduates in UESTC, 2016

    Industry Internships

  • contact

    Office: 322, Gates Building, Stanford, CA 94085