Xuanyi Dong (董宣毅)
Amazon Web Services (AWS) AI
Email: xuanyi.dxy [at] gmail.com

About Me ([GitHub] [Google Scholar] [Full Publications])

I am an applied scientist at Amazon. I received a Ph.D. degree from the School of Computer Science, University of Technology Sydney (UTS). My research interests included automated deep learning (AutoDL) and its application to real world problems. In the past, I was fortunate to work at Google, Facebook, Amazon, Microsoft, etc.

Selected Industrial Experience

Selected Invited Talks

  • May 2021: Extend the Search from Arch to HP, Hardware, System, Keynote Speaker at NAS@ICLR2021
  • Apr 2021: Extend the Search from Architecture to HP, Hardware, System, 4Paradigm, MSRA
  • Sep 2020: Efficient Differentiable Automated Deep Learning, UT Austin
  • Summer 2020: Towards Efficient and Reproducible NAS, Baidu USA, 1st VALSE Student Seminar
  • Summer 2019: Efficient NAS and Its Applications to Computer Vision, YITUTech, Baidu, SCUT, SUST

Selected Publications

AutoHAS: Efficient Hyperparameter and Architecture Search
Xuanyi Dong, Mingxing Tan, Adams Wei Yu, Daiyi Peng, Bogdan Gabrys, Quoc V. Le
in NAS@ICLR, 2021
[arXiv] [Slides] [BibTex]
A weight sharing-based hyperparameter and architecture search approach, improving MobileNet/ResNet/EfficientNet/BERT.
NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size
Xuanyi Dong, Lu Liu, Katarzyna Musial, Bogdan Gabrys
in IEEE TPAMI, 2021
[arXiv] [IEEE] [API] [Package] [Project] [BibTex] [ICLR]
An algorithm-agnostic NAS benchmark with information of 15,625 neural cell candidates for architecture topology and 32,768 for architecture size on three datasets, and we also provide 13 NAS baselines in a single codebase.
Network Pruning via Transformable Architecture Search
Xuanyi Dong and Yi Yang
in NeurIPS, 2019
[arXiv] [NeurIPS] [Code] [Logs] [Project] [Poster] [BibTex]
Search for the network size in a differentiable way.
Searching for A Robust Neural Architecture in Four GPU Hours
Xuanyi Dong and Yi Yang
in CVPR, 2019
[ arXiv ] [ CVPR ] [ Code ] [ BibTex ]
Introduce differentiable neural sampling into gradient-based NAS.

Awards and Honors

Academic Services

Executive Area Chair at Vision And Learning SEminar (VALSE) [SIX]

ICCV 2021 Workshop -- Neural Architectures: Past, Present and Future

Journal Reviewer
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPMAI)
International Journal of Computer Vision (IJCV)
IEEE Transactions on Image Processing (TIP)
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
Pattern Recognition (PR) [Outstanding Reviewer]

Conference Reviewer or Senior Program Committee
Neural Information Processing Systems (NeurIPS) 2019 - 2021
International Conference on Machine Learning (ICML) 2021
International Conference on Learning Representations (ICLR) 2021
Computer Vision and Pattern Recognition (CVPR) 2019 - 2021
European Conference on Computer Vision (ECCV) 2020
International Conference on Computer Vision (ICCV) 2019, 2021
ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) 2021
AAAI Conference on Artificial Intelligence (AAAI) 2020 - 2021
International Joint Conference on Artificial Intelligence (IJCAI) 2020 - 2021