I am a Ph.D. student at National University of Singapore and Alibaba Platform for AI (PAI) team, jointly advised by Prof. Yang You and Wei Lin. I received my B.Eng. in Computer Science from Nanyang Technological University, where I was fortunate to work with Prof. Bo An and Prof. Chen Change Loy.
I want to bridge AI and computer system through building highly efficient distributed ML infrastructure. During my undergrad, I have spent four wonderful years with NTU HPC club. We won an Overall Championship at SC'17 and set LINPACK World Record.
In my spare time, I usually do hiking, cooking, and jogging. I am also a soccer fan.
Download my resumé.
Doctor of Philosophy, Computer Science, 2021 - Current
National University of Singapore
Bachelor of Engineering in Computer Science, 2015 - 2019
Nanyang Technological University
Visiting Student, Fall 2016
New York University
We propose an efficient parameter sharing strategy for Transformer architecture by replacing FFN with MoE layer and sharing the trainable parameters except the normalization layers. Competitive performance across CV and NLP tasks were achieved with up to 6x reduction in the numbers of unique parameters.