Profile image
Kai Wang
Ph.D. Student & AI Singapore Ph.D. Fellowship
Institutes of Data Science & School of Computing
National University of Singapore

About Me

I am a Ph.D student in HPC-AI Lab at National University of Singapore (start from August 2021), supervised by Presidential Young Prof. Yang YOU.

My doctoral thesis committee is composed of Professor Tat Seng CHUA, who serves as the Chair, as well as Professor Mike SHOU and Professor Yang YOU.

I received my M.S. degree in 2020 from MMLab@SIAT , supervised by Prof. Yu Qiao and Assoc. Prof. Xiaojiang Peng .

My research focuses on Data-centric AI and Efficient Machine Learning. I place an emphasis on exploring simple and baseline approaches to gain insights into the workings of deep learning. Until now, my top-5 publications are Self-Cure Network (CVPR-2020), ContrastiveCrop (CVPR-2022 Oral), CAFE (CVPR-2022), DATM (ICLR-2024), and InfoBatch (ICLR-2024 Oral).

News

  • Jan. 2024:InfoBatch, the first lossless dynamic data pruning approach, was selected as Oral Presentation in ICLR-2024..
  • Jan. 2024:DATM, the first lossless dataset distillation approach, was accepted by ICLR-2024..
  • Jan. 2024: Four papers have been accepted by ICLR-2024, including One Oral, One Spotlight, and 2 Posters
  • Sep. 2023: SGDD, GIF, and pFedBreD have been accepted by NeurIPS-2023.
  • July 2023: Dream, Dataset Quantization, and ZSCL have been accepted by ICCV-2023.
  • Feb. 2023: BiCro and MSINet have been accepted by CVPR-2023, two papers consider the data issues in AI.
  • Jan. 2023: Beta was selected as Spotlight Paper in ICLR-2023.
  • Nov. 2022: HaBa was selected as Spotlight Paper in NeurIPS-2022.
  • Sep. 2022: One Paper has been accepted by NeurIPS-2022.
  • July 2022: One Paper has been accepted by ECCV-2022.
  • Mar. 2022: ContrastiveCrop was selected as Oral Presentation in CVPR-2022.
  • Mar. 2022: Give a talk in Sun Yat-sen University, invited by Prof. Xiaodan Liang. Slides coming soon.
  • Mar. 2022: Give a talk in ByteDance, invited by Prof. Jiashi Feng. Slides coming soon.
  • Mar. 2022: Five papers have been accepted by CVPR-2022, including two first-author papers, one equal-first-author paper, and one second-author paper.
  • Oct. 2021: Our Team win one Champion and and one Third Place in ICCV-MFR Challenge, one Second Place in InsightFace Track.
  • Aug. 2021: One Conference paper has been accepted by ICCV-MFR-Workshop.
  • May 2021: Got AI Singapore Ph.D. Fellowship!!!!
  • May 2021: One Journal paper has been accepted by Transaction on Artificial Intelligence.
  • Mar. 2021: Got a NUS Ph.D offer!!!
  • Feb. 2021: One Journal paper has been accepted by Neurocomputing.
  • Jul. 2020: Start my full-time intern at Alibaba DAMO Acadmey.
  • Jul. 2020: One Conference paper has been accepted by ECCV2020.
  • May. 2020: One Conference paper has been accepted by ICIP2020.
  • Feb. 2020: One Conference paper has been accepted by CVPR2020.
  • Jan. 2020: Start my part-time intern at Huawei Cloud.
  • Dec. 2019: One Journal paper has been accepted by TIP.
  • Dec. 2019: One Conference paper has been accepted by AAAI2020.
  • Dec. 2019: Our team achieve Top 6/2612 in NAIC Challenge.
  • Oct. 2019: Three Conference papers have been accepted by ICMI-2019.
  • Sep. 2019: Our team win the Champion in Huawei Garbege Classification Challenge.
  • Aug. 2019: Our team win the Two Second and One Third Place in EmotiW-2019 Challenge.
  • Jan. 2019: Our team win the Champion in PEER (Hosted by UC. Berkeley) Challenge.
  • Aug. 2018: Our team win the One Champion and One Second Place in EmotiW-2018 Challenge.
  • Aug. 2017: Our team win the One Champion in EmotiW-2017 Challenge.
  • Some Awards before 2017, you can check out from my CV

Selected Publications (Full List in Google Scholar)

Neural Network Diffusion
Kai Wang, Zhaopan Xu, Yukun Zhou, Zelin Zang, Trevor Darrell, Zhuang Liu*, and Yang You* (Equal advising)
arXiv 2024
Conference
Paper Code Summary


InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruning
Ziheng Qin, Kai Wang* , Zangwei Zheng, Jianyang Gu, Xiangyu Peng, Zhaopan Xu, Daquan Zhou, Lei Shang, Baigui Sun, Xuansong Xie, and Yang You (Project lead and Equal-first author)
Oral Presentation (1.2%) in The Twelfth International Conference on Learning Representations (ICLR) 2024
Conference
Paper Code OpenReview


Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching
Ziyao Guo, Kai Wang* , George Cazenavette, Hui Li, Kaipeng Zhang, and Yang You (Project lead )
The Twelfth International Conference on Learning Representations (ICLR) 2024
Conference
Paper Code OpenReview

NuwaDynamics: Discovering and Updating in Causal Spatio-Temporal Modeling
Kun Wang, Hao Wu, Yifan Duan, Guibin Zhang, Kai Wang, Xiaojiang Peng, Yu Zheng, Yuxuan Liang, and Yang Wang
Spotlight Presentation (5%) in The Twelfth International Conference on Learning Representations (ICLR) 2024
Conference
Paper Code OpenReview


Does Graph Distillation See Like Vision Dataset Counterpart?
Beining Yang, Kai Wang* , Qingyun Sun, Cheng Ji, Xingcheng Fu, Hao Tang, Yang You, and Jianxin Li (Equal-first author)
Thirty-Seventh Conference on Neural Information Processing Systems (NeurIPS) 2023
Conference
Paper Code OpenReview


Expanding Small-Scale Datasets with Guided Imagination
Yifan Zhang, Daquan Zhou, Bryan Hooi, Kai Wang, and Jiashi Feng
Thirty-Seventh Conference on Neural Information Processing Systems (NeurIPS) 2023
Conference
Paper Code OpenReview


Dataset Quantization
Daquan Zhou, Kai Wang* , Jianyang Gu*, Xiangyu Peng, Dongze Lian, Yifan Zhang, Yang You, and Jiashi Feng (Equal-first author)
International Conference on Computer Vision (ICCV), 2023
Conference
Paper Code


DREAM: Efficient Dataset Distillation by Representative Matching
Yanqing Liu, Jianyang Gu, Kai Wang* , Zheng Zhu, Wei Jiang, and Yang You (Project Lead)
International Conference on Computer Vision (ICCV), 2023
Conference
Paper Code


DiM: Distilling Dataset into Generative Model
Kai Wang, Jianyang Gu, Daquan Zhou, Zheng Zhu, Wei Jiang, and Yang You
arXiv 2023
Conference
Paper Code


BiCro: Noisy Correspondence Rectification for Multi-modality Data via Bi-directional Cross-modal Similarity Consistency
Shuo Yang, Zhaopan Xu, Kai Wang, Yang You, Hongxun Yao, Tongliang Liu, and Min Xu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Conference
Paper Code


Divide to Adapt: Mitigating Confirmation Bias for Domain Adaptation of Black-Box Predictors
Jianfei Yang, Xiangyu Peng, Kai Wang, Zheng Zhu, Jiashi Feng, Lihua Xie, and Yang You
Spotlight Paper in The Eleventh International Conference on Learning Representations (ICLR) 2023
Conference
Paper Code OpenReview


Dataset Distillation via Factorization
Songhua Liu, Kai Wang, Xingyi Yang, Jingwen Ye, and Xinchao Wang
Spotlight Paper in Thirty-Sixth Conference on Neural Information Processing Systems (NeurIPS) 2022
Conference
Paper Code OpenReview


CAFE: Learning to Condense Dataset by Aligning Features
Kai Wang, Bo Zhao，Xiangyu Peng, Zheng Zhu, Shuo Yang, Shuo Wang, Guan Huang, Hakan Bilen, Xinchao Wang, and Yang You
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
Conference
Paper Code


An Efficient Training Approach for Very Large Scale Face Recognition
Kai Wang, Shuo Wang, Panpan Zhang, Zhipeng Zhou, Zheng Zhu, Xiaobo Wang, Xiaojiang Peng, Baigui Sun, Hao Li, and Yang You
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
Conference
Paper Code


Crafting Better Contrastive Views for Siamese Representation Learning
Xiangyu Peng, Kai Wang* , Zheng Zhu, Mang Wang, and Yang You (Equal-first author)
Oral Presentation in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
Conference
Paper Code


Suppressing uncertainties for large-scale facial expression recognition
Kai Wang, Xiaojiang Peng, Jianfei Yang, Shijian Lu, and Yu Qiao
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020
Conference
Paper Code


Region attention networks for pose and occlusion robust facial expression recognition
Kai Wang, Xiaojiang Peng, Jianfei Yang, Debin Meng, and Yu Qiao
IEEE Transaction on Image Processing (TIP), 2020
Journal
Paper Code


Suppressing mislabeled data via grouping and self-attention
Xiaojiang Peng,Kai Wang* , Zhaoyang Zeng, Qing Li, Jianfei Yang, and Yu Qiao (Equal-first author)
European Conference on Computer Vision (ECCV), 2020
Conference
Paper Code


Education

Ph.D. in Data Science & Machine Learning
National University of Singapore, Singapore
Aug. 2021 - Present
M.S. in Computer Technology
University of Chinese Acadmey of Sciences
Sep. 2017 - Aug. 2020
B.Eng. in Electrical Engineering and Automation
Beijing Normal University, Zhuhai, China
Sep. 2013 - July 2017

Advising Experience--Research Interns

  • Yukun Zhou (undergraduate student at Xidian University), Yanqing Liu (incoming Ph.D. student at UCSC), Ziyao Guo (master student at Xidian University), Yuchen Zhang (undergraduate student at UESTC), Tianle Zhang (undergraduate student at UESTC), Beining Yang (incoming Ph.D. student at The University of Edinburgh), Tianyi Li (undergraduate student at CHU KOCHEN Honors College, ZJU), Xiaolong Jin (undergraduate student at School of the Gifted Young, USTC), (All talents are welcome to send an email to me if you are interested in collaborating on projects related to Data-Centric AI, Parameter Generation, or other promising research directions.)

    • Academic Service

  • Reviewer of CVPR, ECCV, ICML, NeurIPS, ICCV, AAAI, ICLR
  • Reviewer of TIP, TCSVT, TAFFEC, TNNLS

    • Friends

    Jianfei Yang (NTU), Huaizheng Zhang (NTU), Sijie Ji (NTU), Zheng Zhu (Tsinghua University), Bo Zhao (The University of Edinburgh), Jiankang Deng (Huawei London), Shuyang Sun (Oxford University), Kaipeng Zhang (The University of Tokyo), Hao Luo (Alibaba Group), Xiangyu Peng (NUS), Wangbo Zhao (NUS), Ruicheng Feng (NTU), David Junhao Zhang (NUS), Zangwei Zheng (NUS), Wangbo Zhao (NUS), Yong Liu (NUS), Yaqi Xie (NUS), Fuzhao Xue (NUS)

    Copyright © Kai Wang 2021