Yuwei Sun

PhD candidate at the University of Tokyo Research fellowship at Japan Society for the Promotion of Science RIKEN Center for Advanced Intelligence Project (AIP) Researcher


Incoming Senior Researcher at Araya Research and Visiting Research Scientist at RIKEN AIP

My research interests lie in the co-learning mechanism of decentralized and modular neural networks with Minsky's Society of Mind as a guide. My focus is on how knowledge learned by different agents or modalities could be transferred and leveraged to tackle future tasks. Understanding these dynamics would help build generalizable lifelong learning machines.
Blog: The Modular Mind Blog


 

Email: ywsun [at] g.ecc.u-tokyo.ac.jp

			



 

News

Feb 2024: I am presenting our paper at AAAI 2024 in Vancouver.

Feb 2024: I successfully defended my PhD dissertation and received the Department Chair's Award.

Sep 2023: I am co-organizing the NeuroAI Social at NeurIPS 2023 in New Orleans.

May 2023: I was nominated for the WBAI Incentive Award for my work on AI and Global Workspace Theory.

Mar 2023: I was accepted by Microsoft Research Asia Collaborative Research Program (D-CORE 2023).

Mar 2023: I am excited to join Araya as a research intern working on NeuroAI and Global Workspace in April.

Mar 2023: I visited Switzerland and Germany for the joint ML workshops among RIKEN AIP, EPFL CIS, and Fraunhofer IIS.

Jan 2023: I attended AAAI 2023 and gave a talk on "Meta Learning in Decentralized Neural Networks: Towards More General AI".

Dec 2022: I presented our poster at NeurIPS 2022.

Oct 2021: I was selected as a fellow of the SPRING GX Program at the Japan Science and Technology Agency (JST).

Sep 2021: I was selected as a PhD research fellow (DC2) at the Japan Society for the Promotion of Science (JSPS).

Mar 2021: I received my Master's degree in Information and Communication Engineering with the honor of Department Chair's Award for Outstanding Thesis.

Jan 2020: I was accepted by the ASP fellowship at Massachusetts Institute of Technology (MIT).



Biography

I am a PhD student in the Graduate School of Information Science and Technology at the University of Tokyo. I received the B.E. degree in computer science and technology from North China Electric Power University, in 2018, and the M.E. degree (Hons.) in information and communication engineering from the University of Tokyo, in 2021. In 2020, I was the fellow of the Advanced Study Program (ASP) at the Massachusetts Institute of Technology. I am working as a part-time researcher at the RIKEN Center for Advanced Intelligence Project and a research fellow at the Japan Society for the Promotion of Science. During my PhD, I have spent time at United Nations University and UPenn.

Curriculum Vitae: pdf


I am a project manager for Microsoft Research Asia D-CORE and JSPS Grants-in-Aid for Scientific Research to develop modular knowledge representation systems for lifelong learning. I am in Moonshot Program by the Cabinet of Japan to bridge artificial and natural intelligence.


Selected Publications

Bidirectional Contrastive Split Learning for Visual Question Answering
Yuwei Sun, Hideya Ochiai
AAAI 2024
PDF | BibTex | Poster | Slides | Video | Code

Associative Transformer is a Sparse Representation Learner
Yuwei Sun, Hideya Ochiai, Zhirong Wu, Stephen Lin, Ryota Kanai
NeurIPS 2023 Associative Memory & Hopfield Networks workshop (Oral)
PDF | BibTex | Poster | Slides | Video

Attacking Distance-aware Attack: Semi-targeted Model Poisoning on Federated Learning
Yuwei Sun, Hideya Ochiai, Jun Sakuma
IEEE Transactions on Artificial Intelligence 2023
PDF | BibTex | Code

Meta Learning in Decentralized Neural Networks: Towards More General AI
Yuwei Sun
AAAI 2023 Doctoral Consortium (Oral)
Mentor: Felipe Meneguzzi
PDF | BibTex | Poster | Slides | Video

Feature Distribution Matching for Federated Domain Generalization
Yuwei Sun, Ng Chong, Hideya Ochiai
ACML 2022 (Oral)
PDF | BibTex | Code | Poster | Video

Semi-Targeted Model Poisoning Attack on Federated Learning via Backward Error Analysis
Yuwei Sun, Hideya Ochiai, Jun Sakuma
IJCNN 2022 (Oral)
PDF | BibTex | Code

Homogeneous Learning: Self-Attention Decentralized Deep Learning
Yuwei Sun, Hideya Ochiai
IEEE Access 2022
PDF | BibTex | Code

Decentralized Deep Learning for Multi-Access Edge Computing: A Survey on Communication Efficiency and Trustworthiness
Yuwei Sun, Hideya Ochiai, Hiroshi Esaki
IEEE Transactions on Artificial Intelligence 2022
PDF | BibTex | Resource

Adaptive Intrusion Detection in the Networking of Large-Scale LANs with Segmented Federated Learning
Yuwei Sun, Hideya Ochiai, Hiroshi Esaki
IEEE Open Journal of the Communications Society 2020
PDF | BibTex | Video | Code

Intrusion Detection with Segmented Federated Learning for Large-Scale Multiple LANs
Yuwei Sun, Hideya Ochiai, Hiroshi Esaki
IJCNN 2020 (Oral)
PDF | BibTex | Video | Code


Talks


Academic Service


Awards and Honors