学术报告 | Federated Learning: Privacy, Efficiency, and Robustness

浙江大学网络空间安全学院

学术报告

  摘 要  

    Federated learning (FL) has received increasing attention in both industry and academia by enabling multiple clients (e.g., mobile devices or institutions) to jointly train machine learning models while keeping data at local clients. There are several well-recognized challenges including: 1) privacy: while FL avoids direct exchange of the local data, the model updates being exchanged could still be used to infer sensitive information of the local data, 2) communication efficiency: the multi-round high-dimensional model updates often incur significant communication overhead, 3) robustness: the training is vulnerable to Byzantine failures and adversarial attacks of the clients such as data poisoning and label flipping attacks.

    In this talk, I will present several of our recent works addressing these challenges including: 1) Projected Federated Averaging (PFA), which optimizes model utility while ensuring formal differential privacy of the model updates given heterogeneous privacy requirements of clients and minimizing communication cost (VLDB ’22), 2) Federated Pruning, which trains a reduced model to reduce communication overhead while maintaining similar performance compared to the full model (INTERSPEECH ’22), 3) Robust Aggregation (RobustFed), a truth inference approach inspired from crowdsourcing for robust federated learning that learns and incorporates clients’ reliability into model aggregation (CIKM ’22). I will conclude by discussing open directions that explore the synergy among these three challenges. 

  报告人简介  

Li Xiong is a Professor of Computer Science and Biomedical Informatics at Emory University. She held a Winship Distinguished Research Professorship from 2015-2018. She has a Ph.D. from Georgia Institute of Technology, an MS from Johns Hopkins University, and a BS from the University of Science and Technology of China. She and her research lab, Assured Information Management and Sharing (AIMS), conduct research on the intersection of data management, machine learning, and data privacy and security. She has published over 170 papers and received six best paper or runner up awards. She has served and serves as associate editor for IEEE TKDE, VLDBJ, IEEE TDSC, general or program co-chairs for ACM CIKM 2022, IEEE BigData 2020, and ACM SIGSPATIAL 2018, 2020. Her research has been supported by National Science Foundation (NSF), AFOSR (Air Force Office of Scientific Research), National Institute of Health (NIH), and Patient-Centered Outcomes Research Institute (PCORI). She is also a recipient of Google Research Award, IBM Smarter Healthcare Faculty Innovation Award, Cisco Research Awards, AT&T Research Gift, and Woodrow Wilson Career Enhancement Fellowship.  She is an IEEE fellow. More details are at http://www. cs.emory.edu/~lxiong.