English
Related papers

Related papers: Exploiting Shared Representations for Personalized…

200 papers

Federated Learning (FL) has emerged as a groundbreaking distributed learning paradigm enabling clients to train a global model collaboratively without exchanging data. Despite enhancing privacy and efficiency in information retrieval and…

Machine Learning · Computer Science 2024-10-30 Long Tan Le , Tuan Dung Nguyen , Tung-Anh Nguyen , Choong Seon Hong , Suranga Seneviratne , Wei Bao , Nguyen H. Tran

This paper formulates and studies a novel algorithm for federated learning from large collections of local datasets. This algorithm capitalizes on an intrinsic network structure that relates the local datasets via an undirected "empirical"…

Machine Learning · Computer Science 2020-10-28 Y. Sarcheshmehpour , M. Leinonen , A. Jung

The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more or less the different explanatory factors of variation behind…

Machine Learning · Computer Science 2014-04-24 Yoshua Bengio , Aaron Courville , Pascal Vincent

Federated learning (FL) allows multiple clients to collectively train a high-performance global model without sharing their private data. However, the key challenge in federated learning is that the clients have significant statistical…

Machine Learning · Computer Science 2022-03-23 Liang Gao , Huazhu Fu , Li Li , Yingwen Chen , Ming Xu , Cheng-Zhong Xu

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

Machine Learning · Computer Science 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

Federated learning has received great attention for its capability to train a large-scale model in a decentralized manner without needing to access user data directly. It helps protect the users' private data from centralized collecting.…

Machine Learning · Computer Science 2023-02-07 Guodong Long , Ming Xie , Tao Shen , Tianyi Zhou , Xianzhi Wang , Jing Jiang , Chengqi Zhang

Federated graph learning (FGL) has become an important research topic in response to the increasing scale and the distributed nature of graph-structured data in the real world. In FGL, a global graph is distributed across different clients,…

Machine Learning · Computer Science 2024-08-27 Binchi Zhang , Minnan Luo , Shangbin Feng , Ziqi Liu , Jun Zhou , Qinghua Zheng

We propose a federated methodology to learn low-dimensional representations from a dataset that is distributed among several clients. In particular, we move away from the commonly-used cross-entropy loss in federated learning, and seek to…

Machine Learning · Computer Science 2022-10-04 Juan Cervino , Navid NaderiAlizadeh , Alejandro Ribeiro

With the tremendous success of deep learning in visual tasks, the representations extracted from intermediate layers of learned models, that is, deep features, attract much attention of researchers. Previous empirical analysis shows that…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Qi Qian , Juhua Hu , Hao Li

Federated learning (FL) is an appealing concept to perform distributed training of Neural Networks (NN) while keeping data private. With the industrialization of the FL framework, we identify several problems hampering its successful…

Machine Learning · Computer Science 2020-11-13 Lixuan Yang , Cedric Beliard , Dario Rossi

Unsupervised dimensionality reduction is one of the commonly used techniques in the field of high dimensional data recognition problems. The deep autoencoder network which constrains the weights to be non-negative, can learn a low…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Anyong Qin , Zhaowei Shang , Zhuolin Tan , Taiping Zhang , Yuan Yan Tang

In federated learning, communication cost is often a critical bottleneck to scale up distributed optimization algorithms to collaboratively learn a model from millions of devices with potentially unreliable or limited communication and…

Machine Learning · Computer Science 2020-11-24 Farzin Haddadpour , Mohammad Mahdi Kamani , Aryan Mokhtari , Mehrdad Mahdavi

Real-world data is usually segmented by attributes and distributed across different parties. Federated learning empowers collaborative training without exposing local data or models. As we demonstrate through designed attacks, even with a…

Machine Learning · Computer Science 2021-04-30 Shuang Zhang , Liyao Xiang , Xi Yu , Pengzhi Chu , Yingqi Chen , Chen Cen , Li Wang

In recent years, data and computing resources are typically distributed in the devices of end users, various regions or organizations. Because of laws or regulations, the distributed data and computing resources cannot be directly shared…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-28 Ji Liu , Jizhou Huang , Yang Zhou , Xuhong Li , Shilei Ji , Haoyi Xiong , Dejing Dou

Quantum federated learning has brought about the improvement of privacy image classification, while the lack of personality of the client model may contribute to the suboptimal of quantum federated learning. A personalized quantum federated…

Quantum Physics · Physics 2024-10-04 Jinjing Shi , Tian Chen , Shichao Zhang , Xuelong Li

Federated Learning is an emerging privacy-preserving distributed machine learning approach to building a shared model by performing distributed training locally on participating devices (clients) and aggregating the local models into a…

Machine Learning · Computer Science 2021-04-15 Sreya Francis , Irene Tenison , Irina Rish

Federated learning (FL) is a distributed machine learning approach involving multiple clients collaboratively training a shared model. Such a system has the advantage of more training data from multiple clients, but data can be…

Machine Learning · Computer Science 2021-08-24 Sone Kyaw Pye , Han Yu

We present PeFLL, a new personalized federated learning algorithm that improves over the state-of-the-art in three aspects: 1) it produces more accurate models, especially in the low-data regime, and not only for clients present during its…

Machine Learning · Computer Science 2025-01-17 Jonathan Scott , Hossein Zakerinia , Christoph H. Lampert

Chemistry research has both high material and computational costs to conduct experiments. Institutions thus consider chemical data to be valuable and there have been few efforts to construct large public datasets for machine learning.…

Machine Learning · Computer Science 2022-05-10 Wei Zhu , Jiebo Luo , Andrew White

Federated learning aims to train models collaboratively across different clients without the sharing of data for privacy considerations. However, one major challenge for this learning paradigm is the {\em data heterogeneity} problem, which…

Machine Learning · Computer Science 2024-04-09 Yujun Shi , Jian Liang , Wenqing Zhang , Vincent Y. F. Tan , Song Bai