English
Related papers

Related papers: Federated Representation Learning via Maximal Codi…

200 papers

To learn intrinsic low-dimensional structures from high-dimensional data that most discriminate between classes, we propose the principle of Maximal Coding Rate Reduction ($\text{MCR}^2$), an information-theoretic measure that maximizes the…

Machine Learning · Computer Science 2020-06-16 Yaodong Yu , Kwan Ho Ryan Chan , Chong You , Chaobing Song , Yi Ma

Federated Learning (FL) enables decentralised model training across distributed clients without requiring data centralisation. However, the generalisation performance of the global model is usually degraded by data heterogeneity across…

Machine Learning · Computer Science 2026-05-11 Ozgu Goksu , Nicolas Pugeault

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be…

Machine Learning · Computer Science 2023-03-28 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

Dimensionality Reduction is a commonly used element in a machine learning pipeline that helps to extract important features from high-dimensional data. In this work, we explore an alternative federated learning system that enables…

Machine Learning · Computer Science 2020-11-16 Anna Bogdanova , Akie Nakai , Yukihiko Okada , Akira Imakura , Tetsuya Sakurai

Representation learning is a widely adopted framework for learning in data-scarce environments to obtain a feature extractor or representation from various different yet related tasks. Despite extensive research on representation learning,…

Machine Learning · Computer Science 2025-12-30 Donghwa Kang , Shana Moothedath

Federated learning is an emerging technique used to prevent the leakage of private information. Unlike centralized learning that needs to collect data from users and store them collectively on a cloud server, federated learning makes it…

Machine Learning · Computer Science 2019-06-11 Hangyu Zhu , Yaochu Jin

Federated Learning (FL) is a framework which enables distributed model training using a large corpus of decentralized training data. Existing methods aggregate models disregarding their internal representations, which are crucial for…

Machine Learning · Computer Science 2021-05-20 Umberto Michieli , Mete Ozay

Federated representation learning (FRL) aims to learn personalized federated models with effective feature extraction from local data. FRL algorithms that share the majority of the model parameters face significant challenges with huge…

Machine Learning · Computer Science 2024-10-15 Haolin Yu , Guojun Zhang , Pascal Poupart

Federated learning (FL) is a distributed learning framework that leverages commonalities between distributed client datasets to train a global model. Under heterogeneous clients, however, FL can fail to produce stable training results.…

Machine Learning · Computer Science 2024-11-04 Connor J. Mclaughlin , Lili Su

In this letter, we formulate a compositional distributed learning framework for multi-view perception by leveraging the maximal coding rate reduction principle combined with subspace basis fusion. In the proposed algorithm, each agent…

Image and Video Processing · Electrical Eng. & Systems 2025-11-13 Zhuojun Tian , Mehdi Bennis

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

Federated learning (FL) is a promising and powerful approach for training deep learning models without sharing the raw data of clients. During the training process of FL, the central server and distributed clients need to exchange a vast…

Machine Learning · Computer Science 2021-04-27 Zhefeng Qiao , Xianghao Yu , Jun Zhang , Khaled B. Letaief

Federated learning is a distributed machine learning approach in which clients train models locally with their own data and upload them to a server so that their trained results are shared between them without uploading raw data to the…

Machine Learning · Computer Science 2023-09-07 Yuto Hoshino , Hiroki Kawakami , Hiroki Matsutani

Learning image representations on decentralized data can bring many benefits in cases where data cannot be aggregated across data silos. Softmax cross entropy loss is highly effective and commonly used for learning image representations.…

Machine Learning · Computer Science 2022-03-10 Sagar M. Waghmare , Hang Qi , Huizhong Chen , Mikhail Sirotenko , Tomer Meron

Federated learning (FL) achieves collaborative learning without the need for data sharing, thus preventing privacy leakage. To extend FL into a fully decentralized algorithm, researchers have applied distributed optimization algorithms to…

Networking and Internet Architecture · Computer Science 2023-12-20 Akihito Taya , Yuuki Nishiyama , Kaoru Sezaki

The principle of Maximal Coding Rate Reduction (MCR$^2$) has recently been proposed as a training objective for learning discriminative low-dimensional structures intrinsic to high-dimensional data to allow for more robust training than…

Machine Learning · Computer Science 2022-04-04 Christina Baek , Ziyang Wu , Kwan Ho Ryan Chan , Tianjiao Ding , Yi Ma , Benjamin D. Haeffele

Federated Learning (FL) has shown great potential as a privacy-preserving solution to learning from decentralized data that are only accessible to end devices (i.e., clients). In many scenarios, however, a large proportion of the clients…

Machine Learning · Computer Science 2022-01-31 Wentai Wu , Ligang He , Weiwei Lin , Carsten Maple

Federated learning is a distributed machine learning framework which enables different parties to collaboratively train a model while protecting data privacy and security. Due to model complexity, network unreliability and connection…

Machine Learning · Computer Science 2020-04-08 Anbu Huang , Yuanyuan Chen , Yang Liu , Tianjian Chen , Qiang Yang

Federated learning is a method of training models on private data distributed over multiple devices. To keep device data private, the global model is trained by only communicating parameters and updates which poses scalability challenges…

Federated learning (FL) as a promising edge-learning framework can effectively address the latency and privacy issues by featuring distributed learning at the devices and model aggregation in the central server. In order to enable efficient…

Information Theory · Computer Science 2022-07-12 Chunmei Xu , Shengheng Liu , Zhaohui Yang , Yongming Huang , Kai-Kit Wong
‹ Prev 1 2 3 10 Next ›