English
Related papers

Related papers: Federated Momentum Contrastive Clustering

200 papers

Federated learning (FL), as an emerging collaborative learning paradigm, has garnered significant attention due to its capacity to preserve privacy within distributed learning systems. In these systems, clients collaboratively train a…

Machine Learning · Computer Science 2024-05-29 Xi Zhu , Songcan Yu , Junbo Wang , Qinglin Yang

The federated learning (FL) framework enables edge clients to collaboratively learn a shared inference model while keeping privacy of training data on clients. Recently, many heuristics efforts have been made to generalize centralized…

Machine Learning · Computer Science 2022-07-18 Jiayin Jin , Jiaxiang Ren , Yang Zhou , Lingjuan Lyu , Ji Liu , Dejing Dou

Federated Continual Learning (FCL) has emerged as a promising paradigm that combines Federated Learning (FL) and Continual Learning (CL). To achieve good model accuracy, FCL needs to tackle catastrophic forgetting due to concept drift over…

Machine Learning · Computer Science 2023-11-14 Xiaopeng Jiang , Cristian Borcea

Federated learning (FL) allows collaborative machine learning training without sharing private data. While most FL methods assume identical data domains across clients, real-world scenarios often involve heterogeneous data domains.…

Machine Learning · Computer Science 2024-10-29 Lei Wang , Jieming Bian , Letian Zhang , Chen Chen , Jie Xu

In a wide range of multimodal tasks, contrastive learning has become a particularly appealing approach since it can successfully learn representations from abundant unlabeled data with only pairing information (e.g., image-caption or…

Machine Learning · Computer Science 2023-10-31 Paul Pu Liang , Zihao Deng , Martin Ma , James Zou , Louis-Philippe Morency , Ruslan Salakhutdinov

Medical image classification plays a crucial role in computer-aided clinical diagnosis. While deep learning techniques have significantly enhanced efficiency and reduced costs, the privacy-sensitive nature of medical imaging data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Sufen Ren , Yule Hu , Shengchao Chen , Guanjun Wang

As people pay more and more attention to privacy protection, Federated Learning (FL), as a promising distributed machine learning paradigm, is receiving more and more attention. However, due to the biased distribution of data on devices in…

Machine Learning · Computer Science 2023-02-27 Yuquan Zhang , Yongquan Zhang

Clustering is one of the most fundamental tasks in machine learning. Recently, deep clustering has become a major trend in clustering techniques. Representation learning often plays an important role in the effectiveness of deep clustering,…

Machine Learning · Computer Science 2021-06-02 Yaling Tao , Kentaro Takagi , Kouta Nakata

The Federated Learning setting has a central server coordinating the training of a model on a network of devices. One of the challenges is variable training performance when the dataset has a class imbalance. In this paper, we address this…

Machine Learning · Computer Science 2020-11-13 Dipankar Sarkar , Ankur Narang , Sumit Rai

We present a collaborative learning method called Mutual Contrastive Learning (MCL) for general visual representation learning. The core idea of MCL is to perform mutual interaction and transfer of contrastive distributions among a cohort…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Chuanguang Yang , Zhulin An , Linhang Cai , Yongjun Xu

Federated learning is a framework for distributed optimization that places emphasis on communication efficiency. In particular, it follows a client-server broadcast model and is particularly appealing because of its ability to accommodate…

Machine Learning · Computer Science 2022-03-30 Han Wang , Siddartha Marella , James Anderson

Federated learning (FL) has emerged as an important machine learning paradigm where a global model is trained based on the private data from distributed clients. However, most of existing FL algorithms cannot guarantee the performance…

Machine Learning · Computer Science 2022-02-17 Fengda Zhang , Kun Kuang , Yuxuan Liu , Long Chen , Chao Wu , Fei Wu , Jiaxun Lu , Yunfeng Shao , Jun Xiao

The goal of fair clustering is to find clusters such that the proportion of sensitive attributes (e.g., gender, race, etc.) in each cluster is similar to that of the entire dataset. Various fair clustering algorithms have been proposed that…

Machine Learning · Statistics 2026-02-26 Jinwon Park , Kunwoong Kim , Jihu Lee , Yongdai Kim

Contrastive learning is a representation learning method performed by contrasting a sample to other similar samples so that they are brought closely together, forming clusters in the feature space. The learning process is typically…

Machine Learning · Computer Science 2022-09-28 Valentino Vito , Lim Yohanes Stefanus

In Federated Learning (FL), forgetting, or the loss of knowledge across rounds, hampers algorithm convergence, particularly in the presence of severe data heterogeneity among clients. This study explores the nuances of this issue,…

Machine Learning · Computer Science 2024-02-09 Mohammed Aljahdali , Ahmed M. Abdelmoniem , Marco Canini , Samuel Horváth

Learning semantic-rich representations from raw unlabeled time series data is critical for downstream tasks such as classification and forecasting. Contrastive learning has recently shown its promising representation learning capability in…

Machine Learning · Computer Science 2023-03-31 Qianwen Meng , Hangwei Qian , Yong Liu , Lizhen Cui , Yonghui Xu , Zhiqi Shen

For early breast cancer detection, regular screening with mammography imaging is recommended. Routinary examinations result in datasets with a predominant amount of negative samples. A potential solution to such class-imbalance is joining…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Amelia Jiménez-Sánchez , Mickael Tardy , Miguel A. González Ballester , Diana Mateus , Gemma Piella

Federated Learning (FL) deals with learning a central model (i.e. the server) in privacy-constrained scenarios, where data are stored on multiple devices (i.e. the clients). The central model has no direct access to the data, but only to…

Machine Learning · Computer Science 2021-05-03 Debora Caldarola , Massimiliano Mancini , Fabio Galasso , Marco Ciccone , Emanuele Rodolà , Barbara Caputo

Federated Learning (FL) enables the multiple participating devices to collaboratively contribute to a global neural network model while keeping the training data locally. Unlike the centralized training setting, the non-IID, imbalanced…

Machine Learning · Computer Science 2024-04-16 Moming Duan , Duo Liu , Xinyuan Ji , Yu Wu , Liang Liang , Xianzhang Chen , Yujuan Tan

We investigate contrastive learning in the federated setting through the lens of SimCLR and multi-view mutual information maximization. In doing so, we uncover a connection between contrastive representation learning and user verification;…

Machine Learning · Computer Science 2024-05-06 Christos Louizos , Matthias Reisser , Denis Korzhenkov