English
Related papers

Related papers: Efficiently Assemble Normalization Layers and Regu…

200 papers

Batch Normalization (BN) is widely used in {centralized} deep learning to improve convergence and generalization. However, in {federated} learning (FL) with decentralized data, prior work has observed that training with BN could hinder…

Machine Learning · Computer Science 2024-04-01 Jike Zhong , Hong-You Chen , Wei-Lun Chao

Domain generalization (DG) aims to train a model to perform well in unseen domains under different distributions. This paper considers a more realistic yet more challenging scenario,namely Single Domain Generalization (Single-DG), where…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Jiajin Zhang , Hanqing Chao , Amit Dhurandhar , Pin-Yu Chen , Ali Tajer , Yangyang Xu , Pingkun Yan

Due to the highly sensitive nature of certain data in cross-border sharing, collaborative cross-border recommendations and data sharing are often subject to stringent privacy protection regulations, resulting in insufficient data for model…

Machine Learning · Computer Science 2025-05-27 Zhizhong Tan , Jiexin Zheng , Xingxing Yang , Chi Zhang , Weiping Deng , Wenyong Wang

Federated learning (FL) has attracted increasing attention in recent years. As a privacy-preserving collaborative learning paradigm, it enables a broader range of applications, especially for computer vision and natural language processing…

Machine Learning · Computer Science 2020-11-24 Yilun Lin , Chaochao Chen , Cen Chen , Li Wang

Federated learning (FL) is a distributed learning protocol in which a server needs to aggregate a set of models learned some independent clients to proceed the learning process. At present, model averaging, known as FedAvg, is one of the…

Machine Learning · Computer Science 2020-08-12 Kenta Nagura , Song Bian , Takashi Sato

Federated Learning is an emerging learning paradigm that allows training models from samples distributed across a large network of clients while respecting privacy and communication restrictions. Despite its success, federated learning…

Machine Learning · Computer Science 2022-06-07 Isidoros Tziotis , Zebang Shen , Ramtin Pedarsani , Hamed Hassani , Aryan Mokhtari

The distribution shifts between training and test data typically undermine the performance of models. In recent years, lots of work pays attention to domain generalization (DG) where distribution shifts exist, and target data are unseen.…

Machine Learning · Computer Science 2024-01-05 Wang Lu , Jindong Wang , Yidong Wang , Xing Xie

For deep learning applications, the massive data development (e.g., collecting, labeling), which is an essential process in building practical applications, still incurs seriously high costs. In this work, we propose an effective data…

Machine Learning · Statistics 2019-12-30 Shin'ya Yamaguchi , Sekitoshi Kanai , Takeharu Eda

Domain generalization (DG) aims to learn a generic model from multiple observed source domains that generalizes well to arbitrary unseen target domains without further training. The major challenge in DG is that the model inevitably faces a…

Machine Learning · Computer Science 2023-09-19 Jintao Guo , Lei Qi , Yinghuan Shi , Yang Gao

We propose a novel federated learning method for distributively training neural network models, where the server orchestrates cooperation between a subset of randomly chosen devices in each round. We view Federated Learning problem…

This paper introduces FedGenGMM, a novel one-shot federated learning approach for Gaussian Mixture Models (GMM) tailored for unsupervised learning scenarios. In federated learning (FL), where multiple decentralized clients collaboratively…

Machine Learning · Computer Science 2025-06-03 Sophia Zhang Pettersson , Kuo-Yun Liang , Juan Carlos Andresen

Due to escalating privacy concerns, federated learning has been recognized as a vital approach for training deep neural networks with decentralized medical data. In practice, it is challenging to ensure consistent imaging quality across…

Machine Learning · Computer Science 2024-12-19 Nannan Wu , Zhuo Kuang , Zengqiang Yan , Li Yu

Training a general-purpose time series foundation models with robust generalization capabilities across diverse applications from scratch is still an open challenge. Efforts are primarily focused on fusing cross-domain time series datasets…

Machine Learning · Computer Science 2024-12-13 Shengchao Chen , Guodong Long , Jing Jiang , Chengqi Zhang

Federated Object Detection (FOD) enables clients to collaboratively train a global object detection model without accessing their local data from diverse domains. However, significant variations in environment, weather, and other domain…

Machine Learning · Computer Science 2025-09-16 Haolin Yuan , Jingtao Li , Weiming Zhuang , Chen Chen , Lingjuan Lyu

Distribution shift presents a significant challenge in machine learning, where models often underperform during the test stage when faced with a different distribution than the one they were trained on. This paper focuses on domain shifts,…

Machine Learning · Computer Science 2024-03-19 Huaxiu Yao , Xinyu Yang , Xinyi Pan , Shengchao Liu , Pang Wei Koh , Chelsea Finn

Personalized Federated Learning (PFL) which collaboratively trains a federated model while considering local clients under privacy constraints has attracted much attention. Despite its popularity, it has been observed that existing PFL…

Machine Learning · Computer Science 2022-12-05 Tianchun Wang , Wei Cheng , Dongsheng Luo , Wenchao Yu , Jingchao Ni , Liang Tong , Haifeng Chen , Xiang Zhang

Data augmentation is one of the most effective techniques for regularizing deep learning models and improving their recognition performance in a variety of tasks and domains. However, this holds for standard in-domain settings, in which the…

Federated Learning (FL) enables collaborative model training across multiple clients without sharing their private data. However, data heterogeneity across clients leads to client drift, which degrades the overall generalization performance…

Machine Learning · Computer Science 2026-03-02 Alina Devkota , Jacob Thrasher , Donald Adjeroh , Binod Bhattarai , Prashnna K. Gyawali

Federated Learning (FL) is an emerging collaborative machine learning framework where multiple clients train the global model without sharing their own datasets. In FL, the model inconsistency caused by the local data heterogeneity across…

Machine Learning · Computer Science 2023-11-13 Xuming An , Li Shen , Han Hu , Yong Luo

Federated Learning (FL) seeks to distribute model training across local clients without collecting data in a centralized data-center, hence removing data-privacy concerns. A major challenge for FL is data heterogeneity (where each client's…

Machine Learning · Computer Science 2022-09-22 Junjiao Tian , James Seale Smith , Zsolt Kira