中文
相关论文

相关论文: FedNAR: Federated Optimization with Normalized Ann…

200 篇论文

Federated learning (FL) faces persistent robustness challenges due to non-IID data distributions and adversarial client behavior. A promising mitigation strategy is contribution evaluation, which enables adaptive aggregation by quantifying…

机器学习 · 计算机科学 2025-10-01 Guojun Tang , Jiayu Zhou , Mohammad Mamun , Steve Drew

Federated learning (FL) is a privacy-preserving machine learning setting that enables many devices to jointly train a shared global model without the need to reveal their data to a central server. However, FL involves a frequent exchange of…

机器学习 · 计算机科学 2021-10-07 Yuzhi Yang , Zhaoyang Zhang , Qianqian Yang

Regularization is a fundamental technique to prevent over-fitting and to improve generalization performances by constraining a model's complexity. Current Deep Networks heavily rely on regularizers such as Data-Augmentation (DA) or…

机器学习 · 计算机科学 2022-04-12 Randall Balestriero , Leon Bottou , Yann LeCun

In the realm of EEG decoding, enhancing the performance of artificial neural networks (ANNs) carries significant potential. This study introduces a novel approach, termed "weight freezing", that is anchored on the principles of ANN…

机器学习 · 计算机科学 2023-06-13 Zhengqing Miao , Meirong Zhao

Modern optimizers such as AdamW, equipped with momentum and adaptive learning rate, are designed to escape local minima and explore the vast parameter space. This exploration is beneficial for finding good loss basins when training from…

机器学习 · 计算机科学 2024-11-05 Junjiao Tian , Chengyue Huang , Zsolt Kira

Federated learning faces huge challenges from model overfitting due to the lack of data and statistical diversity among clients. To address these challenges, this paper proposes a novel personalized federated learning method via Bayesian…

机器学习 · 计算机科学 2022-06-17 Xu Zhang , Yinchuan Li , Wenpeng Li , Kaiyang Guo , Yunfeng Shao

We propose a novel regularization method, called \textit{volumization}, for neural networks. Inspired by physics, we define a physical volume for the weight parameters in neural networks, and we show that this method is an effective way of…

机器学习 · 计算机科学 2020-04-02 Liu Ziyin , Zihao Wang , Makoto Yamada , Masahito Ueda

In this paper, we propose a novel layer-adaptive weight-pruning approach for Deep Neural Networks (DNNs) that addresses the challenge of optimizing the output distortion minimization while adhering to a target pruning ratio constraint. Our…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Kaixin Xu , Zhe Wang , Xue Geng , Jie Lin , Min Wu , Xiaoli Li , Weisi Lin

Current medical image classification efforts mainly aim for higher average performance, often neglecting the balance between different classes. This can lead to significant differences in recognition accuracy between classes and obvious…

图像与视频处理 · 电气工程与系统科学 2024-06-26 Peng Huang , Shu Hu , Bo Peng , Jiashu Zhang , Xi Wu , Xin Wang

In neural networks, developing regularization algorithms to settle overfitting is one of the major study areas. We propose a new approach for the regularization of neural networks by the local Rademacher complexity called LocalDrop. A new…

机器学习 · 计算机科学 2021-03-02 Ziqing Lu , Chang Xu , Bo Du , Takashi Ishida , Lefei Zhang , Masashi Sugiyama

Meta federated learning (FL) is a personalized variant of FL, where multiple agents collaborate on training an initial shared model without exchanging raw data samples. The initial model should be trained in a way that current or new agents…

机器学习 · 计算机科学 2025-05-14 Mohammad Vahid Jamali , Hamid Saber , Jung Hyun Bae

Federated learning (FL) is capable of performing large distributed machine learning tasks across multiple edge users by periodically aggregating trained local parameters. To address key challenges of enabling FL over a wireless fog-cloud…

机器学习 · 计算机科学 2024-10-28 Van-Dinh Nguyen , Symeon Chatzinotas , Bjorn Ottersten , Trung Q. Duong

Decentralized federated learning (DFL) uses peer-to-peer communication to avoid the single point of failure problem in federated learning and has been considered an attractive solution for machine learning tasks on distributed devices. We…

分布式、并行与集群计算 · 计算机科学 2024-09-10 Yifan Hua , Jinlong Pang , Xiaoxue Zhang , Yi Liu , Xiaofeng Shi , Bao Wang , Yang Liu , Chen Qian

Federated learning (FL) is a distributed model training paradigm that preserves clients' data privacy. It has gained tremendous attention from both academia and industry. FL hyper-parameters (e.g., the number of selected clients and the…

机器学习 · 计算机科学 2022-11-28 Huanle Zhang , Lei Fu , Mi Zhang , Pengfei Hu , Xiuzhen Cheng , Prasant Mohapatra , Xin Liu

Conventional matrix completion methods approximate the missing values by assuming the matrix to be low-rank, which leads to a linear approximation of missing values. It has been shown that enhanced performance could be attained by using…

信息论 · 计算机科学 2024-03-18 Sajad Faramarzi , Farzan Haddadi , Sajjad Amini , Masoud Ahookhosh

Federated Learning (FL) is a rising approach towards collaborative and privacy-preserving machine learning where large-scale medical datasets remain localized to each client. However, the issue of data heterogeneity among clients often…

机器学习 · 计算机科学 2024-10-01 Shuang Zeng , Pengxin Guo , Shuai Wang , Jianbo Wang , Yuyin Zhou , Liangqiong Qu

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

机器学习 · 计算机科学 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

To defend the inference attacks and mitigate the sensitive information leakages in Federated Learning (FL), client-level Differentially Private FL (DPFL) is the de-facto standard for privacy protection by clipping local updates and adding…

机器学习 · 计算机科学 2023-05-03 Yifan Shi , Kang Wei , Li Shen , Yingqi Liu , Xueqian Wang , Bo Yuan , Dacheng Tao

It is critical for robots to explore Federated Learning (FL) settings where several robots, deployed in parallel, can learn independently while also sharing their learning with each other. This collaborative learning in real-world…

机器人学 · 计算机科学 2025-02-24 Nikhil Churamani , Saksham Checker , Fethiye Irmak Dogan , Hao-Tien Lewis Chiang , Hatice Gunes

Federated learning (FL) enables collaborative model training across institutions without sharing sensitive data, making it an attractive solution for medical imaging tasks. However, traditional FL methods, such as Federated Averaging…