English
Related papers

Related papers: Communication-Efficient Distributed Training for C…

200 papers

This paper investigates reinforcement learning with constraints, which are indispensable in safety-critical environments. To drive the constraint violation monotonically decrease, we take the constraints as Lyapunov functions and impose new…

Machine Learning · Computer Science 2021-05-07 Chuangchuang Sun , Dong-Ki Kim , Jonathan P. How

We study distributed training of deep learning models in time-constrained environments. We propose a new algorithm that periodically pulls workers towards the center variable computed as a weighted average of workers, where the weights are…

Machine Learning · Computer Science 2024-03-08 Tolga Dimlioglu , Anna Choromanska

Efficient sampling from un-normalized target distributions is pivotal in scientific computing and machine learning. While neural samplers have demonstrated potential with a special emphasis on sampling efficiency, existing neural implicit…

Machine Learning · Computer Science 2024-11-05 Weijian Luo , Wei Deng

Domain Generalization (DG) aims to generalize to arbitrary unseen domains. A promising approach to improve model generalization in DG is the identification of flat minima. One typical method for this task is SWAD, which involves averaging…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to the large memory and computing requirements. Distributed GNN training, where the graph is partitioned across multiple machines, is a common approach to…

Machine Learning · Computer Science 2024-06-26 Juan Cervino , Md Asadullah Turja , Hesham Mostafa , Nageen Himayat , Alejandro Ribeiro

In federated distributed learning, the goal is to optimize a global training objective defined over distributed devices, where the data shard at each device is sampled from a possibly different distribution (a.k.a., heterogeneous or non…

Machine Learning · Computer Science 2019-12-10 Farzin Haddadpour , Mehrdad Mahdavi

Deep neural network (DNN) models are effective solutions for industry 4.0 applications (\eg oil spill detection, fire detection, anomaly detection). However, training a DNN network model needs a considerable amount of data collected from…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-25 Razin Farhan Hussain , Mohsen Amini Salehi

This paper proposes a new mean-field framework for over-parameterized deep neural networks (DNNs), which can be used to analyze neural network training. In this framework, a DNN is represented by probability measures and functions over its…

Machine Learning · Statistics 2020-07-06 Cong Fang , Jason D. Lee , Pengkun Yang , Tong Zhang

The backpropagation networks are notably susceptible to catastrophic forgetting, where networks tend to forget previously learned skills upon learning new ones. To address such the 'sensitivity-stability' dilemma, most previous efforts have…

Machine Learning · Computer Science 2021-10-12 Danruo Deng , Guangyong Chen , Jianye Hao , Qiong Wang , Pheng-Ann Heng

As a prevalent distributed learning paradigm, Federated Learning (FL) trains a global model on a massive amount of devices with infrequent communication. This paper investigates a class of composite optimization and statistical recovery…

Machine Learning · Computer Science 2022-10-04 Yajie Bao , Michael Crawshaw , Shan Luo , Mingrui Liu

Deep neural networks (DNNs) are state-of-the-art solutions for many machine learning applications, and have been widely used on mobile devices. Running DNNs on resource-constrained mobile devices often requires the help from edge servers…

Networking and Internet Architecture · Computer Science 2019-03-11 Wenqi Shi , Yunzhong Hou , Sheng Zhou , Zhisheng Niu , Yang Zhang , Lu Geng

Deep neural networks (DNNs) play an important role in machine learning due to its outstanding performance compared to other alternatives. However, DNNs are not suitable for safety-critical applications since DNNs can be easily fooled by…

Machine Learning · Computer Science 2021-03-26 Zhixin Pan , Prabhat Mishra

Communication overhead is a known bottleneck in federated learning (FL). To address this, lossy compression is commonly used on the information communicated between the server and clients during training. In horizontal FL, where each client…

Machine Learning · Computer Science 2025-02-25 Pedro Valdeira , João Xavier , Cláudia Soares , Yuejie Chi

Distributed and federated learning algorithms and techniques associated primarily with minimization problems. However, with the increase of minimax optimization and variational inequality problems in machine learning, the necessity of…

Optimization and Control · Mathematics 2024-06-04 Siqi Zhang , Sayantan Choudhury , Sebastian U Stich , Nicolas Loizou

To defend the inference attacks and mitigate the sensitive information leakages in Federated Learning (FL), client-level Differentially Private FL (DPFL) is the de-facto standard for privacy protection by clipping local updates and adding…

Machine Learning · Computer Science 2023-06-27 Yifan Shi , Yingqi Liu , Kang Wei , Li Shen , Xueqian Wang , Dacheng Tao

Federated learning (FL) can lead to significant communication overhead and reliance on a central server. To address these challenges, decentralized federated learning (DFL) has been proposed as a more resilient framework. DFL involves…

Machine Learning · Computer Science 2023-08-15 Zhigang Yan , Dong Li

Communication-reduction techniques are a popular way to improve scalability in data-parallel training of deep neural networks (DNNs). The recent emergence of large language models such as GPT has created the need for new approaches to…

Machine Learning · Computer Science 2023-02-07 Ilia Markov , Adrian Vladu , Qi Guo , Dan Alistarh

The emerging machine learning paradigm of decentralized federated learning (DFL) has the promise of greatly boosting the deployment of artificial intelligence (AI) by directly learning across distributed agents without centralized…

Machine Learning · Computer Science 2024-08-12 Yudi Huang , Tingyang Sun , Ting He

We design a low complexity decentralized learning algorithm to train a recently proposed large neural network in distributed processing nodes (workers). We assume the communication network between the workers is synchronized and can be…

Machine Learning · Computer Science 2020-09-30 Xinyue Liang , Alireza M. Javid , Mikael Skoglund , Saikat Chatterjee

Federated Learning (FL), as a distributed learning paradigm, trains models over distributed clients' data. FL is particularly beneficial for distributed training of Diffusion Models (DMs), which are high-quality image generators that…

Machine Learning · Computer Science 2025-07-10 Qianyu Long , Qiyuan Wang , Christos Anagnostopoulos , Daning Bi
‹ Prev 1 3 4 5 6 7 10 Next ›