English
Related papers

Related papers: A Communication-Efficient Distributed Algorithm fo…

200 papers

Online collaborative medical prediction platforms offer convenience and real-time feedback by leveraging massive electronic health records. However, growing concerns about privacy and low prediction quality can deter patient participation…

Machine Learning · Computer Science 2025-07-16 Shao-Bo Lin , Xiaotong Liu , Yao Wang

In this paper, we consider consensus problems over a network of nodes, where the network is divided into a number of clusters. We are interested in the case where the communication topology within each cluster is dense as compared to the…

Systems and Control · Electrical Eng. & Systems 2021-08-27 Thiem V. Pham , Thinh T. Doan , Dinh Hoa Nguyen

Distributed optimization and learning algorithms are designed to operate over large scale networks enabling processing of vast amounts of data effectively and efficiently. One of the main challenges for ensuring a smooth learning process in…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Apostolos I. Rikos , Nicola Bastianello , Themistoklis Charalambous , Karl H. Johansson

Distributed aggregative optimization methods are gaining increased traction due to their ability to address cooperative control and optimization problems, where the objective function of each agent depends not only on its own decision…

Multiagent Systems · Computer Science 2025-06-03 Ziqin Chen , Magnus Egerstedt , Yongqiang Wang

Distributed algorithms and theories are called for in this era of big data. Under weaker local signal-to-noise ratios, we improve upon the celebrated one-round distributed principal component analysis (PCA) algorithm designed in the spirit…

Methodology · Statistics 2025-07-01 ZeYu Li , Xinsheng Zhang , Wang Zhou

We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic…

Optimization and Control · Mathematics 2021-08-04 Jinming Xu , Ye Tian , Ying Sun , Gesualdo Scutari

The increased availability of massive data sets provides a unique opportunity to discover subtle patterns in their distributions, but also imposes overwhelming computational challenges. To fully utilize the information contained in big…

Statistics Theory · Mathematics 2018-04-12 Stanislav Volgushev , Shih-Kang Chao , Guang Cheng

Distributed computing platforms provide a robust mechanism to perform large-scale computations by splitting the task and data among multiple locations, possibly located thousands of miles apart geographically. Although such distribution of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-24 Alok Singh , Eric Stephan , Malachi Schram , Ilkay Altintas

It seems as though progressively more people are in the race to upload content, data, and information online; and hospitals haven't neglected this trend either. Hospitals are now at the forefront for multi-site medical data sharing to…

Machine Learning · Computer Science 2022-02-23 Yoo Jeong Ha , Gusang Lee , Minjae Yoo , Soyi Jung , Seehwan Yoo , Joongheon Kim

We study the distributed average consensus problem in multi-agent systems with directed communication links that are subject to quantized information flow. The goal of distributed average consensus is for the nodes, each associated with…

Systems and Control · Electrical Eng. & Systems 2019-07-26 Apostolos I. Rikos , Christoforos N. Hadjicostis

We propose a distributed method for simultaneous inference for datasets with sample size much larger than the number of covariates, i.e., N >> p, in the generalized linear models framework. When such datasets are too big to be analyzed…

Methodology · Statistics 2020-07-23 Lu Tang , Ling Zhou , Peter X. -K. Song

Modern cities are increasingly reliant on data-driven insights to support decision making in areas such as transportation, public safety and environmental impact. However, city-level data often exists in heterogeneous formats, collected…

Machine Learning · Computer Science 2025-12-15 Takuya Kurihana , Xiaojian Zhang , Wing Yee Au , Hon Yung Wong

The rapid growth of wearable sensor technologies holds substantial promise for the field of personalized and context-aware Human Activity Recognition. Given the inherently decentralized nature of data sources within this domain, the…

Signal Processing · Electrical Eng. & Systems 2023-11-09 Ahmad Esmaeili , Zahra Ghorrati , Eric T. Matson

Distributed deep learning (DL) has become prevalent in recent years to reduce training time by leveraging multiple computing devices (e.g., GPUs/TPUs) due to larger models and datasets. However, system scalability is limited by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-04 Zhenheng Tang , Shaohuai Shi , Wei Wang , Bo Li , Xiaowen Chu

In this paper we study the distributed average consensus problem in multi-agent systems with directed communication links that are subject to quantized information flow. Specifically, we present and analyze a distributed averaging algorithm…

Systems and Control · Electrical Eng. & Systems 2021-03-10 Apostolos I. Rikos , Christoforos N. Hadjicostis , Karl H. Johansson

Motivated by sensor networks and other distributed settings, several models for distributed learning are presented. The models differ from classical works in statistical pattern recognition by allocating observations of an independent and…

Information Theory · Computer Science 2016-11-18 Joel B. Predd , Sanjeev R. Kulkarni , H. Vincent Poor

The robustness of distributed systems is usually phrased in terms of the number of failures of certain types that they can withstand. However, these failure models are too crude to describe the different kinds of trust and expectations of…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-11 Isaac C. Sheff , Robbert van Renesse , Andrew C. Myers

The use of high-dimensional data for targeted therapeutic interventions requires new ways to characterize the heterogeneity observed across subgroups of a specific population. In particular, models for partially exchangeable data are needed…

Methodology · Statistics 2020-08-18 Francesco Denti , Federico Camerlenghi , Michele Guindani , Antonietta Mira

The federated learning paradigm is wellsuited for the field of medical image analysis, as it can effectively cope with machine learning on isolated multicenter data while protecting the privacy of participating parties. However, current…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zhekai Zhou , Guibo Luo , Mingzhi Chen , Zhenyu Weng , Yuesheng Zhu

There are situations where data relevant to a machine learning problem are distributed among multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. For example, data present in users'…

Machine Learning · Computer Science 2020-08-27 Dimitris Stripelis , Jose Luis Ambite