English
Related papers

Related papers: A Communication-Efficient Distributed Algorithm fo…

200 papers

Classical paradigms for distributed learning, such as federated or decentralized gradient descent, employ consensus mechanisms to enforce homogeneity among agents. While these strategies have proven effective in i.i.d. scenarios, they can…

Machine Learning · Computer Science 2023-04-18 Shreya Wadehra , Roula Nassif , Stefan Vlaski

Heterogeneous, interconnected, systems-level, molecular data have become increasingly available and key in precision medicine. We need to utilize them to better stratify patients into risk groups, discover new biomarkers and targets,…

Other Quantitative Biology · Quantitative Biology 2024-05-17 Natasa Przulj , Noel Malod-Dognin

We consider statistical inference for a finite-dimensional parameter in a regular semiparametric model under a distributed setting with blockwise missingness, where entire blocks of variables are unavailable at certain sites and sharing…

Methodology · Statistics 2025-08-26 Jingyue Huang , Huiyuan Wang , Yuqing Lei , Yong Chen

We propose communication-efficient distributed estimation and inference methods for the transelliptical graphical model, a semiparametric extension of the elliptical distribution in the high dimensional regime. In detail, the proposed…

Machine Learning · Statistics 2016-12-30 Pan Xu , Lu Tian , Quanquan Gu

This paper studies Dictionary Learning problems wherein the learning task is distributed over a multi-agent network, modeled as a time-varying directed graph. This formulation is relevant, for instance, in Big Data scenarios where massive…

Optimization and Control · Mathematics 2019-03-06 Amir Daneshmand , Ying Sun , Gesualdo Scutari , Francisco Facchinei , Brian M. Sadler

Classical distributed estimation scenarios typically assume timely and reliable exchanges of information over the sensor network. This paper, in contrast, considers single time-scale distributed estimation via a sensor network subject to…

Systems and Control · Electrical Eng. & Systems 2021-09-08 Mohammadreza Doostmohammadian , Usman A. Khan , Mohammad Pirani , Themistoklis Charalambous

Adaptive networks are suitable for decentralized inference tasks, e.g., to monitor complex natural phenomena. Recent research works have intensively studied distributed optimization problems in the case where the nodes have to estimate a…

Multiagent Systems · Computer Science 2023-07-19 Jie Chen , Cédric Richard , Ali. H. Sayed

Collaboration between different data centers is often challenged by heterogeneity across sites. To account for the heterogeneity, the state-of-the-art method is to re-weight the covariate distributions in each site to match the distribution…

Machine Learning · Statistics 2024-04-25 Tianyu Guo , Sai Praneeth Karimireddy , Michael I. Jordan

It is not unusual for a data analyst to encounter data sets distributed across several computers. This can happen for reasons such as privacy concerns, efficiency of likelihood evaluations, or just the sheer size of the whole data set. This…

Computation · Statistics 2018-05-22 Randy C. S. Lai , J. Hannig , Thomas C. M. Lee

Federated learning opens a number of research opportunities due to its high communication efficiency in distributed training problems within a star network. In this paper, we focus on improving the communication efficiency for fully…

Machine Learning · Computer Science 2019-12-11 Songtao Lu , Yawen Zhang , Yunlong Wang , Christina Mack

Detecting dynamic patterns of task-specific responses shared across heterogeneous datasets is an essential and challenging problem in many scientific applications in medical science and neuroscience. In our motivating example of rodent…

Neurons and Cognition · Quantitative Biology 2024-07-02 Yubai Yuan , Babak Shahbaba , Norbert Fortin , Keiland Cooper , Qing Nie , Annie Qu

To improve the utility of learning applications and render machine learning solutions feasible for complex applications, a substantial amount of heavy computations is needed. Thus, it is essential to delegate the computations among several…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-29 Homa Esfahanizadeh , Alejandro Cohen , Muriel Medard

How can non-communicating agents learn to share congested resources efficiently? This is a challenging task when the agents can access the same resource simultaneously (in contrast to multi-agent multi-armed bandit problems) and the…

Multiagent Systems · Computer Science 2021-05-13 Tomer Boyarski , Amir Leshem , Vikram Krishnamurthy

This paper presents a distributed optimization scheme over a network of agents in the presence of cost uncertainties and over switching communication topologies. Inspired by recent advances in distributed convex optimization, we propose a…

Optimization and Control · Mathematics 2016-11-15 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

In this paper we propose and analyze a distributed algorithm for achieving globally optimal decisions, either estimation or detection, through a self-synchronization mechanism among linearly coupled integrators initialized with local…

Multiagent Systems · Computer Science 2009-11-13 Gesualdo Scutari , Sergio Barbarossa , Loreto Pescosolido

Distributed resource allocation is a central task in network systems such as smart grids, water distribution networks, and urban transportation systems. When solving such problems in practice it is often important to have nonasymptotic…

Optimization and Control · Mathematics 2021-03-30 Xuyang Wu , Sindri Magnusson , Mikael Johansson

A common paradigm for scientific computing is distributed message-passing systems, and a common approach to these systems is to implement them across clusters of high-performance workstations. As multi-core architectures become increasingly…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-05-01 Christine Task , Arun Chauhan

In this work, we design and analyze novel distributed scheduling algorithms for multi-user MIMO systems. In particular, we consider algorithms which do not require sending channel state information to a central processing unit, nor do they…

Information Theory · Computer Science 2015-03-20 Joseph Kampeas , Asaf Cohen , Omer Gurewitz

This paper describes an information system designed to support the large volume of monitoring information generated by a distributed testbed. This monitoring information is produced by several subsystems and consists of status and…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-12-13 Warren Smith , Shava Smallen

The recurrent neural network has been greatly developed for effectively solving time-varying problems corresponding to complex environments. However, limited by the way of centralized processing, the model performance is greatly affected by…

Artificial Intelligence · Computer Science 2023-06-29 Zhihao Hao , Guancheng Wang , Chunwei Tian , Bob Zhang