English
Related papers

Related papers: A Multitask Diffusion Strategy with Optimized Inte…

200 papers

This paper proposes the matrix-weighted consensus algorithm, which is a generalization of the consensus algorithm in the literature. Given a networked dynamical system where the interconnections between agents are weighted by nonnegative…

Optimization and Control · Mathematics 2018-01-09 Minh Hoang Trinh , Hyo-Sung Ahn

Reaching agreement despite noise in communication is a fundamental problem in multi-agent systems. Here we study this problem under an idealized model, where it is assumed that agents can sense the general tendency in the system. More…

Computer Science and Game Theory · Computer Science 2023-01-09 Amos Korman , Robin Vacus

This paper presents a new multitask learning framework that learns a shared representation among the tasks, incorporating both task and feature clusters. The jointly-induced clusters yield a shared latent subspace where task relationships…

Machine Learning · Statistics 2017-03-06 Keerthiram Murugesan , Jaime Carbonell , Yiming Yang

We study the problem of multi-task non-smooth optimization that arises ubiquitously in statistical learning, decision-making and risk management. We develop a data fusion approach that adaptively leverages commonalities among a large number…

Machine Learning · Statistics 2022-10-25 Henry Lam , Kaizheng Wang , Yuhang Wu , Yichen Zhang

A distributed adaptive algorithm to estimate a time-varying signal, measured by a wireless sensor network, is designed and analyzed. One of the major features of the algorithm is that no central coordination among the nodes needs to be…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-10-22 Carlo Fischione , Alberto Speranzon , Karl H. Johansson , Alberto Sangiovanni-Vincentelli

We study the clustering problem for mixtures of bounded covariance distributions, under a fine-grained separation assumption. Specifically, given samples from a $k$-component mixture distribution $D = \sum_{i =1}^k w_i P_i$, where each $w_i…

Machine Learning · Computer Science 2023-12-20 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Thanasis Pittas

In this study, a cluster-computing environment is employed as a computational platform. In order to increase the efficiency of the system, a dynamic task scheduling algorithm is proposed, which balances the load among the nodes of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-22 I. K. Savvas , M. Tahar Kechadi

Adaptive networks are well-suited to perform decentralized information processing and optimization tasks and to model various types of self-organized and complex behavior encountered in nature. Adaptive networks consist of a collection of…

Multiagent Systems · Computer Science 2013-05-07 Ali H. Sayed

The present study proposes incorporating non-parametric knowledge into the diffusion least-mean-squares algorithm in the framework of a maximum a posteriori (MAP) estimation. The proposed algorithm leads to a robust estimation of an unknown…

Machine Learning · Computer Science 2023-12-05 Soheil Ashkezari-Toussi , Hadi sadoghi-Yazdi

Distributed consensus protocols provide a mechanism for spreading information within clustered networks, allowing agents and clusters to make decisions without requiring direct access to the state of the ensemble. In this work, we propose a…

Systems and Control · Electrical Eng. & Systems 2025-12-12 Federico M. Zegers , Sean Phillips

Diffusion models have recently shown promise in offline RL. However, these methods often suffer from high training costs and slow convergence, particularly when using transformer-based denoising backbones. While several optimization…

Machine Learning · Computer Science 2025-06-23 Zhiying Qiu , Tao Lin

Part I of this work [2] developed the exact diffusion algorithm to remove the bias that is characteristic of distributed solutions for deterministic optimization problems. The algorithm was shown to be applicable to a larger set of…

Optimization and Control · Mathematics 2017-12-27 Kun Yuan , Bicheng Ying , Xiaochuan Zhao , Ali H. Sayed

Weight distribution largely impacts the epidemic spreading taking place on top of networks. This paper studies a susceptible-infected-susceptible model on regular random networks with different kinds of weight distributions. Simulation…

Physics and Society · Physics 2012-07-16 Zimo Yang , Tao Zhou

If a piece of information is released from a media site, can it spread, in 1 month, to a million web pages? This influence estimation problem is very challenging since both the time-sensitive nature of the problem and the issue of…

Social and Information Networks · Computer Science 2013-11-18 Nan Du , Le Song , Manuel Gomez Rodriguez , Hongyuan Zha

This paper introduces some tools from graph theory and distributed consensus algorithms to construct an optimal, yet robust, hierarchical information sharing structure for large-scale decision making and control problems. The proposed…

Systems and Control · Computer Science 2012-08-16 Amir Noori

Partial diffusion-based recursive least squares (PDRLS) is an effective method for reducing computational load and power consumption in adaptive network implementation. In this method, each node shares a part of its intermediate estimate…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-07-20 Vahid Vahidpour , Amir Rastegarnia , Azam Khalili , Saeid Sanei

This work develops a distributed optimization strategy with guaranteed exact convergence for a broad class of left-stochastic combination policies. The resulting exact diffusion strategy is shown in Part II to have a wider stability range…

Optimization and Control · Mathematics 2017-12-05 Kun Yuan , Bicheng Ying , Xiaochuan Zhao , Ali H. Sayed

This paper proposes a supervised training algorithm for learning stochastic resource allocation policies with generative diffusion models (GDMs). We formulate the allocation problem as the maximization of an ergodic utility function subject…

Machine Learning · Computer Science 2025-09-23 Yigit Berkay Uslu , Samar Hadou , Shirin Saeedi Bidokhti , Alejandro Ribeiro

Well-spread samples are desirable in many disciplines because they improve estimation when target variables exhibit spatial structure. This paper introduces an integrated methodological framework for spreading samples over the population's…

Methodology · Statistics 2025-10-29 Bardia Panahbehagh , Mehdi Mohebbi , Amir Mohammad HosseiniNasab

This paper considers clustered multi-task compressive sensing, a hierarchical model that solves multiple compressive sensing tasks by finding clusters of tasks that leverage shared information to mutually improve signal reconstruction. The…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Alexander Lin , Demba Ba