English
Related papers

Related papers: Decentralized diffusion-based learning under non-p…

200 papers

Diffusion models have achieved remarkable success in image and video generation. In this work, we demonstrate that diffusion models can also \textit{generate high-performing neural network parameters}. Our approach is simple, utilizing an…

Machine Learning · Computer Science 2025-01-03 Kai Wang , Dongwen Tang , Boya Zeng , Yida Yin , Zhaopan Xu , Yukun Zhou , Zelin Zang , Trevor Darrell , Zhuang Liu , Yang You

We study a tandem of agents who make decisions about an underlying binary hypothesis, where the distribution of the agent observations under each hypothesis comes from an uncertainty class. We investigate both decentralized detection rules,…

Information Theory · Computer Science 2015-10-28 Jack Ho , Wee Peng Tay , Tony Q. S. Quek , Edwin K. P. Chong

The last mile connection is dominated by wireless links where heterogeneous nodes share the limited and already crowded electromagnetic spectrum. Current contention based decentralized wireless access system is reactive in nature to…

Networking and Internet Architecture · Computer Science 2020-02-03 Shuvam Chakraborty , Hesham Mohammed , Dola Saha

Distributed state estimation is examined for a sensor network tasked with reconstructing a system's state through the use of a distributed and event-triggered observer. Each agent in the sensor network employs a deep neural network (DNN) to…

Systems and Control · Electrical Eng. & Systems 2022-02-07 Federico M. Zegers , Runhan Sun , Girish Chowdhary , Warren E. Dixon

Diffusion models are gaining widespread use in cutting-edge image, video, and audio generation. Score-based diffusion models stand out among these methods, necessitating the estimation of score function of the input data distribution. In…

Machine Learning · Computer Science 2024-05-24 Fangzhao Zhang , Mert Pilanci

This paper studies the problem of distributed classification with a network of heterogeneous agents. The agents seek to jointly identify the underlying target class that best describes a sequence of observations. The problem is first…

Artificial Intelligence · Computer Science 2020-11-24 James Z. Hare , Cesar A. Uribe , Lance Kaplan , Ali Jadbabaie

Describing the dynamics of information dissemination within social networks poses a formidable challenge. Despite multiple endeavors aimed at addressing this issue, only a limited number of studies have effectively replicated and forecasted…

Social and Information Networks · Computer Science 2024-03-21 Xinyu Li , Jinyang Huang , Xiang Zhang , Peng Zhao , Meng Wang , Guohang Zhuang , Huan Yan , Xiao Sun , Meng Wang

Conventional diffusion models typically relies on a fixed forward process, which implicitly defines complex marginal distributions over latent variables. This can often complicate the reverse process' task in learning generative…

Machine Learning · Statistics 2025-06-10 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

Linear regression on network-linked observations has been an essential tool in modeling the relationship between response and covariates with additional network structures. Previous methods either lack inference tools or rely on restrictive…

Methodology · Statistics 2022-08-22 Can M. Le , Tianxi Li

Limited by the encoder-decoder architecture, learning-based edge detectors usually have difficulty predicting edge maps that satisfy both correctness and crispness. With the recent success of the diffusion probabilistic model (DPM), we…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yunfan Ye , Kai Xu , Yuhang Huang , Renjiao Yi , Zhiping Cai

This paper addresses the problem of distributed learning of average belief with sequential observations, in which a network of $n>1$ agents aim to reach a consensus on the average value of their beliefs, by exchanging information only with…

Multiagent Systems · Computer Science 2018-11-20 Kaiqing Zhang , Yang Liu , Ji Liu , Mingyan Liu , Tamer Başar

This work proposes a novel channel estimator based on diffusion models (DMs), one of the currently top-rated generative models. Contrary to related works utilizing generative priors, a lightweight convolutional neural network (CNN) with…

Signal Processing · Electrical Eng. & Systems 2024-03-07 Benedikt Fesl , Michael Baur , Florian Strasser , Michael Joham , Wolfgang Utschick

In a distributed network environment, the diffusion-least mean squares (LMS) algorithm gives faster convergence than the original LMS algorithm. It has also been observed that, the diffusion-LMS generally outperforms other distributed LMS…

Machine Learning · Computer Science 2015-09-07 Rangeet Mitra , Vimal Bhatia

Decentralized learning and optimization is a central problem in control that encompasses several existing and emerging applications, such as federated learning. While there exists a vast literature on this topic and most methods centered…

Machine Learning · Computer Science 2023-03-21 Vishnu Pandi Chellapandi , Antesh Upadhyay , Abolfazl Hashemi , Stanislaw H /. Zak

Out-of-distribution detection is crucial to the safe deployment of machine learning systems. Currently, unsupervised out-of-distribution detection is dominated by generative-based approaches that make use of estimates of the likelihood or…

In this paper, we consider a general distributed estimation problem in relay-assisted sensor networks by taking into account time-varying asymmetric communications, fading channels and intermittent measurements. Motivated by centralized…

Information Theory · Computer Science 2016-04-20 Shanying Zhu , Yeng Chai Soh , Lihua Xie

As a class of generative artificial intelligence frameworks inspired by statistical physics, diffusion models have shown extraordinary performance in synthesizing complicated data distributions through a denoising process gradually guided…

Machine Learning · Computer Science 2026-04-23 Fangjun Hu , Guangkuo Liu , Yifan F. Zhang , Xun Gao

This paper studies Dictionary Learning problems wherein the learning task is distributed over a multi-agent network, modeled as a time-varying directed graph. This formulation is relevant, for instance, in Big Data scenarios where massive…

Optimization and Control · Mathematics 2019-03-06 Amir Daneshmand , Ying Sun , Gesualdo Scutari , Francisco Facchinei , Brian M. Sadler

This paper addresses the nonparametric estimation of the drift function over a compact domain for a time-homogeneous diffusion process, based on high-frequency discrete observations from $N$ independent trajectories. We propose a neural…

Machine Learning · Statistics 2026-04-01 Yuzhen Zhao , Yating Liu , Marc Hoffmann

Accurate noise modelling is important for training of deep learning reconstruction algorithms. While noise models are well known for traditional imaging techniques, the noise distribution of a novel sensor may be difficult to determine a…

Machine Learning · Computer Science 2018-07-11 Felix Horger , Tobias Würfl , Vincent Christlein , Andreas Maier