English
Related papers

Related papers: Decentralized diffusion-based learning under non-p…

200 papers

Deep neural networks trained on biased data often inadvertently learn unintended inference rules, particularly when labels are strongly correlated with biased features. Existing bias mitigation methods typically involve either a)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Rajeev Ranjan Dwivedi , Priyadarshini Kumari , Vinod K Kurmi

Deep nonparametric regression, characterized by the utilization of deep neural networks to learn target functions, has emerged as a focus of research attention in recent years. Despite considerable progress in understanding convergence…

Machine Learning · Statistics 2024-08-01 Yuling Jiao , Lican Kang , Jin Liu , Heng Peng , Heng Zuo

We investigate the consensus problem in a network where nodes communicate via diffusion-based molecular communication (DbMC). In DbMC, messages are conveyed via the variation in the concentration of molecules in the medium. Every node…

Information Theory · Computer Science 2011-03-03 Arash Einolghozati , Mohsen Sardari , Ahmad Beirami , Faramarz Fekri

In many remote sensing applications one wants to estimate variables or parameters of interest from observations. When the target variable is available at a resolution that matches the remote sensing observations, standard algorithms such as…

As the complexity of our neural network models grow, so too do the data and computation requirements for successful training. One proposed solution to this problem is training on a distributed network of computational devices, thus…

Machine Learning · Computer Science 2020-05-22 Kyle Crandall , Dustin Webb

This paper addresses the problem of localization, which is inherently non-convex and non-smooth in a federated setting where the data is distributed across a multitude of devices. Due to the decentralized nature of federated environments,…

Machine Learning · Computer Science 2023-09-04 Reza Mirzaeifard , Naveen K. D. Venkategowda , Stefan Werner

Machine learning is becoming increasingly important for nonlinear system identification, including dynamical systems with spatially distributed outputs. However, classical identification and forecasting approaches become markedly less…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Achraf El Messaoudi , Noureddine Khaous , Karim Cherifi

Graph property prediction tasks are important and numerous. While each task offers a small size of labeled examples, unlabeled graphs have been collected from various sources and at a large scale. A conventional approach is training a model…

Machine Learning · Computer Science 2023-10-13 Gang Liu , Eric Inae , Tong Zhao , Jiaxin Xu , Tengfei Luo , Meng Jiang

This paper presents a scalable Bayesian technique for decentralized state estimation from multiple platforms in dynamic environments. As has long been recognized, centralized architectures impose severe scaling limitations for distributed…

Artificial Intelligence · Computer Science 2012-12-12 Matthew Rosencrantz , Geoffrey Gordon , Sebastian Thrun

Distributed learning provides an attractive framework for scaling the learning task by sharing the computational load over multiple nodes in a network. Here, we investigate the performance of distributed learning for large-scale linear…

Machine Learning · Statistics 2021-11-03 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

We consider the problem of distributed estimation of an unknown deterministic scalar parameter (the target signal) in a wireless sensor network (WSN), where each sensor receives a single snapshot of the field. We assume that the observation…

Information Theory · Computer Science 2015-10-09 Qing Zhou , Di Li , Soummya Kar , Lauren Huie , H. Vincent Poor , Shuguang Cui

We study the problem of training diffusion models to sample from a distribution with a given unnormalized density or energy function. We benchmark several diffusion-structured inference methods, including simulation-based variational…

We consider a network scenario in which agents can evaluate each other according to a score graph that models some interactions. The goal is to design a distributed protocol, run by the agents, that allows them to learn their unknown state…

Systems and Control · Computer Science 2018-06-05 Francesco Sasso , Angelo Coluccia , Giuseppe Notarstefano

Learning to sample from intractable distributions over discrete sets without relying on corresponding training data is a central problem in a wide range of fields, including Combinatorial Optimization. Currently, popular deep learning-based…

Machine Learning · Computer Science 2025-08-25 Sebastian Sanokowski , Sepp Hochreiter , Sebastian Lehner

We present a machine learning approach for model-independent new physics searches. The corresponding algorithm is powered by recent large-scale implementations of kernel methods, nonparametric learning algorithms that can approximate any…

High Energy Physics - Phenomenology · Physics 2022-10-17 Marco Letizia , Gianvito Losapio , Marco Rando , Gaia Grosso , Andrea Wulzer , Maurizio Pierini , Marco Zanetti , Lorenzo Rosasco

Employing a forward diffusion chain to gradually map the data to a noise distribution, diffusion-based generative models learn how to generate the data by inferring a reverse diffusion chain. However, this approach is slow and costly…

Machine Learning · Statistics 2023-09-08 Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

The study of random graphs and networks had an explosive development in the last couple of decades. Meanwhile, techniques for the statistical analysis of sequences of networks were less developed. In this paper we focus on networks…

Disordered Systems and Neural Networks · Physics 2017-04-18 Daniel Fraiman , Nicolas Fraiman , Ricardo Fraiman

We propose a decentralized learning algorithm over a general social network. The algorithm leaves the training data distributed on the mobile devices while utilizing a peer to peer model aggregation method. The proposed algorithm allows…

Machine Learning · Statistics 2019-05-28 Anusha Lalitha , Xinghan Wang , Osman Kilinc , Yongxi Lu , Tara Javidi , Farinaz Koushanfar

In this paper, we analyze the effects of random sampling on adaptive diffusion networks. These networks consist in a collection of nodes that can measure and process data, and that can communicate with each other to pursue a common goal of…

Signal Processing · Electrical Eng. & Systems 2024-03-27 Daniel G. Tiglea , Renato Candido , Magno T. M. Silva

Decentralized learning algorithms empower interconnected devices to share data and computational resources to collaboratively train a machine learning model without the aid of a central coordinator. In the case of heterogeneous data…

Machine Learning · Computer Science 2023-01-16 Matteo Zecchin , Marios Kountouris , David Gesbert
‹ Prev 1 8 9 10 Next ›