English
Related papers

Related papers: Collaboratively Learning Linear Models with Struct…

200 papers

This paper pertains to the analysis and design of decentralized estimation schemes that make use of limited communication. Briefly, these schemes equip the sensors with scalar states that iteratively merge the measurements and the state of…

Systems and Control · Computer Science 2018-01-19 Andreea B. Alexandru , Sergio Pequito , Ali Jadbabaie , George J. Pappas

In this paper, we aim to design and analyze distributed Bayesian estimation algorithms for sensor networks. The challenges we address are to (i) derive a distributed provably-correct algorithm in the functional space of probability…

Machine Learning · Computer Science 2025-03-25 Parth Paritosh , Nikolay Atanasov , Sonia Martinez

We study multi-agent reinforcement learning in the setting of episodic Markov decision processes, where multiple agents cooperate via communication through a central server. We propose a provably efficient algorithm based on value iteration…

Machine Learning · Computer Science 2023-06-27 Yifei Min , Jiafan He , Tianhao Wang , Quanquan Gu

We study a class of cooperative multi-agent optimization problems, where each agent is associated with a local action vector and a local cost, and the goal is to cooperatively find the joint action profile that minimizes the average of the…

Optimization and Control · Mathematics 2021-02-24 Yujie Tang , Zhaolin Ren , Na Li

In this paper, we establish minimax optimal rates of convergence for prediction in a semi-functional linear model that consists of a functional component and a less smooth nonparametric component. Our results reveal that the smoother…

Statistics Theory · Mathematics 2021-11-01 Keli Guo , Jun Fan , Lixing Zhu

This paper presents a new approach to distributed linear filtering and prediction. The problem under consideration consists of a random dynamical system observed by a multi-agent network of sensors where the network is sparse. Inspired by…

Systems and Control · Electrical Eng. & Systems 2022-03-08 Subhro Das

Recent semi-supervised learning methods have shown to achieve comparable results to their supervised counterparts while using only a small portion of labels in image classification tasks thanks to their regularization strategies. In this…

Machine Learning · Computer Science 2020-09-25 Wei-Hong Li , Chuan-Sheng Foo , Hakan Bilen

Effective resource allocation in sensor networks, IoT systems, and distributed computing is essential for applications such as environmental monitoring, surveillance, and smart infrastructure. Sensors or agents must optimize their resource…

Machine Learning · Computer Science 2024-09-26 Yu-Zhen Janice Chen , Daniel S. Menasché , Don Towsley

In this paper, we address the problem of how a network of agents can collaboratively fit a linear model when each agent only ever has an arbitrary summand of the regression data. This problem generalizes previously studied…

Optimization and Control · Mathematics 2014-08-06 François D. Côté , Ioannis N. Psaromiligkos , Warren J. Gross

This paper proposes an interpretable non-model sharing collaborative data analysis method as one of the federated learning systems, which is an emerging technology to analyze distributed data. Analyzing distributed data is essential in many…

Machine Learning · Computer Science 2020-11-10 Akira Imakura , Hiroaki Inaba , Yukihiko Okada , Tetsuya Sakurai

Learning cooperative multi-agent policies directly from high-dimensional, multimodal sensory inputs like pixels and audio (from pixels) is notoriously sample-inefficient. Model-free Multi-Agent Reinforcement Learning (MARL) algorithms…

Multiagent Systems · Computer Science 2025-11-12 Sureyya Akin , Kavita Srivastava , Prateek B. Kapoor , Pradeep G. Sethi , Sunita Q. Patel , Rahu Srivastava

The rapid growth of digital devices and IoT has intensified the demand for collaborative learning. Since these devices generate sensitive and high-dimensional data, centralized transmission is often impractical, while local learning suffers…

Signal Processing · Electrical Eng. & Systems 2026-03-03 Nikola Stankovic

The notion that cooperation can aid a group of agents to solve problems more efficiently than if those agents worked in isolation is prevalent, despite the little quantitative groundwork to support it. Here we consider a primordial form of…

Adaptation and Self-Organizing Systems · Physics 2014-10-22 José F. Fontanari

We consider the problem of learning classifiers for labeled data that has been distributed across several nodes. Our goal is to find a single classifier, with small approximation error, across all datasets while minimizing the communication…

Machine Learning · Statistics 2012-03-06 Hal Daume , Jeff M. Phillips , Avishek Saha , Suresh Venkatasubramanian

We consider the estimation problem in high-dimensional semi-supervised learning. Our goal is to investigate when and how the unlabeled data can be exploited to improve the estimation of the regression parameters of linear model in light of…

Methodology · Statistics 2023-03-21 Siyi Deng , Yang Ning , Jiwei Zhao , Heping Zhang

This paper presents a novel approach to Multi-Agent Reinforcement Learning (MARL) that combines cooperative task decomposition with the learning of reward machines (RMs) encoding the structure of the sub-tasks. The proposed method helps…

Artificial Intelligence · Computer Science 2025-02-17 Leo Ardon , Daniel Furelos-Blanco , Alessandra Russo

Mixed linear regression involves the recovery of two (or more) unknown vectors from unlabeled linear measurements; that is, where each sample comes from exactly one of the vectors, but we do not know which one. It is a classic problem, and…

Machine Learning · Statistics 2014-02-10 Xinyang Yi , Constantine Caramanis , Sujay Sanghavi

In this chapter, we will mainly focus on collaborative training across wireless devices. Training a ML model is equivalent to solving an optimization problem, and many distributed optimization algorithms have been developed over the last…

Machine Learning · Computer Science 2021-12-13 Emre Ozfatura , Deniz Gunduz , H. Vincent Poor

A protocol for distributed estimation of discrete distributions is proposed. Each agent begins with a single sample from the distribution, and the goal is to learn the empirical distribution of the samples. The protocol is based on a simple…

Optimization and Control · Mathematics 2014-06-06 Anand D. Sarwate , Tara Javidi

This paper investigates the problem of linear spatial collaboration for distributed estimation in wireless sensor networks. In this context, the sensors share their local noisy (and potentially spatially correlated) observations with each…

Information Theory · Computer Science 2016-11-17 Mohammad Fanaei , Matthew C. Valenti , Abbas Jamalipour , Natalia A. Schmid