English
Related papers

Related papers: Distributed Greedy Pursuit Algorithms

200 papers

This paper focuses on the development of novel greedy techniques for distributed learning under sparsity constraints. Greedy techniques have widely been used in centralized systems due to their low computational requirements and at the same…

Information Theory · Computer Science 2015-06-23 Symeon Chouvardas , Gerasimos Mileounis , Nicholas Kalouptsidis , Sergios Theodoridis

We consider a distributed compressed sensing scenario where many sensors measure correlated sparse signals and the sensors are connected through a network. Correlation between sparse signals is modeled by a partial common support-set. For…

Information Theory · Computer Science 2015-01-14 Dennis Sundman , Saikat Chatterjee , Mikael Skoglund

The problem of the distributed recovery of jointly sparse signals has attracted much attention recently. Let us assume that the nodes of a network observe different sparse signals with common support; starting from linear, compressed…

Optimization and Control · Mathematics 2016-11-15 Sophie M. Fosson , Javier Matamoros , Carles Anton-Haro , Enrico Magli

In this paper, we consider the problem of collaboratively estimating the sparsity pattern of a sparse signal with multiple measurement data in distributed networks. We assume that each node makes Compressive Sensing (CS) based measurements…

Information Theory · Computer Science 2012-11-29 Thakshila Wimalajeewa , Pramod K. Varshney

Greedy Pursuits are very popular in Compressed Sensing for sparse signal recovery. Though many of the Greedy Pursuits possess elegant theoretical guarantees for performance, it is well known that their performance depends on the statistical…

Applications · Statistics 2012-06-20 Sooraj K. Ambat , Saikat Chatterjee , K. V. S. Hari

Greedy algorithms are popular in compressive sensing for their high computational efficiency. But the performance of current greedy algorithms can be degenerated seriously by noise (both multiplicative noise and additive noise). A robust…

Information Theory · Computer Science 2014-02-10 Yurrit Avonds , Yipeng Liu , Sabine Van Huffel

We investigate an existing distributed algorithm for learning sparse signals or data over networks. The algorithm is iterative and exchanges intermediate estimates of a sparse signal over a network. This learning strategy using exchange of…

Machine Learning · Statistics 2017-09-25 Ahmed Zaki , Partha P. Mitra , Lars K. Rasmussen , Saikat Chatterjee

We consider the exploration problem: an agent equipped with a depth sensor must map out a previously unknown environment using as few sensor measurements as possible. We propose an approach based on supervised learning of a greedy…

Machine Learning · Computer Science 2022-03-29 Louis Ly , Yen-Hsi Richard Tsai

Motivated by the question of optimal functional approximation via compressed sensing, we propose generalizations of the Iterative Hard Thresholding and the Compressive Sampling Matching Pursuit algorithms able to promote sparse in levels…

Information Theory · Computer Science 2021-11-01 Ben Adcock , Simone Brugiapaglia , Matthew King-Roskamp

We study the problem of distributed state estimation in a network of sensing units that can exchange their measurements but the rate of communication between the units is constrained. The units collect noisy, possibly only partial…

Signal Processing · Electrical Eng. & Systems 2018-07-23 Abolfazl Hashemi , Osman Fatih Kilic , Haris Vikalo

This paper investigates the problem of distributed network-wide averaging and proposes a new greedy gossip algorithm. Instead of finding the optimal path of each node in a greedy manner, the proposed approach utilises a suboptimal…

Systems and Control · Computer Science 2019-08-20 Hyo-Sang Shin , Shaoming He , Antonios Tsourdos

We discuss a method for sparse signal approximation, which is based on the correlation of the target signal with a pseudo-random signal, and uses a modification of the greedy matching pursuit algorithm. We show that this approach provides…

Data Analysis, Statistics and Probability · Physics 2011-05-26 M. Andrecut

Sparse approximation is important in many applications because of concise form of an approximant and good accuracy guarantees. The theory of compressed sensing, which proved to be very useful in the image processing and data sciences, is…

Numerical Analysis · Mathematics 2025-02-20 V. Temlyakov

For compressive sensing of dynamic sparse signals, we develop an iterative pursuit algorithm. A dynamic sparse signal process is characterized by varying sparsity patterns over time/space. For such signals, the developed algorithm is able…

Statistics Theory · Mathematics 2012-10-15 Dave Zachariah , Saikat Chatterjee , Magnus Jansson

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity constraints. We prove linear convergence in expectation to…

Numerical Analysis · Mathematics 2014-07-02 Nam Nguyen , Deanna Needell , Tina Woolf

We consider a distributed learning setup where a sparse signal is estimated over a network. Our main interest is to save communication resource for information exchange over the network and reduce processing time. Each node of the network…

Machine Learning · Statistics 2018-04-03 Ahmed Zaki , Saikat Chatterjee , Partha P. Mitra , Lars K. Rasmussen

Collective communications are ubiquitous in parallel applications. We present two new algorithms for performing a reduction. The operation associated with our reduction needs to be associative and commutative. The two algorithms are…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-18 Bradley R. Lowery , Julien Langou

This paper proposes a new algorithm for multiple sparse regression in high dimensions, where the task is to estimate the support and values of several (typically related) sparse vectors from a few noisy linear measurements. Our algorithm is…

Machine Learning · Statistics 2012-06-08 Ali Jalali , Sujay Sanghavi

Distributed compressed sensing is concerned with representing an ensemble of jointly sparse signals using as few linear measurements as possible. Two novel joint reconstruction algorithms for distributed compressed sensing are presented in…

Information Theory · Computer Science 2014-05-22 Diego Valsesia , Giulio Coluccia , Enrico Magli

Detection of a signal under noise is a classical signal processing problem. When monitoring spatial phenomena under a fixed budget, i.e., either physical, economical or computational constraints, the selection of a subset of available…

Signal Processing · Electrical Eng. & Systems 2018-08-01 Mario Coutino , Sundeep Prabhakar Chepuri , Geert Leus
‹ Prev 1 2 3 10 Next ›