English
Related papers

Related papers: Sparsity vs. Statistical Independence in Adaptive …

200 papers

This paper considers the distributed sparse identification problem over wireless sensor networks such that all sensors cooperatively estimate the unknown sparse parameter vector of stochastic dynamic systems by using the local information…

Systems and Control · Electrical Eng. & Systems 2022-03-08 Die Gan , Zhixin Liu

Sparse sensor placement is a central challenge in the efficient characterization of complex systems when the cost of acquiring and processing data is high. Leading sparse sensing methods typically exploit either spatial or temporal…

Optimization and Control · Mathematics 2022-06-08 Thomas L. Mohren , Thomas L. Daniel , Steven L. Brunton , Bingni W. Brunton

We formulate sparse support recovery as a salient set identification problem and use information-theoretic analyses to characterize the recovery performance and sample complexity. We consider a very general model where we are not restricted…

Information Theory · Computer Science 2014-03-14 Cem Aksoylar , Venkatesh Saligrama

Spike sorting algorithms are used to separate extracellular recordings of neuronal populations into single-unit spike activities. The development of customized hardware implementing spike sorting algorithms is burgeoning. However, there is…

Machine Learning · Computer Science 2025-01-30 Tim Zhang , Corey Lammie , Mostafa Rahimi Azghadi , Amirali Amirsoleimani , Majid Ahmadi , Roman Genov

Neurons in the nervous system are submitted to distinct sources of noise, such as ionic-channel and synaptic noise, which introduces variability in their responses to repeated presentations of identical stimuli. This motivates the use of…

The nervous system solves a wide variety of problems in signal processing. In many cases the performance of the nervous system is so good that it apporaches fundamental physical limits, such as the limits imposed by diffraction and photon…

Condensed Matter · Physics 2009-10-22 Marc Potters , William Bialek

Motivated by studies of indirect measurements in quantum mechanics, we investigate stochastic differential equations with a fixed point subject to an additional infinitesimal repulsive perturbation. We conjecture, and prove for an important…

Mathematical Physics · Physics 2018-07-18 Michel Bauer , Denis Bernard

Inference on unknown quantities in dynamical systems via observational data is essential for providing meaningful insight, furnishing accurate predictions, enabling robust control, and establishing appropriate designs for future…

Methodology · Statistics 2018-02-06 M. Chung , M. Binois , R. B. Gramacy , D. J. Moquin , A. P. Smith , A. M. Smith

The sparse modeling is an evident manifestation capturing the parsimony principle just described, and sparse models are widespread in statistics, physics, information sciences, neuroscience, computational mathematics, and so on. In…

Machine Learning · Computer Science 2023-08-29 Jianyi Lin

Learning is based on synaptic plasticity, which affects and is driven by neural activity. Because pre- and postsynaptic spiking activity is shaped by randomness, the synaptic weights follow a stochastic process, requiring a probabilistic…

Neurons and Cognition · Quantitative Biology 2026-01-14 Jakob Stubenrauch , Naomi Auer , Richard Kempter , Benjamin Lindner

We consider the problem of recovering the support of a sparse signal using noisy projections. While extensive work has been done on the dense measurement matrix setting, the sparse setting remains less explored. In this work, we establish…

Machine Learning · Statistics 2025-09-03 Youssef Chaabouni , David Gamarnik

Recently, there has been a significant interest in developing cooperative sensing systems for certain types of wireless applications. In such systems, a group of sensing nodes periodically collect measurements about the signals being…

Information Theory · Computer Science 2015-06-11 Harish Ganapathy , Constantine Caramanis , Lei Ying

Statistical independence is a notion ubiquitous in various fields such as in statistics, probability, number theory and physics. We establish the stability of independence for any pair of random variables by their corresponding Brockwell…

Probability · Mathematics 2024-04-12 Xingzhi Wang

This thesis is interested in the application of statistical physics methods and inference to sparse linear estimation problems. The main tools are the graphical models and approximate message-passing algorithm together with the cavity…

Information Theory · Computer Science 2015-11-06 Jean Barbier

We obtain an almost sure bound for oscillation rates of empirical distribution functions for stationary causal processes. For short-range dependent processes, the oscillation rate is shown to be optimal in the sense that it is as sharp as…

Probability · Mathematics 2007-05-23 Wei Biao Wu

Theory and algorithms are developed for detecting changes in the distribution of statistically periodic random processes. The statistical periodicity is modeled using independent and periodically identically distributed processes, a new…

Signal Processing · Electrical Eng. & Systems 2019-08-14 Taposh Banerjee , Prudhvi Gurram , Gene Whipps

Classical results in asymptotic statistics show that the Fisher information matrix controls the difficulty of estimating a statistical model from observed data. In this work, we introduce a companion measure of robustness of an estimation…

Statistics Theory · Mathematics 2026-02-10 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

Markovian population models are suitable abstractions to describe well-mixed interacting particle systems in situation where stochastic fluctuations are significant due to the involvement of low copy particles. In molecular biology,…

Quantitative Methods · Quantitative Biology 2014-01-17 Christoph Zechner , Federico Wadehn , Heinz Koeppl

Syntactic parsing, the process of obtaining the internal structure of sentences in natural languages, is a crucial task for artificial intelligence applications that need to extract meaning from natural language text or speech. Sentiment…

Computation and Language · Computer Science 2017-10-25 Carlos Gómez-Rodríguez , Iago Alonso-Alonso , David Vilares

Functional data are typically modeled as sample paths of smooth stochastic processes in order to mitigate the fact that they are often observed discretely and noisily, occasionally irregularly and sparsely. The smoothness assumption is…

Methodology · Statistics 2021-12-23 Neda Mohammadi , Victor M. Panaretos