English
Related papers

Related papers: Sparsity vs. Statistical Independence in Adaptive …

200 papers

Stochastic processes offer a flexible mathematical formalism to model and reason about systems. Most analysis tools, however, start from the premises that models are fully specified, so that any parameters controlling the system's dynamics…

Systems and Control · Computer Science 2017-01-11 Luca Bortolussi , Guido Sanguinetti

Motivated by a neuroscience question about synchrony detection in spike train analysis, we deal with the independence testing problem for point processes. We introduce non-parametric test statistics, which are rescaled general…

Statistics Theory · Mathematics 2015-05-28 Mélisande Albert , Yann Bouret , Magalie Fromont , Patricia Reynaud-Bouret

A fundamental concept in control theory is that of controllability, where any system state can be reached through an appropriate choice of control inputs. Indeed, a large body of classical and modern approaches are designed for controllable…

Optimization and Control · Mathematics 2022-06-13 Yonathan Efroni , Sham Kakade , Akshay Krishnamurthy , Cyril Zhang

Recovering dynamical equations from observed noisy data is the central challenge of system identification. We develop a statistical mechanics approach to analyze sparse equation discovery algorithms, which typically balance data fit and…

Statistical Mechanics · Physics 2025-09-16 Andrei A. Klishin , Joseph Bakarji , J. Nathan Kutz , Krithika Manohar

An increasing body of evidence suggests that the trial-to-trial variability of spiking activity in the brain is not mere noise, but rather the reflection of a sampling-based encoding scheme for probabilistic computing. Since the precise…

Advances in modern technology have enabled the simultaneous recording of neural spiking activity, which statistically can be represented by a multivariate point process. We characterise the second order structure of this process via the…

Methodology · Statistics 2024-04-30 Carla Pinkney , Carolina Euan , Alex Gibberd , Ali Shojaie

Accurately estimating the proportion of true signals among a large number of variables is crucial for enhancing the precision and reliability of scientific research. Traditional signal proportion estimators often assume independence among…

Statistics Theory · Mathematics 2026-05-15 Jingtian Bai , Xinge Jessie Jeng

Regular variation provides a convenient theoretical framework to study large events. In the multivariate setting, the dependence structure of the positive extremes is characterized by a measure - the spectral measure - defined on the…

Machine Learning · Statistics 2021-02-24 Meyer Nicolas , Olivier Wintenberger

Hawkes process provides an effective statistical framework for analyzing the time-dependent interaction of neuronal spiking activities. Although utilized in many real applications, the classic Hawkes process is incapable of modelling…

Machine Learning · Statistics 2021-02-23 Feng Zhou , Yixuan Zhang , Jun Zhu

Many signal and image processing applications have benefited remarkably from the fact that the underlying signals reside in a low dimensional subspace. One of the main models for such a low dimensionality is the sparsity one. Within this…

Information Theory · Computer Science 2015-03-25 Raja Giryes

Recent studies have demonstrated the potential of flexible loads in providing frequency response services. However, uncertainty and variability in various weather-related and end-use behavioral factors often affect the demand-side control…

Systems and Control · Electrical Eng. & Systems 2021-06-29 Sai Pushpak Nandanoori , Soumya Kundu , Jianming Lian , Umesh Vaidya , Draguna Vrabie , Karanjit Kalsi

This paper proposes and analyzes fully data driven methods for inference about the mean function of a stochastic process from a sample of independent trajectories of the process, observed at discrete time points and corrupted by additive…

Methodology · Statistics 2009-05-20 F. Bunea , M. H. Wegkamp , A. E. Ivanescu

Stochastic process discovery is concerned with deriving a model capable of reproducing the stochastic character of observed executions of a given process, stored in a log. This leads to an optimisation problem in which the model's parameter…

Formal Languages and Automata Theory · Computer Science 2025-05-01 Pierre Cry , Paolo Ballarini , András Horváth , Pascale Le Gall

One step in the conventional analysis of extracellularly recorded neuronal data is spike sorting, which separates electrical signal into action potentials from different neurons. Because spike sorting involves human judgment, it can be…

Neurons and Cognition · Quantitative Biology 2007-05-23 Artur Luczak , Nandakumar S. Narayanan

This paper deals with the problem of nonparametric independence testing, a fundamental decision-theoretic problem that asks if two arbitrary (possibly multivariate) random variables $X,Y$ are independent or not, a question that comes up in…

Machine Learning · Statistics 2015-09-04 Aaditya Ramdas , Leila Wehbe

Sufficient statistic perturbation (SSP) is a widely used method for differentially private linear regression. SSP adopts a data-independent approach where privacy noise from a simple distribution is added to sufficient statistics. However,…

Machine Learning · Computer Science 2024-05-27 Cecilia Ferrando , Daniel Sheldon

Neural noise sets a limit to information transmission in sensory systems. In several areas, the spiking response (to a repeated stimulus) has shown a higher degree of regularity than predicted by a Poisson process. However, a simple model…

Neurons and Cognition · Quantitative Biology 2018-01-08 Ulisse Ferrari , Stephane Deny , Olivier Marre , Thierry Mora

A key trait of stochastic optimizers is that multiple runs of the same optimizer in attempting to solve the same problem can produce different results. As a result, their performance is evaluated over several repeats, or runs, on the…

Machine Learning · Computer Science 2026-05-18 Moslem Noori , Elisabetta Valiante , Thomas Van Vaerenbergh , Masoud Mohseni , Ignacio Rozada

This article introduces a new signal analysis method, which can be interpreted as a principal component analysis in sparse decomposition of the signal. The method, called principal basis analysis, is based on a novel criterion:…

Computer Vision and Pattern Recognition · Computer Science 2015-11-26 Hong Sun , Cheng-Wei Sang , Chen-Guang Liu

We study sparse principal component analysis in the high-dimensional, sample-limited regime, aiming to recover a leading component supported on a few coordinates. Despite extensive progress, most methods and analyses are tailored to the…

Information Theory · Computer Science 2025-12-18 Mengchu Xu , Jian Wang , Yonina C. Eldar