English
Related papers

Related papers: Detection boundary in sparse regression

200 papers

Statistical inferences for high-dimensional regression models have been extensively studied for their wide applications ranging from genomics, neuroscience, to economics. However, in practice, there are often potential unmeasured…

Methodology · Statistics 2023-09-12 Jing Ouyang , Kean Ming Tan , Gongjun Xu

The problem of sparse linear regression is relevant in the context of linear system identification from large datasets. When data are collected from real-world experiments, measurements are always affected by perturbations or low-precision…

Optimization and Control · Mathematics 2020-04-01 S. M. Fosson , V. Cerone , D. Regruto

Gaussian processes (GPs) are non-parametric probabilistic regression models that are popular due to their flexibility, data efficiency, and well-calibrated uncertainty estimates. However, standard GP models assume homoskedastic Gaussian…

Machine Learning · Computer Science 2025-01-08 Sebastian Ament , Elizabeth Santorella , David Eriksson , Ben Letham , Maximilian Balandat , Eytan Bakshy

Dimensionality reduction is an effective method for learning high-dimensional data, which can provide better understanding of decision boundaries in human-readable low-dimensional subspace. Linear methods, such as principal component…

Machine Learning · Computer Science 2020-07-09 Koji Maruhashi , Heewon Park , Rui Yamaguchi , Satoru Miyano

We propose a sparse regression method capable of discovering the governing partial differential equation(s) of a given system by time series measurements in the spatial domain. The regression framework relies on sparsity promoting…

Pattern Formation and Solitons · Physics 2016-09-22 Samuel H. Rudy , Steven L. Brunton , Joshua L. Proctor , J. Nathan Kutz

Generic event boundary detection (GEBD) aims to identify natural boundaries in a video, segmenting it into distinct and meaningful chunks. Despite the inherent subjectivity of event boundaries, previous methods have focused on deterministic…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Jaejun Hwang , Dayoung Gong , Manjin Kim , Minsu Cho

This paper presents uniform-in-time finite-sample bounds for regularized linear regression with vector-valued outputs and conditionally zero-mean subgaussian noise. By revisiting classical self-normalized martingale arguments, we obtain…

Statistics Theory · Mathematics 2026-03-20 Léo Simpson , Katrin Baumgärtner , Johannes Köhler , Moritz Diehl

The discovery of Partial Differential Equations (PDEs) is an essential task for applied science and engineering. However, data-driven discovery of PDEs is generally challenging, primarily stemming from the sensitivity of the discovered…

Machine Learning · Statistics 2024-03-27 Aoxue Chen , Yifan Du , Liyao Mars Gao , Guang Lin

The estimation of static parameters in dynamical systems and control theory has been extensively studied, with significant progress made in estimating varying parameters in specific system types. Suppose, in the general case, we have data…

Optimization and Control · Mathematics 2025-07-10 Jamiree Harrison , Enoch Yeung

We develop a fast variational approximation scheme for Gaussian process (GP) regression, where the spectrum of the covariance function is subjected to a sparse approximation. Our approach enables uncertainty in covariance function…

Computation · Statistics 2019-04-24 Linda S. L. Tan , Victor M. H. Ong , David J. Nott , Ajay Jasra

This paper develops a threshold regression model where an unknown relationship between two variables nonparametrically determines the threshold. We allow the observations to be cross-sectionally dependent so that the model can be applied to…

Econometrics · Economics 2021-01-29 Yoonseok Lee , Yulong Wang

We show that density models describing multiple observables with (i) hard boundaries and (ii) dependence on external parameters may be created using an auto-regressive Gaussian mixture model. The model is designed to capture how observable…

Data Analysis, Statistics and Probability · Physics 2022-02-01 Stephen B. Menary , Darren D. Price

This paper presents Sparse Partitioning, a Bayesian method for identifying predictors that either individually or in combination with others affect a response variable. The method is designed for regression problems involving binary or…

Quantitative Methods · Quantitative Biology 2011-08-31 Doug Speed , Simon Tavaré

Interference detection in gaussian noise is proposed. It can be applied for easy detection and editing of interference lines in radio spectral line observations. One need not know the position of occurence or keep track of interference in…

Instrumentation and Methods for Astrophysics · Physics 2015-05-20 Raju R Baddi

Generalization theory has been established for sparse deep neural networks under high-dimensional regime. Beyond generalization, parameter estimation is also important since it is crucial for variable selection and interpretability of deep…

Machine Learning · Statistics 2024-06-27 Dongya Wu , Xin Li

We consider the problem of estimating a deterministic sparse vector x from underdetermined measurements Ax+w, where w represents white Gaussian noise and A is a given deterministic dictionary. We analyze the performance of three sparse…

Statistics Theory · Mathematics 2015-05-13 Zvika Ben-Haim , Yonina C. Eldar , Michael Elad

In this letter, we address the problem of estimating Gaussian noise level from the trained dictionaries in update stage. We first provide rigorous statistical analysis on the eigenvalue distributions of a sample covariance matrix. Then we…

Signal Processing · Electrical Eng. & Systems 2017-12-12 Rui Chen , Changshui Yang , Huizhu Jia , Xiaodong Xie

We consider a high dimensional linear regression problem where the goal is to efficiently recover an unknown vector $\beta^*$ from $n$ noisy linear observations $Y=X\beta^*+W \in \mathbb{R}^n$, for known $X \in \mathbb{R}^{n \times p}$ and…

Statistics Theory · Mathematics 2018-11-12 David Gamarnik , Ilias Zadik

The detection of hidden two-dimensional Gauss-Markov random fields using sensor networks is considered. Under a conditional autoregressive model, the error exponent for the Neyman-Pearson detector satisfying a fixed level constraint is…

Information Theory · Computer Science 2016-11-15 Youngchul Sung , H. Vincent Poor , Heejung Yu

This paper presents an innovative approach to dimensionality reduction and feature extraction in high-dimensional datasets, with a specific application focus on wood surface defect detection. The proposed framework integrates sparse…

Machine Learning · Computer Science 2024-10-01 Harish Neelam , Koushik Sai Veerella , Souradip Biswas