English
Related papers

Related papers: Sparse Volterra and Polynomial Regression Models: …

200 papers

We present a novel method for exact hierarchical sparse polynomial regression. Our regressor is that degree $r$ polynomial which depends on at most $k$ inputs, counting at most $\ell$ monomial terms, which minimizes the sum of the squares…

Optimization and Control · Mathematics 2017-09-29 Dimitris Bertsimas , Bart Van Parys

In many statistical modeling problems, such as classification and regression, it is common to encounter sparse and blocky coefficients. Sparse fused Lasso is specifically designed to recover these sparse and blocky structured features,…

Statistics Theory · Mathematics 2024-05-30 Xiaofei Wu , Rongmei Liang , Zhimin Zhang , Zhenyu Cui

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a limited number of noisy linear measurements is an important problem in compressed sensing. In the high-dimensional setting, it is known that recovery with a…

Information Theory · Computer Science 2012-06-26 Galen Reeves , Michael Gastpar

Pre-trained large models attract widespread attention in recent years, but they face challenges in applications that require high interpretability or have limited resources, such as physical sensing, medical imaging, and bioinformatics.…

Machine Learning · Computer Science 2025-01-24 Chaoqing Tang , Huanze Zhuang , Guiyun Tian , Zhenli Zeng , Yi Ding , Wenzhong Liu , Xiang Bai

We investigate the sparse recovery problem of reconstructing a high-dimensional non-negative sparse vector from lower dimensional linear measurements. While much work has focused on dense measurement matrices, sparse measurement schemes are…

Information Theory · Computer Science 2009-02-25 M. Amin Khajehnejad , Alexandros G. Dimakis , Weiyu Xu , Babak Hassibi

Compressed sensing (CS) is a signal processing technique that enables the efficient recovery of a sparse high-dimensional signal from low-dimensional measurements. In the multiple measurement vector (MMV) framework, a set of signals with…

Signal Processing · Electrical Eng. & Systems 2022-06-08 Pavan K. Kota , Daniel LeJeune , Rebekah A. Drezek , Richard G. Baraniuk

This paper introduces a novel framework and corresponding methods for sampling and reconstruction of sparse signals in shift-invariant (SI) spaces. We reinterpret the random demodulator, a system that acquires sparse bandlimited signals, as…

Signal Processing · Electrical Eng. & Systems 2022-01-24 Tin Vlašić , Damir Seršić

Reliable and energy-efficient wireless data transmission remains a major challenge in resource-constrained wireless neural recording tasks, where data compression is generally adopted to relax the burdens on the wireless data link.…

Information Theory · Computer Science 2016-02-02 Biao Sun , Wenfeng Zhao , Xinshan Zhu

This paper introduces an efficient sparse recovery approach for Polynomial Chaos (PC) expansions, which promotes the sparsity by breaking the dimensionality of the problem. The proposed algorithm incrementally explores sub-dimensional…

Computation · Statistics 2017-04-05 Negin Alemazkoor , Hadi Meidani

The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables $p_n$ is potentially much larger than the number of samples $n$. However, it was recently…

Statistics Theory · Mathematics 2009-03-02 Nicolai Meinshausen , Bin Yu

With massive high-dimensional data now commonplace in research and industry, there is a strong and growing demand for more scalable computational techniques for data analysis and knowledge discovery. Key to turning these data into knowledge…

Data Structures and Algorithms · Computer Science 2016-06-17 Yasuo Tabei , Hiroto Saigo , Yoshihiro Yamanishi , Simon J. Puglisi

Sparse subspace clustering (SSC) relies on sparse regression for accurate neighbor identification. Inspired by recent progress in compressive sensing, this paper proposes a new sparse regression scheme for SSC via two-step reweighted…

Information Theory · Computer Science 2019-07-18 Jwo-Yuh Wu , Liang-Chi Huang , Ming-Hsun Yang , Chun-Hung Liu

Compressed Sensing (CS) is an appealing framework for applications such as Magnetic Resonance Imaging (MRI). However, up-to-date, the sensing schemes suggested by CS theories are made of random isolated measurements, which are usually…

Information Theory · Computer Science 2016-06-14 Claire Boyer , Jérémie Bigot , Pierre Weiss

Discovering the partial differential equations underlying spatio-temporal datasets from very limited and highly noisy observations is of paramount interest in many scientific fields. However, it remains an open question to know when model…

Machine Learning · Statistics 2021-10-06 Georges Tod , Gert-Jan Both , Remy Kusters

We propose dimension reduction methods for sparse, high-dimensional multivariate response regression models. Both the number of responses and that of the predictors may exceed the sample size. Sometimes viewed as complementary, predictor…

Statistics Theory · Mathematics 2013-02-14 Florentina Bunea , Yiyuan She , Marten H. Wegkamp

Both linear mixed models (LMMs) and sparse regression models are widely used in genetics applications, including, recently, polygenic modeling in genome-wide association studies. These two approaches make very different assumptions, so are…

Quantitative Methods · Quantitative Biology 2012-11-16 Xiang Zhou , Peter Carbonetto , Matthew Stephens

Neural networks are usually not the tool of choice for nonparametric high-dimensional problems where the number of input features is much larger than the number of observations. Though neural networks can approximate complex multivariate…

Methodology · Statistics 2019-06-25 Jean Feng , Noah Simon

Posynomials are nonnegative combinations of monomials with possibly fractional and both positive and negative exponents. Posynomial models are widely used in various engineering design endeavors, such as circuits, aerospace and structural…

Systems and Control · Computer Science 2014-03-17 Giuseppe C. Calafiore , Laurent El Ghaoui , Carlo Novara

Compressive sensing(CS) has drawn much attention in recent years due to its low sampling rate as well as high recovery accuracy. As an important procedure, reconstructing a sparse signal from few measurement data has been intensively…

Information Theory · Computer Science 2018-06-25 Yicong He , Fei Wang , Shiyuan Wang , Badong Chen

A trend in compressed sensing (CS) is to exploit structure for improved reconstruction performance. In the basic CS model, exploiting the clustering structure among nonzero elements in the solution vector has drawn much attention, and many…

Computation · Statistics 2011-06-13 Zhilin Zhang , Bhaskar D. Rao