English
Related papers

Related papers: Detection of sparse additive functions

200 papers

We investigate fast methods that allow to quickly eliminate variables (features) in supervised learning problems involving a convex loss function and a $l_1$-norm penalty, leading to a potentially substantial reduction in the number of…

Machine Learning · Computer Science 2010-10-28 Laurent El Ghaoui , Vivian Viallon , Tarek Rabbani

Additive regression provides an extension of linear regression by modeling the signal of a response as a sum of functions of covariates of relatively low complexity. We study penalized estimation in high-dimensional nonparametric additive…

Statistics Theory · Mathematics 2017-04-25 Zhiqiang Tan , Cun-Hui Zhang

The performance of Bayesian detection of Gaussian signals using noisy observations is investigated via the error exponent for the average error probability. Under unknown signal correlation structure or limited processing capability it is…

Information Theory · Computer Science 2009-11-11 Youngchul Sung , Lang Tong , H. Vincent Poor

We assume a spatial blind source separation model in which the observed multivariate spatial data is a linear mixture of latent spatially uncorrelated Gaussian random fields containing a number of pure white noise components. We propose a…

Statistics Theory · Mathematics 2024-04-12 Christoph Muehlmann , François Bachoc , Klaus Nordhausen , Mengxi Yi

This paper addresses the detection of a stochastic process in noise from irregular samples. We consider two hypotheses. The \emph{noise only} hypothesis amounts to model the observations as a sample of a i.i.d. Gaussian random variables…

Information Theory · Computer Science 2009-09-25 Walid Hachem , Eric Moulines , Francois Roueff

Deep neural networks have emerged as powerful tools for learning operators defined over infinite-dimensional function spaces. However, existing theories frequently encounter difficulties related to dimensionality and limited…

Machine Learning · Computer Science 2026-05-12 Jianfei Li , Shuo Huang , Han Feng , Ding-Xuan Zhou , Gitta Kutyniok

One of the key challenges in sensor networks is the extraction of information by fusing data from a multitude of distinct, but possibly unreliable sensors. Recovering information from the maximum number of dependable sensors while…

Machine Learning · Statistics 2015-05-20 Vassilis Kekatos , Georgios B. Giannakis

We consider the high-dimensional inference problem where the signal is a low-rank symmetric matrix which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low-rank matrix, we compute the limit in the large…

Probability · Mathematics 2017-03-31 Marc Lelarge , Léo Miolane

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Computer Science 2015-08-25 Rémi Gribonval , Rodolphe Jenatton , Francis Bach

Compressed sensing is a signal processing technique in which data is acquired directly in a compressed form. There are two modeling approaches that can be considered: the worst-case (Hamming) approach and a statistical mechanism, in which…

Information Theory · Computer Science 2016-01-20 Wasim Huleihel , Neri Merhav

We study the problem of estimating multiple predictive functions from a dictionary of basis functions in the nonparametric regression setting. Our estimation scheme assumes that each predictive function can be estimated in the form of a…

Machine Learning · Computer Science 2012-06-05 Jianhui Chen , Jieping Ye

We discuss a general approach to handling "multiple hypotheses" testing in the case when a particular hypothesis states that the vector of parameters identifying the distribution of observations belongs to a convex compact set associated…

Statistics Theory · Mathematics 2016-02-24 A. Goldenshluger , A. Juditski , A. Nemirovski

We propose a nonparametric method for detecting nonlinear causal relationship within a set of multidimensional discrete time series, by using sparse additive models (SpAMs). We show that, when the input to the SpAM is a $\beta$-mixing time…

Machine Learning · Statistics 2018-04-27 Yingxiang Yang , Adams Wei Yu , Zhaoran Wang , Tuo Zhao

The aim of this paper is to present an extension of the well-known as-ymptotic equivalence between density estimation experiments and a Gaussian white noise model. Our extension consists in enlarging the nonparametric class of the…

Probability · Mathematics 2015-03-18 Ester Mariucci

Estimation and prediction problems for dense signals are often framed in terms of minimax problems over highly symmetric parameter spaces. In this paper, we study minimax problems over l2-balls for high-dimensional linear models with…

Statistics Theory · Mathematics 2012-03-22 Lee Dicker

We consider the problem of detecting a change in mean in a sequence of Gaussian vectors. Under the alternative hypothesis, the change occurs only in some subset of the components of the vector. We propose a test of the presence of a…

Statistics Theory · Mathematics 2014-02-28 Farida Enikeeva , Zaid Harchaoui

This paper proposes a bootstrap-assisted procedure to conduct simultaneous inference for high dimensional sparse linear models based on the recent de-sparsifying Lasso estimator (van de Geer et al. 2014). Our procedure allows the dimension…

Statistics Theory · Mathematics 2016-03-07 Xianyang Zhang , Guang Cheng

In this paper, we observe a sparse mean vector through Gaussian noise and we aim at estimating some additive functional of the mean in the minimax sense. More precisely, we generalize the results of (Collier et al., 2017, 2019) to a very…

Statistics Theory · Mathematics 2019-08-30 Olivier Collier , Laëtitia Comminges

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Statistics 2012-10-03 Rodolphe Jenatton , Rémi Gribonval , Francis Bach

We study sparse group Lasso for high-dimensional double sparse linear regression, where the parameter of interest is simultaneously element-wise and group-wise sparse. This problem is an important instance of the simultaneously structured…

Statistics Theory · Mathematics 2022-05-10 T. Tony Cai , Anru R. Zhang , Yuchen Zhou
‹ Prev 1 3 4 5 6 7 10 Next ›