English
Related papers

Related papers: From dense to sparse design: Optimal rates under t…

200 papers

This paper proposes and analyzes fully data driven methods for inference about the mean function of a stochastic process from a sample of independent trajectories of the process, observed at discrete time points and corrupted by additive…

Methodology · Statistics 2009-05-20 F. Bunea , M. H. Wegkamp , A. E. Ivanescu

In high dimensional sparse regression, pivotal estimators are estimators for which the optimal regularization parameter is independent of the noise level. The canonical pivotal estimator is the square-root Lasso, formulated along with its…

Machine Learning · Statistics 2020-09-04 Mathurin Massias , Quentin Bertrand , Alexandre Gramfort , Joseph Salmon

The Lasso is one of the most important approaches for parameter estimation and variable selection in high dimensional linear regression. At the heart of its success is the attractive rate of convergence result even when $p$, the dimension…

Statistics Theory · Mathematics 2019-08-09 Junlong Zhao , Chenlei Leng

Decentralized sparsity learning has attracted a significant amount of attention recently due to its rapidly growing applications. To obtain the robust and sparse estimators, a natural idea is to adopt the non-smooth median loss combined…

Machine Learning · Statistics 2022-03-02 Weidong Liu , Xiaojun Mao , Xin Zhang

Estimation of the mean and covariance parameters for functional data is a critical task, with local linear smoothing being a popular choice. In recent years, many scientific domains are producing multivariate functional data for which $p$,…

Statistics Theory · Mathematics 2024-09-24 Alexander Petersen

We establish minimax convergence rates for classification of functional data and for nonparametric regression with functional design variables. The optimal rates are of logarithmic type under smoothness constraints on the functional density…

Statistics Theory · Mathematics 2016-03-31 Alexander Meister

We consider the high-dimensional discriminant analysis problem. For this problem, different methods have been proposed and justified by establishing exact convergence rates for the classification risk, as well as the l2 convergence results…

Machine Learning · Statistics 2013-06-28 Mladen Kolar , Han Liu

Many conventional statistical procedures are extremely sensitive to seemingly minor deviations from modeling assumptions. This problem is exacerbated in modern high-dimensional settings, where the problem dimension can grow with and…

Machine Learning · Statistics 2017-02-27 Simon S. Du , Sivaraman Balakrishnan , Aarti Singh

Signal processing is rich in inherently continuous and often nonlinear applications, such as spectral estimation, optical imaging, and super-resolution microscopy, in which sparsity plays a key role in obtaining state-of-the-art results.…

Machine Learning · Computer Science 2020-03-23 Luiz F. O. Chamon , Yonina C. Eldar , Alejandro Ribeiro

Functional linear regression is one of the fundamental and well-studied methods in functional data analysis. In this work, we investigate the functional linear regression model within the context of reproducing kernel Hilbert space by…

Statistics Theory · Mathematics 2024-12-12 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

A central topic in functional data analysis is how to design an optimaldecision rule, based on training samples, to classify a data function. We exploit the optimal classification problem when data functions are Gaussian processes. Sharp…

Methodology · Statistics 2021-09-14 Shuoyang Wang , Zuofeng Shang , Guanqun Cao , Jun Liu

This paper establishes optimal convergence rates for estimation of structured covariance operators of Gaussian processes. We study banded operators with kernels that decay rapidly off-the-diagonal and $L^q$-sparse operators with an…

Statistics Theory · Mathematics 2025-07-01 Omar Al-Ghattas , Jiaheng Chen , Daniel Sanz-Alonso , Nathan Waniorek

Estimation of convex functions finds broad applications in engineering and science, while convex shape constraint gives rise to numerous challenges in asymptotic performance analysis. This paper is devoted to minimax optimal estimation of…

Statistics Theory · Mathematics 2013-06-11 Teresa M. Lebair , Jinglai Shen , Xiao Wang

In sparse linear regression, the SLOPE estimator generalizes LASSO by penalizing different coordinates of the estimate according to their magnitudes. In this paper, we present a precise performance characterization of SLOPE in the…

Information Theory · Computer Science 2021-06-07 Hong Hu , Yue M. Lu

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. While naturally cast as a combinatorial optimization problem, variable or feature selection admits a convex relaxation through the…

Machine Learning · Computer Science 2012-04-23 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

We develop a novel methodology for detecting abrupt break points in mean functions of functional time series, adaptable to arbitrary sampling schemes. By employing B-spline smoothing, we introduce $\mathcal L_{\infty}$ and $\mathcal L_2$…

Methodology · Statistics 2024-12-31 Leheng Cai , Qirui Hu

The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables $p_n$ is potentially much larger than the number of samples $n$. However, it was recently…

Statistics Theory · Mathematics 2009-03-02 Nicolai Meinshausen , Bin Yu

This paper considers estimation of sparse covariance matrices and establishes the optimal rate of convergence under a range of matrix operator norm and Bregman divergence losses. A major focus is on the derivation of a rate sharp minimax…

Statistics Theory · Mathematics 2013-02-14 T. Tony Cai , Harrison H. Zhou

The spectral density function describes the second-order properties of a stationary stochastic process on $\mathbb{R}^d$. This paper considers the nonparametric estimation of the spectral density of a continuous-time stochastic process…

Statistics Theory · Mathematics 2023-02-07 Rafail Kartsioukas , Stilian Stoev , Tailen Hsing

Sparse polynomial approximation has become indispensable for approximating smooth, high- or infinite-dimensional functions from limited samples. This is a key task in computational science and engineering, e.g., surrogate modelling in…

Numerical Analysis · Mathematics 2023-11-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga