English
Related papers

Related papers: The Dantzig selector and sparsity oracle inequalit…

200 papers

In this work, we consider two sets of dependent variables $\{X_{1},\ldots,X_{n}\}$ and $\{Y_{1},\ldots,Y_{n}\}$, where $X_{i}\sim EW(\alpha_{i},\lambda_{i},k_{i})$ and $Y_{i}\sim EW(\beta_{i},\mu_{i},l_{i})$, for $i=1,\ldots, n$, which are…

Other Statistics · Statistics 2024-12-18 Ramkrishna Jyoti Samanta , Sangita Das , N. Balakrishnan

The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables $p_n$ is potentially much larger than the number of samples $n$. However, it was recently…

Statistics Theory · Mathematics 2009-03-02 Nicolai Meinshausen , Bin Yu

The difference equations $\xi_{k}=af(\xi_{k-1})+\epsilon_{k}$, where $(\epsilon_k)$ is a square integrable difference martingale, and the differential equation ${\rm d}\xi=-af(\xi){\rm d}t+{\rm d}\eta$, where $\eta$ is a square integrable…

Statistics Theory · Mathematics 2007-07-11 Dmytro Ivanenko

In this article we obtain an "off-diagonal" version of the Fefferman-Stein vector-valued maximal inequality on weighted Lebesgue spaces with variable exponents. As an application of this result and the atomic decomposition developed in [12]…

Classical Analysis and ODEs · Mathematics 2022-11-28 Pablo Rocha

We show that in the point process limit of the bulk eigenvalues of $\beta$-ensembles of random matrices, the probability of having no eigenvalue in a fixed interval of size $\lambda$ is given by \[\bigl(\…

Probability · Mathematics 2016-08-14 Benedek Valkó , Bálint Virág

Dantzig Selector (DS) is widely used in compressed sensing and sparse learning for feature selection and sparse signal recovery. Since the DS formulation is essentially a linear programming optimization, many existing linear programming…

Machine Learning · Computer Science 2018-11-05 Bo Liu , Luwan Zhang , Ji Liu

The Rasch model has been widely used to analyse item response data in psychometrics and educational assessments. When the number of individuals and items are large, it may be impractical to provide all possible responses. It is desirable to…

Statistics Theory · Mathematics 2025-01-15 Pai Peng , Lianqiang Qu , Qiuping Wang , Shufang Wang , Ting Yan

Let $\Omega \subset \mathbb{R}^d$ be a bounded open connected set with Lipschitz boundary. Let $A^N$ and $A^D$ be the Neumann Stokes operator and Dirichlet Stokes operator on $\Omega$, respectively. Further let $\lambda_1^N \leq \lambda_2^N…

Analysis of PDEs · Mathematics 2022-03-24 C. Denis , A. F. M. ter Elst

We investigate the behavior of the nonparametric maximum likelihood estimator $\hat{f}_n$ for a decreasing density $f$ near the boundaries of the support of $f$. We establish the limiting distribution of $\hat{f}_n(n^{-\alpha})$, where we…

Statistics Theory · Mathematics 2016-08-16 Vladimir N. Kulikov , Hendrik P. Lopuhaä

We consider approximations of signals by the elements of a frame in a complex vector space of dimension $N$ and formulate both the noiseless and the noisy sparse representation problems. The noiseless representation problem is to find…

Information Theory · Computer Science 2007-07-13 Mehmet Akçakaya , Vahid Tarokh

We present theoretical guarantees for an alternating minimization algorithm for the dictionary learning/sparse coding problem. The dictionary learning problem is to factorize vector samples $y^{1},y^{2},\ldots, y^{n}$ into an appropriate…

Machine Learning · Statistics 2019-08-01 Niladri S. Chatterji , Peter L. Bartlett

We prove the following analogue of the classical Skitovich--Darmois theorem for complex random variables. Let $\alpha=a+ib$ be a nonzero complex number. Then the following statements hold. $1$. Let either $b\ne 0$, or $b=0$ and $a>0$. Let…

Probability · Mathematics 2020-01-23 G. M. Feldman

For a positive integer $n$ and a real number $\xi$, let $\lambda_n (\xi)$ denote the supremum of the real numbers $\lambda$ for which there are arbitrarily large positive integers $q$ such that $|| q \xi ||, || q \xi^2 ||, \ldots , ||q…

Number Theory · Mathematics 2019-06-14 Dmitry Badziahin , Yann Bugeaud

We consider the problem of sparsity testing in the high-dimensional linear regression model. The problem is to test whether the number of non-zero components (aka the sparsity) of the regression parameter $\theta^*$ is less than or equal to…

Statistics Theory · Mathematics 2020-04-24 Alexandra Carpentier , Nicolas Verzelen

We study high-dimensional linear models and the $\ell_1$-penalized least squares estimator, also known as the Lasso estimator. In literature, oracle inequalities have been derived under restricted eigenvalue or compatibility conditions. In…

Methodology · Statistics 2011-07-04 Sara van de Geer , Johannes Lederer

We provide a unified framework to proving pointwise convergence of sparse sequences, deterministic and random, at the $L^1(X)$ endpoint. Specifically, suppose that \[ a_n \in \{ \lfloor n^c \rfloor, \min\{ k : \sum_{j \leq k} X_j = n\} \}…

Dynamical Systems · Mathematics 2026-03-10 Ben Krause , Yu-Chen Sun

Consider estimating a structured signal $\mathbf{x}_0$ from linear, underdetermined and noisy measurements $\mathbf{y}=\mathbf{A}\mathbf{x}_0+\mathbf{z}$, via solving a variant of the lasso algorithm: $\hat{\mathbf{x}}=\arg\min_\mathbf{x}\{…

Optimization and Control · Mathematics 2014-01-28 Christos Thrampoulidis , Samet Oymak , Babak Hassibi

Random walks in random scenery are processes defined by $Z_n:=\sum_{k=1}^n\xi_{X_1+...+X_k}$, where $(X_k,k\ge 1)$ and $(\xi_y,y\in\mathbb Z)$ are two independent sequences of i.i.d. random variables. We assume here that their distributions…

Probability · Mathematics 2010-02-10 Fabienne Castell , Nadine Guillotin-Plantard , Françoise Pène , Bruno Schapira

We calculate analytically the probability of large deviations from its mean of the largest (smallest) eigenvalue of random matrices belonging to the Gaussian orthogonal, unitary and symplectic ensembles. In particular, we show that the…

Statistical Mechanics · Physics 2009-11-11 David S. Dean , Satya N. Majumdar

It is more and more frequently the case in applications that the data we observe come from one or more random variables taking values in an infinite dimensional space, e.g. curves. The need to have tools adapted to the nature of these data…

Statistics Theory · Mathematics 2023-06-01 Angelina Roche