English
Related papers

Related papers: Stochastic Lipschitz continuity for high dimension…

200 papers

We study high-dimensional regression with missing entries in the covariates. A common strategy in practice is to \emph{impute} the missing entries with an appropriate substitute and then implement a standard statistical procedure acting as…

Statistics Theory · Mathematics 2020-01-28 Kabir Aladin Chandrasekher , Ahmed El Alaoui , Andrea Montanari

Stochastic differential equations of Langevin-diffusion form have received significant attention, thanks to their foundational role in both Bayesian sampling algorithms and optimization in machine learning. In the latter, they serve as a…

Optimization and Control · Mathematics 2024-05-14 Fabio V. Difonzo , Vyacheslav Kungurtsev , Jakub Marecek

We provide a simple method to estimate the parameters of multivariate stochastic volatility models with latent factor structures. These models are very useful as they alleviate the standard curse of dimensionality, allowing the number of…

Econometrics · Economics 2023-02-15 Giorgio Calzolari , Roxana Halbleib , Christian Mücher

The paper concerns foundations of sensitivity and stability analysis in optimization and related areas, being primarily addressed truncated constrained systems. We consider general models, which are described by multifunctions between…

Optimization and Control · Mathematics 2025-04-30 Boris S. Mordukhovich , Pengcheng Wu , Xiaoqi Yang

In this paper we present the framework of symmetry in nonparametric regression. This generalises the framework of covariate sparsity, where the regression function depends only on at most $s < d$ of the covariates, which is a special case…

Statistics Theory · Mathematics 2024-04-22 Louis G. Christie , John A. D. Aston

Lasso is a popular and efficient approach to simultaneous estimation and variable selection in high-dimensional regression models. In this paper, a robust LAD-lasso method for multiple outcomes is presented that addresses the challenges of…

Methodology · Statistics 2022-12-02 Jyrki Möttönen , Tero Lähderanta , Janne Salonen , Mikko J. Sillanpää

In this paper, we deal with one dimensional backward doubly stochastic differential equations (BDSDEs) where the coefficient is left Lipschitz in y (may be discontinuous) and uniformly continuous in z. We obtain a generalized comparison…

Probability · Mathematics 2011-05-25 Qian Lin

We consider the problem of extracting a low-dimensional, linear latent variable structure from high-dimensional random variables. Specifically, we show that under mild conditions and when this structure manifests itself as a linear space…

Machine Learning · Statistics 2015-10-14 Xiongzhi Chen , John D. Storey

The lasso has been studied extensively as a tool for estimating the coefficient vector in the high-dimensional linear model; however, considerably less is known about estimating the error variance in this context. In this paper, we propose…

Methodology · Statistics 2019-07-22 Guo Yu , Jacob Bien

We develop a finite-sample optimal estimator for regression discontinuity design when the outcomes are bounded, including binary outcomes as the leading case. Our estimator achieves minimax mean squared error among linear shrinkage…

Econometrics · Economics 2025-12-29 Takuya Ishihara , Masayuki Sawada , Kohei Yata

We study the estimation capacity of the generalized Lasso, i.e., least squares minimization combined with a (convex) structural constraint. While Lasso-type estimators were originally designed for noisy linear regression problems, it has…

Statistics Theory · Mathematics 2019-09-12 Martin Genzel , Gitta Kutyniok

Stochastic programming models can lead to very large-scale optimization problems for which it may be impossible to enumerate all possible scenarios. In such cases, one adopts a sampling-based solution methodology in which case the…

Optimization and Control · Mathematics 2024-05-20 Shuotao Diao , Suvrajeet Sen

In the present paper, a systematic study is made of quantitative semicontinuity (a.k.a. Lipschitzian) properties of certain multifunctions, which are defined as a solution map associated to a family of parameterized ``split" feasibility…

Optimization and Control · Mathematics 2026-04-01 Amos Uderzo

We consider linear random coefficient regression models, where the regressors are allowed to have a finite support. First, we investigate identifiability, and show that the means and the variances and covariances of the random coefficients…

Statistics Theory · Mathematics 2023-06-16 Philipp Hermann , Hajo Holzmann

Beside the minimization of the prediction error, two of the most desirable properties of a regression scheme are stability and interpretability. Driven by these principles, we propose continuous-domain formulations for one-dimensional…

Machine Learning · Computer Science 2021-12-28 Shayan Aziznejad , Thomas Debarre , Michael Unser

In this paper we study reflected backward stochastic differential equations with a continuous, linear growth coefficient and two barriers which belong to L^2. We prove that there exists at least by penalization method.

Probability · Mathematics 2008-07-15 Shaolin Ji , Zhen Wu , Li Zhou

We develop a higher regularity theory for general quasilinear elliptic equations and systems in divergence form with random coefficients. The main result is a large-scale $L^\infty$-type estimate for the gradient of a solution. The estimate…

Analysis of PDEs · Mathematics 2016-01-27 Scott N. Armstrong , Jean-Christophe Mourrat

This paper is concerned with inference on the regression function of a high-dimensional linear model when outcomes are missing at random. We propose an estimator which combines a Lasso pilot estimate of the regression function with a bias…

Methodology · Statistics 2024-12-11 Yikun Zhang , Alexander Giessing , Yen-Chi Chen

The lasso is a popular tool for sparse linear regression, especially for problems in which the number of variables p exceeds the number of observations n. But when p>n, the lasso criterion is not strictly convex, and hence it may not have a…

Statistics Theory · Mathematics 2012-11-06 Ryan J. Tibshirani

Variance estimation in the linear model when $p > n$ is a difficult problem. Standard least squares estimation techniques do not apply. Several variance estimators have been proposed in the literature, all with accompanying asymptotic…

Methodology · Statistics 2014-01-30 Stephen Reid , Robert Tibshirani , Jerome Friedman