English
Related papers

Related papers: Stochastic Lipschitz continuity for high dimension…

200 papers

Generalized linear model or GLM constitutes a large class of models and essentially extends the ordinary linear regression by connecting the mean of the response variable with the covariate through appropriate link functions. On the other…

Methodology · Statistics 2026-02-03 Mayukh Choudhury , Debraj Das

Lower and upper bounds for a given function are important in many mathematical and engineering contexts, where they often serve as a base for both analysis and application. In this short paper, we derive piecewise linear and quadratic…

Optimization and Control · Mathematics 2014-06-17 Gene A. Bunin , Grégory François , Dominique Bonvin

We propose a new testing procedure of heteroskedasticity in high-dimensional linear regression, where the number of covariates can be larger than the sample size. Our testing procedure is based on residuals of the Lasso. We demonstrate that…

Statistics Theory · Mathematics 2022-11-01 Akira Shinkyu

Given data $y$ and $k$ covariates $x$ one problem in linear regression is to decide which in any of the covariates to include when regressing $y$ on the $x$. If $k$ is small it is possible to evaluate each subset of the $x$. If however $k$…

Statistics Theory · Mathematics 2016-05-17 Patrick Laurie Davies

This manuscript bridges nonparametric smoothness-based and shape-restricted estimation, which may appear as two disjoint paradigms in the field. The proposed approach is motivated by a conceptually simple observation: every Lipschitz…

Methodology · Statistics 2026-05-22 Kenta Takatsu , Tianyu Zhang , Arun Kumar Kuchibhotla

We consider the finite sample properties of the regularized high-dimensional Cox regression via lasso. Existing literature focuses on linear models or generalized linear models with Lipschitz loss functions, where the empirical risk…

Statistics Theory · Mathematics 2012-04-11 Shengchun Kong , Bin Nan

In this paper, we propose a novel variable selection approach in the framework of multivariate linear models taking into account the dependence that may exist between the responses. It consists in estimating beforehand the covariance matrix…

Statistics Theory · Mathematics 2017-07-14 Marie Perrot-Dockès , Céline Lévy-Leduc , Laure Sansonnet , Julien Chiquet

Biased sampling designs can be highly efficient when studying rare (binary) or low variability (continuous) endpoints. We consider longitudinal data settings in which the probability of being sampled depends on a repeatedly measured…

We consider an inverse problem of reconstructing two spatially varying coefficients in an acoustic equation of hyperbolic type using interior data of solutions with suitable choices of initial condition. Using a Carleman estimate, we prove…

Analysis of PDEs · Mathematics 2018-01-17 L. Beilina , M. Cristofol , S. Li , M. Yamamoto

Inferring causal relationships or related associations from observational data can be invalidated by the existence of hidden confounding. We focus on a high-dimensional linear regression setting, where the measured covariates are affected…

Methodology · Statistics 2021-07-22 Zijian Guo , Domagoj Ćevid , Peter Bühlmann

Many theoretical results in the machine learning domain stand only for functions that are Lipschitz continuous. Lipschitz continuity is a strong form of continuity that linearly bounds the variations of a function. In this paper, we derive…

Numerical Analysis · Computer Science 2016-04-06 Valentina Zantedeschi , Rémi Emonet , Marc Sebban

In the first part of the paper we continue the study of solutions to Schr\"odinger equations with a time singularity in the dispersive relation and in the periodic setting. In the second we show that if the Schr\"odinger operator involves a…

Analysis of PDEs · Mathematics 2022-01-14 Serena Federico , Gigliola Staffilani

The regularity and characterization of solutions to degenerate, quasilinear SPDE is studied. Our results are two-fold: First, we prove regularity results for solutions to certain degenerate, quasilinear SPDE driven by Lipschitz continuous…

Probability · Mathematics 2014-05-23 Benjamin Gess , Michael Röckner

We introduce the notion of stochastic logarithmic Lipschitz constants and use these constants to characterize stochastic contractivity of It\^o stochastic differential equations (SDEs) with multiplicative noise. We find an upper bound for…

Systems and Control · Electrical Eng. & Systems 2021-11-08 Zahra Aminzare

Volatility forecasts are key inputs in financial analysis. While lasso based forecasts have shown to perform well in many applications, their use to obtain volatility forecasts has not yet received much attention in the literature. Lasso…

Applications · Statistics 2016-10-11 Ines Wilms , Jeroen Rombouts , Christophe Croux

This paper focuses on systems of nonlinear second-order stochastic differential equations with multi-scales. The motivation for our study stems from mathematical physics and statistical mechanics, for examples, Langevin dynamics and…

Probability · Mathematics 2024-04-08 Nhu N. Nguyen , George Yin

The Lasso is a method for high-dimensional regression, which is now commonly used when the number of covariates $p$ is of the same order or larger than the number of observations $n$. Classical asymptotic normality theory does not apply to…

Statistics Theory · Mathematics 2023-09-20 Michael Celentano , Andrea Montanari , Yuting Wei

We consider an infinite horizon, obliquely reflected backward stochastic differential equation (RBSDE). The main contribution of the present work is that we generalize previous results on infinite horizon reflected BSDEs to the setting…

Probability · Mathematics 2023-09-21 Magnus Perninge

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

It is well-known that the statistical performance of Lasso can suffer significantly when the covariates of interest have strong correlations. In particular, the prediction error of Lasso becomes much worse than computationally inefficient…

Machine Learning · Statistics 2024-02-26 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi