English
Related papers

Related papers: Stochastic Lipschitz continuity for high dimension…

200 papers

Missing values in datasets are common in applied statistics. For regression problems, theoretical work thus far has largely considered the issue of missing covariates as distinct from missing responses. However, in practice, many datasets…

Statistics Theory · Mathematics 2026-02-17 Benedict M. Risebrow , Thomas B. Berrett

Estimation of solution norms and stability for time-dependent nonlinear systems is ubiquitous in numerous applied and control problems. Yet, practically valuable results are rare in this area. This paper develops a novel approach, which…

Dynamical Systems · Mathematics 2018-08-29 Mark A. Pinsky , Steve Koblik

Hierarchical learning models, such as mixture models and Bayesian networks, are widely employed for unsupervised learning tasks, such as clustering analysis. They consist of observable and hidden variables, which represent the given data…

Machine Learning · Statistics 2018-01-08 Keisuke Yamazaki

We establish interior Lipschitz estimates at the macroscopic scale for solutions to systems of linear elasticity with rapidly oscillating periodic coefficients and mixed boundary conditions in domains periodically perforated at a…

Analysis of PDEs · Mathematics 2017-04-12 B. Chase Russell

Meinshausen and Buhlmann [Ann. Statist. 34 (2006) 1436--1462] showed that, for neighborhood selection in Gaussian graphical models, under a neighborhood stability condition, the LASSO is consistent, even when the number of variables is of…

Statistics Theory · Mathematics 2008-08-08 Cun-Hui Zhang , Jian Huang

When we are interested in high-dimensional system and focus on classification performance, the $\ell_{1}$-penalized logistic regression is becoming important and popular. However, the Lasso estimates could be problematic when penalties of…

Machine Learning · Statistics 2020-06-12 Huamei Huang , Yujing Gao , Huiming Zhang , Bo Li

Stochastic differential equations are often simulated with the Monte Carlo Euler method. Convergence of this method is well understood in the case of globally Lipschitz continuous coefficients of the stochastic differential equation. The…

Numerical Analysis · Mathematics 2011-11-18 Martin Hutzenthaler , Arnulf Jentzen

We study the problem of signal estimation from non-linear observations when the signal belongs to a low-dimensional set buried in a high-dimensional space. A rough heuristic often used in practice postulates that non-linear observations may…

Information Theory · Computer Science 2015-11-17 Yaniv Plan , Roman Vershynin

Motivated by recent works on the high-dimensional logistic regression, we establish that the existence of the maximum likelihood estimate exhibits a phase transition for a wide range of generalized linear models with binary outcome and…

Statistics Theory · Mathematics 2020-12-18 Wenpin Tang , Yuting Ye

A multiscale optimization framework for problems over a space of Lipschitz continuous functions is developed. The method solves a coarse-grid discretization followed by linear interpolation to warm-start project gradient descent on…

Numerical Analysis · Mathematics 2026-03-05 Nicholas J. E. Richardson , Noah Marusenko , Michael P. Friedlander

We are interested in the inverse problem of recovering a Robin coefficient defined on some non accessible part of the boundary from available data on another part of the boundary in the nonstationary Stokes system. We prove a Lipschitz…

Analysis of PDEs · Mathematics 2013-09-11 Anne-Claire Egloffe

The Lipschitz constant of the map between the input and output space represented by a neural network is a natural metric for assessing the robustness of the model. We present a new method to constrain the Lipschitz constant of dense deep…

Machine Learning · Computer Science 2023-08-22 Ouail Kitouni , Niklas Nolte , Mike Williams

The strong convergence of Euler approximations of stochastic delay differential equations is proved under general conditions. The assumptions on drift and diffusion coefficients have been relaxed to include polynomial growth and only…

Probability · Mathematics 2013-03-07 Chaman Kumar , Sotirios Sabanis

Probabilistic learning is increasingly being tackled as an optimization problem, with gradient-based approaches as predominant methods. When modelling multivariate likelihoods, a usual but undesirable outcome is that the learned model fits…

Machine Learning · Computer Science 2020-10-23 Adrián Javaloy , Isabel Valera

Longitudinal data are important in numerous fields, such as healthcare, sociology and seismology, but real-world datasets present notable challenges for practitioners because they can be high-dimensional, contain structured missingness…

Machine Learning · Computer Science 2024-07-01 Maksim Sinelnikov , Manuel Haussmann , Harri Lähdesmäki

Residual variance and the signal-to-noise ratio are important quantities in many statistical models and model fitting procedures. They play an important role in regression diagnostics, in determining the performance limits in estimation and…

Methodology · Statistics 2012-09-04 Lee H. Dicker

The classical result by It\^o on the existence of strong solutions of stochastic differential equations (SDEs) with Lipschitz coefficients can be extended to the case where the drift is only measurable and bounded. These generalizations are…

Probability · Mathematics 2021-10-05 Gunther Leobacher , Michaela Szölgyenyi , Stefan Thonhauser

We show that every real-valued Lipschitz function on a subset of a metric space can be extended to the whole space while preserving the slope and, up to a small error, the global Lipschitz constant. This answers a question posed by Di…

Metric Geometry · Mathematics 2025-07-29 Nicolò De Ponti , Jacopo Somaglia

Motivated by neural network training in finite-precision arithmetic environments, this work studies the convergence of perturbed iterate SGD using adaptive step sizes in an environment with numerical error. Considering a general stochastic…

Optimization and Control · Mathematics 2025-09-10 Michael R. Metel

We study the nonparametric least squares estimator (LSE) of a multivariate convex regression function. The LSE, given as the solution to a quadratic program with $O(n^2)$ linear constraints ($n$ being the sample size), is difficult to…

Computation · Statistics 2015-09-29 Rahul Mazumder , Arkopal Choudhury , Garud Iyengar , Bodhisattva Sen