English
Related papers

Related papers: Nonlinear Matrix Concentration via Semigroup Metho…

200 papers

Regularized nonnegative low-rank approximations, such as sparse Nonnegative Matrix Factorization or sparse Nonnegative Tucker Decomposition, form an important branch of dimensionality reduction models known for their enhanced…

Machine Learning · Computer Science 2025-01-31 Jeremy E. Cohen , Valentin Leplat

The concentration inequality approach for normal approximation by Stein's method is generalized to the multivariate setting. We use this approach to prove a non-smooth function distance for multivariate normal approximation for standardized…

Probability · Mathematics 2015-05-19 Louis H. Y. Chen , Xiao Fang

Consider the standard nonparametric regression model and take as estimator the penalized least squares function. In this article, we study the trade-off between closeness to the true function and complexity penalization of the estimator,…

Statistics Theory · Mathematics 2016-10-20 Alan Muro , Sara van de Geer

In this paper, we prove an Azuma-Hoeffding-type inequality in several classical models of random configurations, including the Erd\H{o}s-R\'enyi random graph models $G(n,p)$ and $G(n,M)$, the random $d$-out(in)-regular directed graphs, and…

Combinatorics · Mathematics 2019-06-11 Linyuan Lu , Zhiyu Wang

We are concerned with an approximation problem for a symmetric positive semidefinite matrix due to motivation from a class of nonlinear machine learning methods. We discuss an approximation approach that we call {matrix ridge…

Machine Learning · Statistics 2013-12-18 Zhihua Zhang

This paper develops a general concentration inequality for the suprema of empirical processes with dependent data. The concentration inequality is obtained by combining generic chaining with a coupling-based strategy. Our framework…

Econometrics · Economics 2026-02-23 Chiara Amorino , Christian Brownlees , Ankita Ghosh

We characterize all real matrix semigroups satisfying a mild boundedness assumption, without assuming continuity. Besides the continuous solutions of the semigroup functional equation, we give a description of solutions arising from…

Rings and Algebras · Mathematics 2023-05-26 Benedict Bauer , Stefan Gerhold

We consider two methods to establish log-Sobolev inequalities for the invariant measure of a diffusion process when its density is not explicit and the curvature is not positive everywhere. In the first approach, based on the Holley-Stroock…

Probability · Mathematics 2025-03-25 Pierre Monmarché , Songbo Wang

An exact renormalization group equation is derived for the free energy of matrix models. The renormalization group equation turns out to be nonlinear for matrix models, as opposed to linear for vector models. An algorithm for determining…

High Energy Physics - Theory · Physics 2009-10-22 Saburo Higuchi , Chigak Itoi , Shinsuke Nishigaki , Norisuke Sakai

This paper studies inference in linear models with a high-dimensional parameter matrix that can be well-approximated by a ``spiked low-rank matrix.'' A spiked low-rank matrix has rank that grows slowly compared to its dimensions and nonzero…

Statistics Theory · Mathematics 2023-01-04 Victor Chernozhukov , Christian Hansen , Yuan Liao , Yinchu Zhu

We apply the density matrix renormalization group (DMRG) method to a non-equilibrium problem: the asymmetric exclusion process in one dimension. We study the stationary state of the process to calculate the particle density profile…

Statistical Mechanics · Physics 2009-10-30 Yasuhiro Hieida

This work shows how exponential concentration inequalities for additive functionals of stochastic processes over a finite time interval can be derived from concentration inequalities for martingales. The approach is entirely probabilistic…

Probability · Mathematics 2020-07-14 Bob Pepin

In this paper, a restricted memory quasi-Newton bundle method for minimizing a locally Lipschitz continuous function over a Riemannian manifold is proposed. The curvature information of the objective function is approximated by applying a…

Optimization and Control · Mathematics 2026-05-04 Chunming Tang , Shajie Xing , Wen Huang , Jinbao Jian

A generalization of the Bernstein matrix concentration inequality to random tensors of general order is proposed. This generalization is based on the use of Einstein products between tensors, from which a strong link can be established…

Statistics Theory · Mathematics 2021-05-31 Z. Luo , L. Qi , Ph. L. Toint

Based on earlier work by Carlen-Maas and the second- and third-named author, we introduce the notion of intertwining curvature lower bounds for graphs and quantum Markov semigroups. This curvature notion is stronger than both Bakry-\'Emery…

Functional Analysis · Mathematics 2024-01-11 Florentin Münch , Melchior Wirth , Haonan Zhang

We derive Concentration of Measure (CoM) inequalities for randomized Toeplitz matrices. These inequalities show that the norm of a high-dimensional signal mapped by a Toeplitz matrix to a low-dimensional space concentrates around its mean…

Information Theory · Computer Science 2016-11-17 Borhan M. Sanandaji , Tyrone L. Vincent , Michael B. Wakin

Let $M$ be a complete connected Riemannian manifold with boundary $\partial M$, and let $P_t$ be the Neumann semigroup generated by $\frac{ 1}{ 2} L$ where $L=\Delta+Z$ for a $C^1$-vector field $Z$ on $M$. We establish Bismut type formulae…

Probability · Mathematics 2022-10-19 Li-Juan Cheng , Anton Thalmaier , Feng-Yu Wang

This paper presents a synthesis approach aiming to guarantee a minimum upper-bound for the time taken to reach a target set of non-zero measure that encompasses the origin, while taking into account uncertainties and input and state…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Víctor Costa da Silva Campos , Mariella Maia Quadros , Luciano Frezzato , Leonardo Mozelli , Anh-Tu Nguyen

We consider a random variable $X$ that takes values in a (possibly infinite-dimensional) topological vector space $\mathcal{X}$. We show that, with respect to an appropriate "normal distance" on $\mathcal{X}$, concentration inequalities for…

Probability · Mathematics 2010-09-27 Timothy John Sullivan , Houman Owhadi

Matrix concentration inequalities, intimately connected to the Non-Commutative Khintchine inequality, have been an important tool in both applied and pure mathematics. We study tensor versions of these inequalities, and establish…

Probability · Mathematics 2024-11-19 Afonso S. Bandeira , Sivakanth Gopi , Haotian Jiang , Kevin Lucca , Thomas Rothvoss