English
Related papers

Related papers: Regularization of non-normal matrices by Gaussian …

200 papers

The quasinormal modes (QNM's) of gravitational systems modeled by the Klein-Gordon equation with effective potentials are studied in analogy to the QNM's of optical cavities. Conditions are given for the QNM's to form a complete set, i.e.,…

General Relativity and Quantum Cosmology · Physics 2016-08-31 E. S. C. Ching , P. T. Leung , W. M. Suen , K. Young

Injecting noise within gradient descent has several desirable features, such as smoothing and regularizing properties. In this paper, we investigate the effects of injecting noise before computing a gradient step. We demonstrate that small…

Machine Learning · Computer Science 2023-01-24 Antonio Orvieto , Anant Raj , Hans Kersting , Francis Bach

In this short note we address a gaussian property of normal vectors in random non-Hermitian matrices. The approach uses a simple geometric and comparison technique.

Probability · Mathematics 2016-04-19 Hoi H. Nguyen

We extend the theory of regularity structures [Hai14] to allow processes belonging to locally $m$-convex topological algebras. This extension includes processes in the locally $C^{*}$-algebras of [CHP25] used to localise singular stochastic…

Probability · Mathematics 2025-09-11 Ajay Chandra , Martin Hairer , Martin Peev

This paper considers the problems of solving monotone variational inequalities with H\"older continuous Jacobians. By employing the knowledge of H\"older parameter $\nu$, we propose the $\nu$-regularized extra-Newton method within at most…

Optimization and Control · Mathematics 2022-12-19 Chengchang Liu , Luo Luo

Let $T_N$ denote an $N\times N$ Toeplitz matrix with finite, $N$ independent symbol ${\bf a}$. For $E_N$ a noise matrix satisfying mild assumptions (ensuring, in particular, that $N^{-1/2}\|E_N\|_{{\rm HS}}\to_{N\to\infty} 0$ at a…

Probability · Mathematics 2019-11-14 Anirban Basak , Elliot Paquette , Ofer Zeitouni

In this paper, a methodology is investigated for signal recovery in the presence of non-Gaussian noise. In contrast with regularized minimization approaches often adopted in the literature, in our algorithm the regularization parameter is…

Optimization and Control · Mathematics 2017-01-23 Yosra Marnissi , Yuling Zheng , Emilie Chouzenoux , Jean-Christophe Pesquet

We consider the problem of approximating a $d \times d$ covariance matrix $M$ with a rank-$k$ matrix under $(\varepsilon,\delta)$-differential privacy. We present and analyze a complex variant of the Gaussian mechanism and obtain upper…

Data Structures and Algorithms · Computer Science 2025-02-12 Oren Mangoubi , Nisheeth K. Vishnoi

Newton's inequalities $c_n^2 \ge c_{n-1}c_{n+1}$ are shown to hold for the normalized coefficients $c_n$ of the characteristic polynomial of any $M$- or inverse $M$-matrix. They are derived by establishing first an auxiliary set of…

Rings and Algebras · Mathematics 2007-05-23 Olga Holtz

Let $X$ be an open subset of $\Bbb C^N$, and let $A$ be an $n\times n$ matrix of holomorphic functions on $X$. We call a point $\xi\in X$ $\mathbf{Jordan}$ $\mathbf{stable}$ for $A$ if $\xi$ is not a splitting point of the eigenvalues of…

Complex Variables · Mathematics 2017-03-29 Jürgen Leiterer

We consider a product of an arbitrary number of independent rectangular Gaussian random matrices. We derive the mean densities of its eigenvalues and singular values in the thermodynamic limit, eventually verified numerically. These…

Statistical Mechanics · Physics 2011-06-28 Z. Burda , A. Jarosz , G. Livan , M. A. Nowak , A. Swiech

Numerous empirical evidences have corroborated the importance of noise in nonconvex optimization problems. The theory behind such empirical observations, however, is still largely unknown. This paper studies this fundamental problem through…

Machine Learning · Computer Science 2021-02-25 Tianyi Liu , Yan Li , Song Wei , Enlu Zhou , Tuo Zhao

In overparametrized models, the noise in stochastic gradient descent (SGD) implicitly regularizes the optimization trajectory and determines which local minimum SGD converges to. Motivated by empirical studies that demonstrate that training…

Machine Learning · Computer Science 2021-12-07 Alex Damian , Tengyu Ma , Jason D. Lee

The training of over-parameterized neural networks has received much study in recent literature. An important consideration is the regularization of over-parameterized networks due to their highly nonconvex and nonlinear geometry. In this…

Machine Learning · Computer Science 2024-09-24 Hongyang R. Zhang , Dongyue Li , Haotian Ju

In the machine learning literature stochastic gradient descent has recently been widely discussed for its purported implicit regularization properties. Much of the theory, that attempts to clarify the role of noise in stochastic gradient…

Machine Learning · Computer Science 2022-10-21 Alberto Lanconelli , Christopher S. A. Lauria

The exceptional Jordan algebra is the algebra of $3\times 3$ Hermitian matrices with octonionic entries. It is the only one from Jordan's algebraic formulation of quantum mechanics which is not equivalent to the conventional formulation of…

General Physics · Physics 2023-04-05 Tejinder P. Singh

In this paper, we calculate the Jordan decomposition (or say, the Jordan canonical form) for a class of non-symmetric Ornstein-Uhlenbeck operators with the drift coefficient matrix being a Jordan block and the diffusion coefficient matrix…

Probability · Mathematics 2013-02-21 Yong Chen , Ying Li

In Einstein-Gauss-Bonnet gravity, we study the quasi-normal modes (QNMs) of the tensor perturbation for the so-called Maeda-Dadhich black hole which locally has a topology $\mathcal{M}^n \simeq M^4 \times \mathcal{K}^{n-4}$. Our discussion…

General Relativity and Quantum Cosmology · Physics 2026-02-27 Li-Ming Cao , Liang-Bi Wu , Yaqi Zhao , Yu-Sen Zhou

This work discusses the Improved Matrix Method and Weighted Residual Method for studying the quasinormal modes (QNMs) of black holes. In the first method, by utilizing Jordan decomposition, the improved matrix method avoids the calculation…

General Relativity and Quantum Cosmology · Physics 2025-07-09 Kai Lin

Let $M_n$ be the algebra of $n \times n$ complex matrices. We consider arbitrary subalgebras $\mathcal{A}$ of $M_n$ which contain the algebra of all upper-triangular matrices (i.e.\ block upper-triangular subalgebras), and their Jordan…

Rings and Algebras · Mathematics 2024-10-22 Ilja Gogić , Tatjana Petek , Mateo Tomašević