English
Related papers

Related papers: Matrix liberation process I: Large deviation upper…

200 papers

A determinantal point process is a stochastic point process that is commonly used to capture negative correlations. It has become increasingly popular in machine learning in recent years. Sampling a determinantal point process however…

Numerical Analysis · Mathematics 2020-09-02 Lexing Ying

The notion of upper variance under multiple probabilities is defined by a corresponding minimax optimization problem. This paper proposes a simple algorithm to solve the related minimax optimization problem exactly. As an application, we…

Probability · Mathematics 2023-11-22 Xinpeng Li , Miao Yu , Shiyi Zheng

Iterative hard thresholding (IHT) has gained in popularity over the past decades in large-scale optimization. However, convergence properties of this method have only been explored recently in non-convex settings. In matrix completion,…

Optimization and Control · Mathematics 2023-01-11 Trung Vu , Evgenia Chunikhina , Raviv Raich

In this paper, we introduce a method for approximating the solution to inference and optimization tasks in uncertain and deterministic reasoning. Such tasks are in general intractable for exact algorithms because of the large number of…

Artificial Intelligence · Computer Science 2012-12-12 David Ephraim Larkin

We prove pathwise large deviation principles of slow variables in slow-fast systems in the limit of time-scale separation tending to infinity. In the limit regime we consider, the convergence of the slow variable to its deterministic limit…

Probability · Mathematics 2020-11-25 Richard C. Kraaij , Mikola C. Schlottke

The singular values of a product of $M$ independent Ginibre matrices of size $N\times N$ form a determinantal point process. Near the soft edge, as both $M$ and $N$ go to infinity in such a way that $M/N\to \alpha$, $\alpha>0$, a scaling…

Probability · Mathematics 2021-12-21 Sergey Berezin , Eugene Strahov

We obtain an optimal bound for a Gaussian approximation of a large class of vector-valued random processes. Our results provide a substantial generalization of earlier results that assume independence and/or stationarity. Based on the decay…

Statistics Theory · Mathematics 2020-01-29 Sayar Karmakar , Wei Biao Wu

Dramatic increases in the size and dimensionality of many recent data sets make crucial the need for sophisticated methods that can exploit inherent structure and handle missing values. In this article we derive an expectation-maximization…

Methodology · Statistics 2013-09-26 Hunter Glanz , Luis Carvalho

We consider the precise upper large deviations estimates for the maximal displacement of a branching random walk. In addition, we obtain a description of the extremal process of the branching random walk conditioned on this large deviations…

Probability · Mathematics 2025-02-04 Lianghui Luo

Random matrix theory has played a major role in several areas of pure and applied mathematics, as well as statistics, physics, and computer science. This lecture aims to describe the intrinsic freeness phenomenon and how it provides new…

Probability · Mathematics 2025-10-02 Afonso S. Bandeira

The task of estimating a matrix given a sample of observed entries is known as the \emph{matrix completion problem}. Most works on matrix completion have focused on recovering an unknown real-valued low-rank matrix from a random sample of…

Statistics Theory · Mathematics 2014-08-27 Olga Klopp , Jean Lafond , Eric Moulines , Joseph Salmon

The problem of approximating a matrix by a low-rank one has been extensively studied. This problem assumes, however, that the whole matrix has a low-rank structure. This assumption is often false for real-world matrices. We consider the…

Data Structures and Algorithms · Computer Science 2025-11-05 Martino Ciaperoni , Aristides Gionis , Heikki Mannila

Many real-world problems rely on finding eigenvalues and eigenvectors of a matrix. The power iteration algorithm is a simple method for determining the largest eigenvalue and associated eigenvector of a general matrix. This algorithm relies…

Numerical Analysis · Mathematics 2021-09-23 Congzhou M Sha , Nikolay V Dokholyan

We present a large deviation property for the pattern statistics representing the number of occurrences of a symbol in words of given length generated at random according to a rational stochastic model. The result is obtained assuming that…

Probability · Mathematics 2023-06-14 Massimiliano Goldwurm , Marco Vignati

Recently, diffusion probabilistic models (DPMs) have achieved promising results in diverse generative tasks. A typical DPM framework includes a forward process that gradually diffuses the data distribution and a reverse process that…

Machine Learning · Computer Science 2023-10-31 Tianyu Pang , Cheng Lu , Chao Du , Min Lin , Shuicheng Yan , Zhijie Deng

We study the high-dimensional limit of the free energy associated with the inference problem of a rank-one nonsymmetric matrix. The matrix is expressed as the outer product of two vectors, not necessarily independent. The distributions of…

Probability · Mathematics 2020-06-18 Hong-Bin Chen

In this paper we provide an upper bound for the conjunction probability of independent Gaussian smooth processes and then we prove that this bound is a good approximation with exponentially smaller error. Our result confirms the heuristic…

Probability · Mathematics 2019-09-17 Viet-Hung Pham

Consider the collection of all binary matrices having a specific sequence of row and column sums and consider sampling binary matrices uniformly from this collection. Practical algorithms for exact uniform sampling are not known, but there…

Computation · Statistics 2013-01-28 Matthew T. Harrison

We introduce a method for proving almost sure termination in the context of lambda calculus with continuous random sampling and explicit recursion, based on ranking supermartingales. This result is extended in three ways. Antitone ranking…

Programming Languages · Computer Science 2021-05-04 Andrew Kenyon-Roberts , Luke Ong

We provide a perturbative expansion for the empirical spectral distribution of a Hermitian matrix with large size perturbed by a random matrix with small operator norm whose entries in the eigenvector basis of the first one are independent…

Probability · Mathematics 2017-10-03 Florent Benaych-Georges , Nathanaël Enriquez , Alkéos Michaïl