English
Related papers

Related papers: Finitary coding and Gaussian concentration for ran…

200 papers

We develop an operator-theoretic framework for stability and statistical concentration in nonlinear inverse problems with block-structured parameters. Under a unified set of assumptions combining blockwise Lipschitz geometry, local…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Joe-Mei Feng , Hsin-Hsiung Kao

This article studies the infinite-width limit of deep feedforward neural networks whose weights are dependent, and modelled via a mixture of Gaussian distributions. Each hidden node of the network is assigned a nonnegative random variable…

Machine Learning · Statistics 2025-02-06 Hoil Lee , Fadhel Ayed , Paul Jung , Juho Lee , Hongseok Yang , François Caron

Gaussian processes are used in many machine learning applications that rely on uncertainty quantification. Recently, computational tools for working with these models in geometric settings, such as when inputs lie on a Riemannian manifold,…

Machine Learning · Statistics 2023-10-31 Paul Rosa , Viacheslav Borovitskiy , Alexander Terenin , Judith Rousseau

We give Hoeffding and Bernstein-type concentration inequalities for the largest eigenvalue of sums of random matrices arising from a Markov chain. We consider time-dependent matrix-valued functions on a general state space, generalizing…

Probability · Mathematics 2025-07-01 Joe Neeman , Bobby Shi , Rachel Ward

In this paper, we consider the direct and inverse problems of the description of lattice positive random fields by various systems of finite-dimensional (as well as one-point) probability distributions parameterized by boundary conditions.…

Probability · Mathematics 2022-06-06 L. A. Khachatryan

We establish non-asymptotic bounds on the finite-sample behavior of generalized first-order iterative algorithms -- including gradient-based optimization methods and approximate message passing (AMP) -- with Gaussian data matrices and…

Machine Learning · Statistics 2025-08-15 Galen Reeves

We present a probabilistic model for natural images which is based on Gaussian scale mixtures and a simple multiscale representation. In contrast to the dominant approach to modeling whole images focusing on Markov random fields, we…

Machine Learning · Statistics 2012-09-17 Lucas Theis , Reshad Hosseini , Matthias Bethge

One of the outstanding problems in the numerical discretization of the Feynman-Kac formula calls for the design of arbitrary-order short-time approximations that are constructed in a stable way, yet only require knowledge of the potential…

Mathematical Physics · Physics 2007-05-23 Cristian Predescu

Gaussian mixture filters for nonlinear systems usually rely on severe approximations when calculating mixtures in the prediction and filtering step. Thus, offline approximations of noise densities by Gaussian mixture densities to reduce the…

Systems and Control · Electrical Eng. & Systems 2025-06-02 Ondŕej Straka , Uwe D. Hanebeck

We firstly extend the interpretation of feedback communication over stationary finite dimensional Gaussian channels as feedback control systems by showing that, the problem of finding stabilizing feedback controllers with maximal reliable…

Information Theory · Computer Science 2015-12-01 Chong Li , Nicola Elia

A numerical study is presented of the 3d Gaussian Random Field Ising Model at T=0 driven by an external field. Standard synchronous relaxation dynamics is employed to obtain the magnetization versus field hysteresis loops. The focus is on…

Disordered Systems and Neural Networks · Physics 2009-11-07 F. J. Perez-Reche , Eduard Vives

We study a translation invariant spin model in a three-dimensional regular lattice, called the cubic code model, in the presence of arbitrary extensive perturbations. Below a critical perturbation strength, we show that most states with…

Quantum Physics · Physics 2016-01-19 Isaac H. Kim , Jeongwan Haah

We continue the study of the maximum of the scale-inhomogeneous discrete Gaussian free field in dimension two. In this paper, we consider the regime of weak correlations and prove the convergence in law of the centred maximum to a randomly…

Probability · Mathematics 2020-10-05 Maximilian Fels , Lisa Hartung

This paper characterizes the second-order coding rates for lossy source coding with side information available at both the encoder and the decoder. We first provide non-asymptotic bounds for this problem and then specialize the…

Information Theory · Computer Science 2014-10-13 Sy-Quoc Le , Vincent Y. F. Tan , Mehul Motani

This paper studies the interpretability of neural network features from a Bayesian Gaussian view, where optimizing a cost is reaching a probabilistic bound; learning a model approximates a density that makes the bound tight and the cost…

Machine Learning · Computer Science 2025-11-18 Bo Hu , Jose C. Principe

The martingale method is used to establish concentration inequalities for a class of dependent random sequences on a countable state space, with the constants in the inequalities expressed in terms of certain mixing coefficients. Along the…

Probability · Mathematics 2009-01-22 Leonid , Kontorovich , Kavita Ramanan

We derive two lower bounds on entanglement of formation for arbitrary mixed Gaussian states by two distinct methods. To achieve the first one we use a local measurement procedure derived by Giedke et al [Quantum Inf. and Comp. vol.1, 79…

Quantum Physics · Physics 2016-09-08 G. Rigolin , C. O. Escobar

Sample path properties of random processes are an interesting and extensively studied topic, especially in the case of Gaussian processes. In this article, we study the continuity properties of hypercontractive fields, providing natural…

Probability · Mathematics 2023-11-02 Patrik Nummi , Lauri Viitasaari

Much recent rigorous study of the classical ferromagnetic Ising model has been powered by its graphical representations, such as the random current and loop O(1) model (high temperature expansion). In this paper, we prove uniqueness of…

Probability · Mathematics 2026-03-31 Ulrik Thinggaard Hansen , Frederik Ravn Klausen

We consider the problem of successive-refinement coding for lossy compression of individual sequences, namely, compression in two stages, where in the first stage, a coarse description at a relatively low rate is sent from the encoder to…

Information Theory · Computer Science 2025-02-25 Neri Merhav