English
Related papers

Related papers: Factorizations of relative entropy using stochasti…

200 papers

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

Optimization and Control · Mathematics 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

We present a review of some recent results on estimation of location parameter for several models of observations with cusp-type singularity at the change point. We suppose that the cusp-type models fit better to the real phenomena…

Statistics Theory · Mathematics 2017-11-13 S. Dachian , N. Kordzakhia , Yu. A. Kutoyants , A. Novikov

Stein's method for concentration inequalities was introduced to prove concentration of measure in problems involving complex dependencies such as random permutations and Gibbs measures. In this paper, we provide some extensions of the…

Probability · Mathematics 2010-11-11 Sourav Chatterjee , Partha S. Dey

In this paper non-asymptotic exact rearrangement invariant norm estimates are derived for the maximum distribution of the family elements of some rearrangement invariant (r.i.) space over unbounded measure in the entropy terms and in the…

Functional Analysis · Mathematics 2008-08-26 E. Ostrovsky , E. Rogover

Flexible Bayesian models are typically constructed using limits of large parametric models with a multitude of parameters that are often uninterpretable. In this article, we offer a novel alternative by constructing an exponentially tilted…

Methodology · Statistics 2023-03-20 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

We investigate and contrast, via the Wang-Landau (WL) algorithm, the effects of quenched bond randomness on the self-averaging properties of two Ising spin models in 2d. The random bond version of the superantiferromagnetic (SAF) square…

Statistical Mechanics · Physics 2008-10-31 N G Fytas , A Malakis

The dynamics of the spins in the Ising model are analyzed using a virtual walk scenario. The system is quenched from a very high temperature to a lower one using the Glauber scheme in one and two dimensions. A walk is associated with each…

Statistical Mechanics · Physics 2026-03-11 Amit Pradhan , Parongama Sen , Sagnik Seth

We consider the minimization over probability measures of the expected value of a random variable, regularized by relative entropy with respect to a given probability distribution. In the general setting we provide a complete…

Probability · Mathematics 2020-09-29 Joris Bierkens , Hilbert J. Kappen

In this work, we propose low-complexity adaptive biased estimation algorithms, called group-based shrinkage estimators (GSEs), for parameter estimation and interference suppression scenarios with mechanisms to automatically adjust the…

Information Theory · Computer Science 2016-11-17 Sheng Li , Rodrigo C. de Lamare , Martin Haardt

We study the estimation of Tsallis entropy of a finite number of independent populations, each following an exponential distribution with the same scale parameter and distinct location parameters for $q>0$. We derive a Stein-type improved…

Statistics Theory · Mathematics 2024-01-18 Naveen Kumar , Ambesh Dixit , Vivek Vijay

Motivated by applications of statistical mechanics in which the system of interest is spatially unconfined, we present an exact solution to the maximum entropy problem for assigning a stationary probability distribution on the phase space…

Statistical Mechanics · Physics 2021-12-17 Bruno Arderucio Costa , Pedro Pessoa

Given a set of discrete probability distributions, the minimum entropy coupling is the minimum entropy joint distribution that has the input distributions as its marginals. This has immediate relevance to tasks such as entropic causal…

Information Theory · Computer Science 2023-02-24 Spencer Compton , Dmitriy Katz , Benjamin Qi , Kristjan Greenewald , Murat Kocaoglu

We promote use of the geometric entropy formula derived by Holzhey et. al. from conformal field theory, $S_\ell\sim ({c}/{3}) \log(\sin{\pi\ell}/{N})$, to identify critical regions in zero temperature 1D quantum systems. The method is…

Statistical Mechanics · Physics 2009-11-11 S. O. Skrøvseth , K. Olaussen

A well-known result across information theory, machine learning, and statistical physics shows that the maximum entropy distribution under a mean constraint has an exponential form called the Gibbs-Boltzmann distribution. This is used for…

Machine Learning · Computer Science 2020-06-26 Amir R. Asadi , Emmanuel Abbe

Quantum systems that violate the eigenstate thermalisation hypothesis thereby falling outside the paradigm of conventional statistical mechanics are of both intellectual and practical interest. We show that such a breaking of ergodicity may…

Disordered Systems and Neural Networks · Physics 2020-05-20 Sthitadhi Roy , Achilleas Lazarides

In optimal prediction methods one estimates the future behavior of underresolved systems by solving reduced systems of equations for expectations conditioned by partial data; renormalization group methods reduce the number of variables in…

Mathematical Physics · Physics 2007-05-23 Alexandre J. Chorin

The foundations of the Boltzmann-Gibbs (BG) distributions for describing equilibrium statistical mechanics of systems are examined. Broadly, they fall into: (i) probabilistic paaroaches based on the principle of equal a priori probability…

Statistical Mechanics · Physics 2009-11-10 A. K. Rajagopal , Sumiyoshi Abe

The standard nonperturbative approaches of renormalization group for tensor models are generally focused on a purely local potential approximation (i.e. involving only generalized traces and product of them) and are showed to strongly…

High Energy Physics - Theory · Physics 2022-02-21 Vincent Lahoche , Dine Ousmane Samary

We discuss on general grounds some local indicators of entanglement, that have been proposed recently for the study and classification of quantum phase transitions. In particular, we focus on the capability of entanglement in detecting…

Quantum Physics · Physics 2007-05-23 L. Campos Venuti , C. Degli Esposti Boschi , G. Morandi , M. Roncaglia , A. Scaramucci

To construct asymptotically-Euclidean Einstein's initial data sets, we introduce the localized seed-to-solution method, which projects from approximate to exact solutions of the Einstein constraints. The method enables us to glue together…

General Relativity and Quantum Cosmology · Physics 2024-06-07 Bruno Le Floch , Philippe G. LeFloch