English
Related papers

Related papers: Typical reconstruction limit and phase transition …

200 papers

Due to the interconnectedness of financial entities, estimating certain key properties of a complex financial system (e.g. the implied level of systemic risk) requires detailed information about the structure of the underlying network.…

Physics and Society · Physics 2020-09-08 Federica Parisi , Tiziano Squartini , Diego Garlaschelli

Multi-instance data, in which each object (bag) contains a collection of instances, are widespread in machine learning, computer vision, bioinformatics, signal processing, and social sciences. We present a maximum entropy (ME) framework for…

Machine Learning · Computer Science 2016-03-15 Behrouz Behmardi , Forrest Briggs , Xiaoli Z. Fern , Raviv Raich

In x-ray computed tomography (CT) it is generally acknowledged that reconstruction methods exploiting image sparsity allow reconstruction from a significantly reduced number of projections. The use of such reconstruction methods is…

Numerical Analysis · Mathematics 2014-08-05 Jakob S. Jørgensen , Emil Y. Sidky , Per Christian Hansen , Xiaochuan Pan

Maximum entropy (MAXENT) method has a large number of applications in theoretical and applied machine learning, since it provides a convenient non-parametric tool for estimating unknown probabilities. The method is a major contribution of…

Data Analysis, Statistics and Probability · Physics 2020-12-18 A. E. Allahverdyan , N. H. Martirosyan

Reconstructing 4D or 6D phase space distributions from 1D or 2D measurements is a challenging inverse problem encountered in particle accelerators. Entropy maximization is an established method to incorporate prior information in the…

Accelerator Physics · Physics 2025-08-18 Austin Hoover

We study the multi-reference alignment (MRA) problem of recovering a signal from noisy observations acted on by unknown random circular shifts. While the information-theoretic limits of MRA are well characterized in many settings, the…

Signal Processing · Electrical Eng. & Systems 2026-02-12 Amnon Balanov , Wasim Huleihel , Tamir Bendory

A method for correcting for detector smearing effects using machine learning techniques is presented. Compared to the standard approaches the method can use more than one reconstructed variable to infere the value of the unsmeared quantity…

Data Analysis, Statistics and Probability · Physics 2017-12-06 Alexander Glazov

Electrical impedance tomography is an imaging modality for extracting information on the conductivity distribution inside a physical body from boundary measurements of current and voltage. In many practical applications, it is a priori…

Numerical Analysis · Mathematics 2014-06-06 Lauri Harhanen , Nuutti Hyvönen , Helle Majander , Stratos Staboulis

This paper is a review of a particular approach to the method of maximum entropy as a general framework for inference. The discussion emphasizes the pragmatic elements in the derivation. An epistemic notion of information is defined in…

Data Analysis, Statistics and Probability · Physics 2021-08-04 Ariel Caticha

The Expectation Maximization (EM) algorithm is a versatile tool for model parameter estimation in latent data models. When processing large data sets or data stream however, EM becomes intractable since it requires the whole data set to be…

Statistics Theory · Mathematics 2012-10-18 Sylvain Le Corff , Gersende Fort

Complex biological processes are usually experimented along time among a collection of individuals. Longitudinal data are then available and the statistical challenge is to better understand the underlying biological mechanisms. The…

Statistics Theory · Mathematics 2015-06-11 Pierre Barbillon , Célia Barthélémy , Adeline Samson

A number of recent contributions have put forward the topological structure of production networks as a key determinant of macro-economic dynamics. However, firm-to-firm production networks data is generally not available. Against this…

Physics and Society · Physics 2026-03-24 Mitja Devetak , Antoine Mandel

We study the maximum entropy (MaxEnt) approach for analytical continuation of spectral data from imaginary times to real frequencies. The total error is divided in a statistical error, due to the noise in the input data, and a systematic…

Data Analysis, Statistics and Probability · Physics 2010-11-16 O. Gunnarsson , M. W. Haverkort , G. Sangiovanni

Expectation Maximization (EM) is among the most popular algorithms for estimating parameters of statistical models. However, EM, which is an iterative algorithm based on the maximum likelihood principle, is generally only guaranteed to find…

Statistics Theory · Mathematics 2016-08-30 Ji Xu , Daniel Hsu , Arian Maleki

We introduce the entropic measure transform (EMT) problem for a general process and prove the existence of a unique optimal measure characterizing the solution. The density process of the optimal measure is characterized using a…

Mathematical Finance · Quantitative Finance 2019-02-22 Renjie Wang , Cody Hyndman , Anastasis Kratsios

The EM algorithm is a generic tool that offers maximum likelihood solutions when datasets are incomplete with data values missing at random or completely at random. At least for its simplest form, the algorithm can be rewritten in terms of…

Methodology · Statistics 2025-09-25 Daniel A. Griffith

We consider the random design regression model with square loss. We propose a method that aggregates empirical minimizers (ERM) over appropriately chosen random subsets and reduces to ERM in the extreme case, and we establish sharp oracle…

Statistics Theory · Mathematics 2017-07-04 Alexander Rakhlin , Karthik Sridharan , Alexandre B. Tsybakov

Radio polarisation images of the jets of Active Galactic Nuclei (AGN) can provide a deep insight into the launching and collimation mechanisms of relativistic jets. However, even at VLBI scales, resolution is often a limiting factor in the…

Astrophysics of Galaxies · Physics 2016-09-07 Colm P. Coughlan , Denise C. Gabuzda

In the context of state estimation under communication constraints, several notions of dynamical entropy play a fundamental role, among them: topological entropy and restoration entropy. In this paper, we present a theorem which…

Optimization and Control · Mathematics 2019-01-30 Christoph Kawan

Purpose: To achieve automatic hyperparameter estimation for the joint recovery of quantitative MR images, we propose a Bayesian formulation of the reconstruction problem that incorporates the signal model. Additionally, we investigate the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-12 Shuai Huang , James J. Lah , Jason W. Allen , Deqiang Qiu