English
Related papers

Related papers: Maximum-Entropy Revisited

200 papers

MEMS gyroscopes play a critical role in inertial navigation and motion control applications but typically suffer from a fundamental trade-off between measurement range and noise performance. Existing hardware-based solutions aimed at…

Signal Processing · Electrical Eng. & Systems 2025-11-13 Feiyang Pan , Shenghe Zheng , Chunyan Yin , Guangbin Dou

Denoising by frame thresholding is one of the most basic and efficient methods for recovering a discrete signal or image from data that are corrupted by additive Gaussian white noise. The basic idea is to select a frame of analyzing…

Numerical Analysis · Mathematics 2015-01-21 Markus Haltmeier , Axel Munk

We consider recovery of low-rank matrices from noisy data by shrinkage of singular values, in which a single, univariate nonlinearity is applied to each of the empirical singular values. We adopt an asymptotic framework, in which the matrix…

Statistics Theory · Mathematics 2016-05-17 Matan Gavish , David L. Donoho

Feature detection is an important procedure for image matching, where unsupervised feature detection methods are the detection approaches that have been mostly studied recently, including the ones that are based on repeatability requirement…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Chao Li , Yanan You , Wenli Zhou

Purpose: To develop a deep learning-based Bayesian inference for MRI reconstruction. Methods: We modeled the MRI reconstruction problem with Bayes's theorem, following the recently proposed PixelCNN++ method. The image reconstruction from…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 GuanXiong Luo , Na Zhao , Wenhao Jiang , Edward S. Hui , Peng Cao

We show that a simple geometric result suffices to derive the form of the optimal solution in a large class of finite and infinite-dimensional maximum entropy problems concerning probability distributions, spectral densities and covariance…

Optimization and Control · Mathematics 2012-12-24 Michele Pavon , Augusto Ferrante

We consider the approximate recovery of multivariate periodic functions from a discrete set of function values taken on a rank-$s$ integration lattice. The main result is the fact that any (non-)linear reconstruction algorithm taking…

Numerical Analysis · Mathematics 2016-08-02 Glenn Byrenheid , Lutz Kämmerer , Tino Ullrich , Toni Volkmer

The wavelet Maximum Entropy on the Mean (wMEM) approach to the MEG inverse problem is revisited and extended to infer brain activity from full space-time data. The resulting dimensionality increase is tackled using a collection of…

Machine Learning · Statistics 2018-07-25 Marie-Christine Roubaud , Jean-Marc Lina , Julie Carrier , B Torrésani

Single-particle imaging with X-ray free-electron lasers depends crucially on algorithms that merge large numbers of weak diffraction patterns despite missing measurements of parameters such as particle orientations. The…

Computational Physics · Physics 2021-08-24 B. R. Mobley , K. E. Schmidt , J. P. Chen , R. A. Kirian

Free-form strong-lensing (SL) mass reconstructions typically suffer from overfitting, which manifest itself as false-positive small-scale fluctuations. We present a new free-form MAximum-entropy ReconStruction (${\tt MARS}$) method without…

Cosmology and Nongalactic Astrophysics · Physics 2022-06-08 Sangjun Cha , M. James Jee

This dissertation shows that careful injection of noise into sample data can substantially speed up Expectation-Maximization algorithms. Expectation-Maximization algorithms are a class of iterative algorithms for extracting maximum…

Machine Learning · Statistics 2014-11-26 Osonde Adekorede Osoba

Robust compressive sensing(CS) reconstruction has become an attractive research topic in recent years. Robust CS aims to reconstruct the sparse signals under non-Gaussian(i.e. heavy tailed) noises where traditional CS reconstruction…

Information Theory · Computer Science 2017-06-13 Yicong He , Fei Wang , Shiyuan Wang , Jiuwen Cao , Badong Chen

We investigate the theoretical foundations of a recently introduced entropy-based formulation of weighted least squares for the approximation of overdetermined linear systems, motivated by robust data fitting in the presence of sparse gross…

Numerical Analysis · Mathematics 2026-03-17 Felice Iavernaro , Monica Lazzo , Lorenzo Pisani

Efficient approximation lies at the heart of large-scale machine learning problems. In this paper, we propose a novel, robust maximum entropy algorithm, which is capable of dealing with hundreds of moments and allows for computationally…

Machine Learning · Statistics 2019-06-05 Diego Granziol , Binxin Ru , Stefan Zohren , Xiaowen Doing , Michael Osborne , Stephen Roberts

EGRET data are usually analysed on the basis of the Maximum-Likelihood method \cite{ma96} in a search for point sources in excess to a model for the background radiation (e.g. \cite{hu97}). This method depends strongly on the quality of the…

Astrophysics · Physics 2009-10-30 Martin Pohl

A new multi-frequency synthesis algorithm for reconstructing images from multi-frequency VLBI data is proposed. The algorithm is based on a generalized maximum-entropy method, and makes it possible to derive an effective spectral correction…

Astrophysics · Physics 2011-08-31 Anisa T. Bajkova

This paper studies two structured approximation problems: (1) Recovering a corrupted low-rank Toeplitz matrix and (2) recovering the range of a Fourier matrix from a single observation. Both problems are computationally challenging because…

Information Theory · Computer Science 2025-11-24 Albert Fannjiang , Weilin Li

The maximum-entropy principle (Max-Ent) is a valuable and extensively used tool in statistical mechanics and quantum information theory. It provides a method for inferring the state of a system by utilizing a reduced set of parameters…

Quantum Physics · Physics 2024-03-01 F. T. B. Pérez , J. M. Matera

Sparse representation learning has recently gained a great success in signal and image processing, thanks to recent advances in dictionary learning. To this end, the $\ell_0$-norm is often used to control the sparsity level. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Yuan Liu , Stéphane Canu , Paul Honeine , Su Ruan

We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of quantum Monte Carlo data. With the sampled spectrum parametrized with delta-functions in continuous frequency space, a calculation of…

Strongly Correlated Electrons · Physics 2023-01-11 Hui Shao , Anders W. Sandvik