English
Related papers

Related papers: Suppression of Overfitting in Extraction of Spectr…

200 papers

An overview is given of Bayesian inversion and regularization procedures. In particular, the conceptual basis of the maximum entropy method (MEM) is discussed, and extensions to positive/negative and complex data are highlighted. Other…

Astrophysics · Physics 2009-11-06 A. N. Lasenby , R. B. Barreiro , M. P. Hobson

Accurate segmentation of white matter hyperintensities (WMH) is crucial for clinical decision-making, particularly in the context of multiple sclerosis. However, domain shifts, such as variations in MRI machine types or acquisition…

Image and Video Processing · Electrical Eng. & Systems 2025-06-18 Franco Matzkin , Agostina Larrazabal , Diego H Milone , Jose Dolz , Enzo Ferrante

In this paper we propose a method of obtaining points of extreme overfitting - parameters of modern neural networks, at which they demonstrate close to 100 % training accuracy, simultaneously with almost zero accuracy on the test sample.…

Machine Learning · Computer Science 2020-04-03 Daniil Merkulov , Ivan Oseledets

In this article, we propose a sampling-based motion planning algorithm equipped with an information-theoretic convergence criterion for incremental informative motion planning. The proposed approach allows dense map representations and…

Robotics · Computer Science 2019-05-24 Maani Ghaffari Jadidi , Jaime Valls Miro , Gamini Dissanayake

We propose novel methods for max-cost Discrete Function Evaluation Problem (DFEP) under budget constraints. We are motivated by applications such as clinical diagnosis where a patient is subjected to a sequence of (possibly expensive) tests…

Machine Learning · Computer Science 2015-01-13 Feng Nan , Joseph Wang , Venkatesh Saligrama

A well-known result across information theory, machine learning, and statistical physics shows that the maximum entropy distribution under a mean constraint has an exponential form called the Gibbs-Boltzmann distribution. This is used for…

Machine Learning · Computer Science 2020-06-26 Amir R. Asadi , Emmanuel Abbe

We consider a differential method of maximum entropy that is based on the linearity of Fourier transform and involves reconstruction of images from the differences of the visibility function. The efficiency of the method is demonstrated…

Astrophysics · Physics 2015-06-24 Anisa T. Bajkova

Graph spectra have been successfully used to classify network types, compute the similarity between graphs, and determine the number of communities in a network. For large graphs, where an eigen-decomposition is infeasible, iterative moment…

Machine Learning · Statistics 2019-03-27 Diego Granziol , Binxin Ru , Stefan Zohren , Xiaowen Dong , Michael Osborne , Stephen Roberts

We provide a quantitative analysis of super-resolution imaging techniques which exploit temporal fluctuations of luminosity of the sources in order to beat the Rayleigh limit. We define an operationally justified resolution gain figure of…

Quantum Physics · Physics 2021-06-08 Stanislaw Kurdzialek , Rafal Demkowicz-Dobrzanski

First principle calculation of the QCD spectral functions (SPFs) based on the lattice QCD simulations is reviewed. Special emphasis is placed on the Bayesian inference theory and the Maximum Entropy Method (MEM), which is a useful tool to…

High Energy Physics - Lattice · Physics 2009-10-31 M. Asakawa , T. Hatsuda , Y. Nakahara

Quantum computers, using efficient Hamiltonian evolution routines, have the potential to simulate Green's functions of classically-intractable quantum systems. However, the decoherence errors of near-term quantum processors prohibit large…

Quantum Physics · Physics 2023-12-20 Diogo Cruz , Duarte Magano

In Monte Carlo simulation, lattice field theory with a $\theta$ term suffers from the sign problem. This problem can be circumvented by Fourier-transforming the topological charge distribution $P(Q)$. Although this strategy works well for…

High Energy Physics - Lattice · Physics 2016-09-01 M. Imachi , Y. Shinno , H. Yoneyama

Regularization is a popular technique to solve the overfitting problem of machine learning algorithms. Most regularization technique relies on parameter selection of the regularization coefficient. Plug-in method and cross-validation…

Machine Learning · Computer Science 2022-05-24 Hao Wang

Traditionally, the Method of (Shannon-Kullback's) Relative Entropy Maximization (REM) is considered with linear moment constraints. In this work, the method is studied under frequency moment constraints which are non-linear in…

Data Analysis, Statistics and Probability · Physics 2012-08-27 M. Grendar, , M. Grendar

Moment-closure methods are popular tools to simplify the mathematical analysis of stochastic models defined on networks, in which high dimensional joint distributions are approximated (often by some heuristic argument) as functions of lower…

Data Analysis, Statistics and Probability · Physics 2011-05-25 Tim Rogers

Labeling a classification dataset implies to define classes and associated coarse labels, that may approximate a smoother and more complicated ground truth. For example, natural images may contain multiple objects, only one of which is…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Raphael Baena , Lucas Drumetz , Vincent Gripon

Mixup is an effective data augmentation method that generates new augmented samples by aggregating linear combinations of different original samples. However, if there are noises or aberrant features in the original samples, Mixup may…

Machine Learning · Computer Science 2024-05-09 Leixin Yang , Yu Xiang

Implicit Neural Representation (INR) has emerged as an effective method for unsupervised image denoising. However, INR models are typically overparameterized; consequently, these models are prone to overfitting during learning, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Zipei Yan , Zhengji Liu , Jizhou Li

We present a Maximum Entropy method (MEM) for obtaining dynamical spectra from Quantum Monte Carlo data which have a sign problem. By relating the sign fluctuations to the norm of the spectra, our method properly treats the correlations…

Statistical Mechanics · Physics 2007-05-23 A. Macridin , S. P. Doluweera , M. Jarrell , Th. Maier

Spectral methods provide an elegant and efficient way of numerically solving differential equations of all kinds. For smooth problems, truncation error for spectral methods vanishes exponentially in the infinity norm and $L_2$-norm.…

Numerical Analysis · Computer Science 2019-10-09 Joanna Piotrowska , Jonah M. Miller , Erik Schnetter