English
Related papers

Related papers: Recent Advances in Maximum-Entropy Sampling

200 papers

The goal of this paper is to review the advances that were made during the last few decades in the study of the entropy, and in particular the entropy method, for Kac's many particle system.

Analysis of PDEs · Mathematics 2023-06-21 Amit Einav

The Experience Sampling Method (ESM) introduces in-situ sampling of human behaviour, and provides researchers and behavioural therapists with ecologically valid and timely assessments of a person's psychological state. This, in turn, opens…

Human-Computer Interaction · Computer Science 2015-08-18 Veljko Pejovic , Neal Lathia , Cecilia Mascolo , Mirco Musolesi

The maximum-entropy remote sampling problem (MERSP) is to select a subset of s random variables from a set of n random variables, so as to maximize the information concerning a set of target random variables that are not directly…

Optimization and Control · Mathematics 2026-02-03 Gabriel Ponte , Marcia Fampa , Jon Lee

Entropy Estimation is an important problem with many applications in cryptography, statistic,machine learning. Although the estimators optimal with respect to the sample complexity have beenrecently developed, there are still some…

Data Structures and Algorithms · Computer Science 2020-02-24 Maciej Skorski

The recent years have seen remarkable success in the use of deep neural networks on text summarization. However, there is no clear understanding of \textit{why} they perform so well, or \textit{how} they might be improved. In this paper, we…

Computation and Language · Computer Science 2019-07-09 Ming Zhong , Pengfei Liu , Danqing Wang , Xipeng Qiu , Xuanjing Huang

Within a framework of utmost generality, we show that the entropy maximization procedure with linear constraints uniquely leads to the Shannon-Boltzmann-Gibbs entropy. Therefore, the use of this procedure with linear constraints should not…

Statistical Mechanics · Physics 2018-05-01 Thomas Oikonomou , G. Baris Bagci

We develop a new sampling method to estimate eigenvector centrality on incomplete networks. Our goal is to estimate this global centrality measure having at disposal a limited amount of data. This is the case in many real-world scenarios…

Social and Information Networks · Computer Science 2020-10-29 Nicolò Ruggeri , Caterina De Bacco

In this paper, we develop a general theory for the estimation of the transition probabilities of reversible Markov chains using the maximum entropy principle. A broad range of physical models can be studied within this approach. We use…

Statistical Mechanics · Physics 2015-05-14 Erik Van der Straeten

We identify recurrent ingredients in the antithetic sampling literature leading to a unified sampling framework. We introduce a new class of antithetic schemes that includes the most used antithetic proposals. This perspective enables the…

Methodology · Statistics 2021-12-07 Roberto Casarin , Radu V. Craiu , Lorenzo Frattarolo , Christian P. Robert

We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of quantum Monte Carlo data. With the sampled spectrum parametrized with delta-functions in continuous frequency space, a calculation of…

Strongly Correlated Electrons · Physics 2023-01-11 Hui Shao , Anders W. Sandvik

We study maximum-entropy inference for finite-dimensional quantum states under linear moment constraints. Given expectation values of finitely many observables, the feasible set of states is convex but typically non-unique. The…

Quantum Physics · Physics 2025-10-27 James Tian

We obtain the maximum entropy distribution for an asset from call and digital option prices. A rigorous mathematical proof of its existence and exponential form is given, which can also be applied to legitimise a formal derivation by Buchen…

Pricing of Securities · Quantitative Finance 2011-02-03 C. Neri , L. Schneider

During the MaxEnt 2002 workshop in Moscow, Idaho, Tony Vignaux asked again a few simple questions about using Maximum Entropy or Bayesian approaches for the famous Dice problems which have been analyzed many times through this workshop and…

Data Analysis, Statistics and Probability · Physics 2009-11-07 Ali Mohammad-Djafari

In this short paper, we describe an efficient numerical solver for the optimal sampling problem considered in "Designing Sampling Schemes for Multi-Dimensional Data". An implementation may be found on…

Signal Processing · Electrical Eng. & Systems 2021-11-11 Filip Elvander , Johan Swärd , Andreas Jakobsson

Given a large real symmetric, positive semidefinite m-by-m matrix, the goal of this paper is to show how a numerical approximation of the entropy, given by the sum of the entropies of the individual eigenvalues, can be computed in an…

Numerical Analysis · Mathematics 2014-06-13 Thomas P. Wihler , Bänz Bessire , André Stefanov

Molecular dynamics (MD) enables the study of physical systems with excellent spatiotemporal resolution but suffers from severe time-scale limitations. To address this, enhanced sampling methods have been developed to improve exploration of…

Statistical Mechanics · Physics 2023-06-19 Shams Mehdi , Zachary Smith , Lukas Herron , Ziyue Zou , Pratyush Tiwary

Scientific writing builds upon already published papers. Manual identification of publications to read, cite or consider as related papers relies on a researcher's ability to identify fitting keywords or initial papers from which a…

Digital Libraries · Computer Science 2022-09-08 Christin Katharina Kreutz , Ralf Schenkel

The Expectation-Maximization (EM) algorithm is an iterative method to maximize the log-likelihood function for parameter estimation. Previous works on the convergence analysis of the EM algorithm have established results on the asymptotic…

Statistics Theory · Mathematics 2017-05-31 Chong Wu , Can Yang , Hongyu Zhao , Ji Zhu

The Expectation Maximization (EM) algorithm is widely used as an iterative modification to maximum likelihood estimation when the data is incomplete. We focus on a semi-supervised case to learn the model from labeled and unlabeled samples.…

Machine Learning · Computer Science 2023-01-26 Erixhen Sula , Lizhong Zheng

This paper provides a thorough examination of recent developments in the field of multi-choice Machine Reading Comprehension (MRC). Focused on benchmark datasets, methodologies, challenges, and future trajectories, our goal is to offer…

Computation and Language · Computer Science 2024-08-06 Shima Foolad , Kourosh Kiani , Razieh Rastgoo