English
Related papers

Related papers: Eigenvector method for umbrella sampling enables e…

200 papers

Boltzmann sampling based on Metropolis algorithm has been extensively used for simulating a canonical ensemble. An estimate of a mechanical property, like energy, of an equilibrium system, can be made by averaging over a large number…

Statistical Mechanics · Physics 2017-10-04 K P N Murthy

We endeavour to estimate numerous multi-dimensional means of various probability distributions on a common space based on independent samples. Our approach involves forming estimators through convex combinations of empirical means derived…

Machine Learning · Statistics 2025-03-11 Gilles Blanchard , Jean-Baptiste Fermanian , Hannah Marienwald

A central task of artificial intelligence is the design of artificial agents that act towards specified goals in partially observed environments. Since such environments frequently include interaction over time with other agents with their…

Computer Science and Game Theory · Computer Science 2012-05-14 Miroslav Dudik , Geoffrey Gordon

Inspired by the key principle behind the EM algorithm, we propose a general methodology for conducting wavelet estimation with irregularly-spaced data by viewing the data as the observed portion of an augmented regularly-spaced data set. We…

Statistics Theory · Mathematics 2007-06-13 Thomas C. M. Lee , Xiao-Li Meng

Ensemble weather forecasts enable a measure of uncertainty to be attached to each forecast, by computing the ensemble's spread. However, generating an ensemble with a good spread-error relationship is far from trivial, and a wide range of…

Atmospheric and Oceanic Physics · Physics 2021-01-05 Sebastian Scher , Gabriele Messori

We present a method for calibrating the Ensemble of Exemplar SVMs model. Unlike the standard approach, which calibrates each SVM independently, our method optimizes their joint performance as an ensemble. We formulate joint calibration as a…

Computer Vision and Pattern Recognition · Computer Science 2015-04-27 Davide Modolo , Alexander Vezhnevets , Olga Russakovsky , Vittorio Ferrari

We provide an efficient unified plug-in approach for estimating symmetric properties of distributions given $n$ independent samples. Our estimator is based on profile-maximum-likelihood (PML) and is sample optimal for estimating various…

Machine Learning · Statistics 2022-10-14 Moses Charikar , Zhihao Jiang , Kirankumar Shiragur , Aaron Sidford

Model averaging has gained significant attention in recent years due to its ability of fusing information from different models. The critical challenge in frequentist model averaging is the choice of weight vector. The bootstrap method,…

Methodology · Statistics 2024-12-10 Minghui Song , Guohua Zou , Alan T. K. Wan

Despite empirical risk minimization (ERM) is widely applied in the machine learning community, its performance is limited on data with spurious correlation or subpopulation that is introduced by hidden attributes. Existing literature…

Machine Learning · Computer Science 2024-12-18 Hongyu Shen , Zhizhen Zhao

This paper investigates adaptive importance sampling algorithms for which the policy, the sequence of distributions used to generate the particles, is a mixture distribution between a flexible kernel density estimate (based on the previous…

Statistics Theory · Mathematics 2020-03-23 Bernard Delyon , François Portier

Envelope methodology is succinctly pitched as a class of procedures for increasing efficiency in multivariate analyses without altering traditional objectives \citep[first sentence of page 1]{cook2018introduction}. This description is true…

Methodology · Statistics 2020-02-05 Daniel J. Eck

Since Rendle and Krichene argued that commonly used sampling-based evaluation metrics are "inconsistent" with respect to the global metrics (even in expectation), there have been a few studies on the sampling-based recommender system…

Information Retrieval · Computer Science 2023-10-12 Dong Li , Ruoming Jin , Zhenming Liu , Bin Ren , Jing Gao , Zhi Liu

For many tasks of data analysis, we may only have the information of the explanatory variable and the evaluation of the response values are quite expensive. While it is impractical or too costly to obtain the responses of all units, a…

Computation · Statistics 2023-04-07 Wei Zheng , Ting Tian , Xueqin Wang

We consider two classical ensembles of the random matrix theory: the Wigner matrices and sample covariance matrices, and prove Central Limit Theorem for linear eigenvalue statistics under rather weak (comparing with results known before)…

Mathematical Physics · Physics 2011-01-18 Mariya Shcherbina

For systems that self assemble into finite-sized objects, it is sometimes convenient to compute the thermodynamics for a small system where a single assembly can form. However, we show that in the canonical ensemble the use of small systems…

Soft Condensed Matter · Physics 2010-02-24 Thomas E. Ouldridge , Ard A. Louis , Jonathan P. K. Doye

The problem of nonlinear functional of parameters, such as differential entropy, has received much attention in information theory and statistics. In many situations, prior information about the parameters is available in the form of order…

Statistics Theory · Mathematics 2026-03-10 Somnath Mandal , Lakshmi Kanta Patra

The free energetics of water density fluctuations in bulk water, at interfaces, and in hydrophobic confinement inform the hydration of hydrophobic solutes as well as their interactions and assembly. The characterization of such free…

Statistical Mechanics · Physics 2018-03-15 Erte Xi , Sean M. Marks , Suruchi Fialoke , Amish J. Patel

To tackle massive data, subsampling is a practical approach to select the more informative data points. However, when responses are expensive to measure, developing efficient subsampling schemes is challenging, and an optimal sampling…

Computation · Statistics 2022-10-11 Jing Wang , HaiYing Wang , Shifeng Xiong

When the study variable is functional and storage capacities are limited or transmission costs are high, selecting with survey sampling techniques a small fraction of the observations is an interesting alternative to signal compression…

Statistics Theory · Mathematics 2013-02-15 Hervé Cardot , Camelia Goga , Pauline Lardin

This paper develops a variance estimation framework for matching estimators that enables valid population inference for treatment effects. We provide theoretical analysis of a variance estimator that addresses key limitations in the…

Methodology · Statistics 2025-06-16 Xiang Meng , Aaron Smith , Luke Miratrix