中文
相关论文

相关论文: Proximal Averages for Minimization of Entropy Func…

200 篇论文

We develop and analyze $M$-estimation methods for divergence functionals and the likelihood ratios of two probability distributions. Our method is based on a non-asymptotic variational characterization of $f$-divergences, which allows the…

统计理论 · 数学 2016-11-18 XuanLong Nguyen , Martin J. Wainwright , Michael I. Jordan

Free-energy-based adaptive biasing methods, such as Metadynamics, the Adaptive Biasing Force (ABF) and their variants, are enhanced sampling algorithms widely used in molecular simulations. Although their efficiency has been empirically…

概率论 · 数学 2026-01-29 Tony Lelièvre , Xuyang Lin , Pierre Monmarché

We study the use of von Neumann entropy constraints for obtaining lower bounds on the ground energy of quantum many-body systems. Known methods for obtaining certificates on the ground energy typically use consistency of local observables…

量子物理 · 物理学 2024-06-19 Hamza Fawzi , Omar Fawzi , Samuel O. Scalet

Perspective functions arise explicitly or implicitly in various forms in applied mathematics and in statistical data analysis. To date, no systematic strategy is available to solve the associated, typically nonsmooth, optimization problems.…

最优化与控制 · 数学 2016-12-15 Patrick L. Combettes , Christian L. Müller

We establish the theoretical framework for implementing the maximumn entropy on the mean (MEM) method for linear inverse problems in the setting of approximate (data-driven) priors. We prove a.s. convergence for empirical means and further…

机器学习 · 统计学 2024-12-25 Matthew King-Roskamp , Rustum Choksi , Tim Hoheisel

We develop a method, based on a Bochner-type identity, to obtain estimates on the exponential rate of decay of the relative entropy from equilibrium of Markov processes in discrete settings. When this method applies the relative entropy…

概率论 · 数学 2007-12-18 Pietro Caputo , Paolo Dai Pra , Gustavo Posta

Sample average approximation (SAA) replaces an intractable expected objective by an empirical average and is a basic device of modern stochastic optimization. We develop a rate theory for optimal values and empirical…

最优化与控制 · 数学 2026-04-29 Hien Duy Nguyen , Jacob Westerhout , Xin Guo

Finding parameters that minimise a loss function is at the core of many machine learning methods. The Stochastic Gradient Descent algorithm is widely used and delivers state of the art results for many problems. Nonetheless, Stochastic…

机器学习 · 计算机科学 2018-09-26 Yao Zhang , Andrew M. Saxe , Madhu S. Advani , Alpha A. Lee

Low-rank matrix completion is a problem of immense practical importance. Recent works on the subject often use nuclear norm as a convex surrogate of the rank function. Despite its solid theoretical foundation, the convex version of the…

计算机视觉与模式识别 · 计算机科学 2014-10-29 Yu-Xiang Wang , Choon Meng Lee , Loong-Fah Cheong , Kim-Chuan Toh

We present a new approach for computing approximate global minimizers to a large class of non-local pairwise interaction problems defined over probability distributions. The approach predicts candidate global minimizers, with a recovery…

数值分析 · 数学 2017-10-04 Mahdi Bandegi , David Shirokoff

We develop model-based methods for solving stochastic convex optimization problems, introducing the approximate-proximal point, or aProx, family, which includes stochastic subgradient, proximal point, and bundle methods. When the modeling…

最优化与控制 · 数学 2019-09-20 Hilal Asi , John C. Duchi

We consider the problem of minimizing a finite sum of convex functions subject to the set of minimizers of a convex differentiable function. In order to solve the problem, an algorithm combining the incremental proximal gradient method with…

最优化与控制 · 数学 2020-04-21 Nimit Nimana , Narin Petrot

This paper presents a unified analysis for the proximal subgradient method (Prox-SubGrad) type approach to minimize an overall objective of $f(x)+r(x)$, subject to convex constraints, where both $f$ and $r$ are weakly convex, nonsmooth, and…

最优化与控制 · 数学 2026-01-23 Daoli Zhu , Lei Zhao , Shuzhong Zhang

We present an a posteriori error estimate based on equilibrated stress reconstructions for the finite element approximation of a unilateral contact problem with weak enforcement of the contact conditions. We start by proving a guaranteed…

数值分析 · 数学 2021-09-27 Daniele Antonio Di Pietro , Ilaria Fontana , Kyrylo Kazymyrenko

Accuracy of the mean activity coefficient expression (Hansen-Vieillefosse-Belloni equation), valid within the hypernetted chain (HNC) approximation, was tested in a wide concentration range against new Monte Carlo (MC) data for +1:-1 and…

软凝聚态物质 · 物理学 2012-02-21 E. Gutiérrez-Valladares , M. Luksic , B. Millán-Malo , B. Hribar-Lee , V. Vlachy

Optimisation problems in science and engineering typically involve finding the ground state (i.e. the minimum energy configuration) of a cost function with respect to many variables. If the variables are corrupted by noise then this…

量子物理 · 物理学 2016-03-08 Nicholas Chancellor , Szilard Szoke , Walter Vinci , Gabriel Aeppli , Paul A. Warburton

In this paper, we propose a new lower approximation scheme for POMDP with discounted and average cost criterion. The approximating functions are determined by their values at a finite number of belief points, and can be computed efficiently…

人工智能 · 计算机科学 2012-07-19 Huizhen Yu , Dimitri Bertsekas

We derive normal approximation bounds in the Wasserstein distance for sums of weighted U-statistics, based on a general distance bound for functionals of independent random variables of arbitrary distributions. Those bounds are applied to…

概率论 · 数学 2020-07-28 Nicolas Privault , Grzegorz Serafin

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

信息论 · 计算机科学 2017-05-01 Maciej Skorski

Weighted average sampling is more practical and numerically more stable than sampling at single points as in the classical Shannon sampling framework. Using the frame theory, one can completely reconstruct a bandlimited function from its…

信息论 · 计算机科学 2014-07-04 Haizhang Zhang
‹ 上一页 1 8 9 10 下一页 ›