English
Related papers

Related papers: Proximal Averages for Minimization of Entropy Func…

200 papers

Quadratic-support functions [Aravkin, Burke, and Pillonetto; J. Mach. Learn. Res. 14(1), 2013] constitute a parametric family of convex functions that includes a range of useful regularization terms found in applications of convex…

Optimization and Control · Mathematics 2018-08-23 Michael P. Friedlander , Gabriel Goh

Entropy functionals (i.e. convex integral functionals) and extensions of these functionals are minimized on convex sets. This paper is aimed at reducing as much as possible the assumptions on the constraint set. Dual equalities and…

Optimization and Control · Mathematics 2015-05-13 Christian Léonard

In this article we provide initial findings regarding the problem of solving likelihood equations by means of a maximum entropy approach. Unlike standard procedures that require equating at zero the score function of the maximum-likelihood…

Computation · Statistics 2019-06-18 Antonio Calcagnì , Livio Finos , Gianmarco Altoè , Massimiliano Pastore

The goal of the paper is development of an optimization method with the superlinear convergence rate for a nonsmooth convex function. For optimization an approximation is used that is similar to the Steklov integral averaging. The…

Optimization and Control · Mathematics 2023-08-03 I. M. Prudnikov

The proximal average of two convex functions has proven to be a useful tool in convex analysis. In this note, we express Goebel's self-dual smoothing operator in terms of the proximal average, which allows us to give a simple proof of self…

Functional Analysis · Mathematics 2010-03-31 Heinz H. Bauschke , Sarah M. Moffat , Xianfu Wang

A new result in convex analysis on the calculation of proximity operators in certain scaled norms is derived. We describe efficient implementations of the proximity calculation for a useful class of functions; the implementations exploit…

Optimization and Control · Mathematics 2013-03-04 Stephen Becker , M. Jalal Fadili

Given a strictly convex multiobjective optimization problem with objective functions $f_1,\dots,f_N$, let us denote by $x_0$ its solution, obtained as minimum point of the linear scalarized problem, where the objective function is the…

Optimization and Control · Mathematics 2023-03-06 Carlo Alberto De Bernardi , Enrico Miglierina , Elena Molho , Jacopo Somaglia

We propose a general framework for solving quantum state estimation problems using the minimum relative entropy criterion. A convex optimization approach allows us to decide the feasibility of the problem given the data and, whenever…

Quantum Physics · Physics 2013-01-29 Mattia Zorzi , Francesco Ticozzi , Augusto Ferrante

Dual averaging-type methods are widely used in industrial machine learning applications due to their ability to promoting solution structure (e.g., sparsity) efficiently. In this paper, we propose a novel accelerated dual-averaging…

Optimization and Control · Mathematics 2020-01-17 Conghui Tan , Yuqiu Qian , Shiqian Ma , Tong Zhang

In this work, we generalized and unified recent two completely different works of Jascha \cite{sohl2014fast} and Lee \cite{lee2012proximal} respectively into one by proposing the \textbf{prox}imal s\textbf{to}chastic \textbf{N}ewton-type…

Optimization and Control · Mathematics 2014-10-30 Ziqiang Shi

In the works on Statistical Mechanics and Statistical Physics, when deriving the distribution of particles of ideal gases, one uses the method of Lagrange multipliers in a formal way. In this paper we treat rigorously this problem for…

Mathematical Physics · Physics 2016-01-12 Constantin Zalinescu

In this paper, we discuss the problem of minimizing the sum of two convex functions: a smooth function plus a non-smooth function. Further, the smooth part can be expressed by the average of a large number of smooth component functions, and…

Machine Learning · Computer Science 2016-11-17 Luo Luo , Zihao Chen , Zhihua Zhang , Wu-Jun Li

We propose in this paper a proximal and contraction method for solving a convex mixed variational inequality problem in a real Hilbert space. To accelerate the convergence of our proposed method, we incorporate an inertial extrapolation…

Optimization and Control · Mathematics 2025-11-25 Chidi Elijah Nwakpa , Austine Efut Ofem , Kalu Okam Okorie , Chinedu Izuchukwu , Chibueze Christian Okeke

We extend the problem of obtaining an estimator for the finite population mean parameter incorporating complete auxiliary information through calibration estimation in survey sampling but considering a functional data framework. The…

Statistics Theory · Mathematics 2013-02-06 Santiago Gallón , Jean-Michel Loubes , Fabrice Gamboa

The excess entropy of restricted primitive model electrolytes is calculated using a potential based approach through the symmetric Poisson-Boltzmann and the modified Poisson-Boltzmann theories. The theories are utilized in conjunction with…

Statistical Mechanics · Physics 2025-04-01 S. Lamperski , L. B. Bhuiyan , C. W. Outhwaite , R. Gorniak

We consider synthesis and analysis of probability measures using the entropy-regularized Wasserstein-2 cost and its unbiased version, the Sinkhorn divergence. The synthesis problem consists of computing the barycenter, with respect to these…

Machine Learning · Statistics 2025-03-25 Brendan Mallery , James M. Murphy , Shuchin Aeron

Compressive sensing relies on the sparse prior imposed on the signal of interest to solve the ill-posed recovery problem in an under-determined linear system. The objective function used to enforce the sparse prior information should be…

Information Theory · Computer Science 2020-02-25 Shuai Huang , Trac D. Tran

This paper studies simple bilevel problems, where a convex upper-level function is minimized over the optimal solutions of a convex lower-level problem. We first show the fundamental difficulty of simple bilevel problems, that the…

Optimization and Control · Mathematics 2025-01-28 Huaqing Zhang , Lesi Chen , Jing Xu , Jingzhao Zhang

We develop an approach to spectral estimation that has been advocated by Ferrante, Masiero and Pavon and, in the context of the scalar-valued covariance extension problem, by Enqvist and Karlsson. The aim is to determine the power spectrum…

Systems and Control · Computer Science 2016-05-13 Tryphon T. Georgiou , Anders Lindquist

The paper proposes and justifies a new algorithm of the proximal Newton type to solve a broad class of nonsmooth composite convex optimization problems without strong convexity assumptions. Based on advanced notions and techniques of…

Optimization and Control · Mathematics 2022-03-02 Boris S. Mordukhovich , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang