English
Related papers

Related papers: Minimization of entropy functionals

200 papers

We propose a variable metric framework for minimizing the sum of a self-concordant function and a possibly non-smooth convex function, endowed with an easily computable proximal operator. We theoretically establish the convergence of our…

Machine Learning · Statistics 2014-04-15 Quoc Tran-Dinh , Anastasios Kyrillidis , Volkan Cevher

We study the convexity of the entropy functional along particular interpolating curves defined on the space of finitely supported probability measures on a graph.

Probability · Mathematics 2014-06-20 Erwan Hillion

We propose an entropy function for simplicial complices. Its value gives the expected cost of the optimal encoding of sequences of vertices of the complex, when any two vertices belonging to the same simplex are indistinguishable. We show…

Information Theory · Computer Science 2016-03-24 Stefan Dantchev , Ioannis Ivrissimtzis

We consider the problem of recovering elements of a low-dimensional model from under-determined linear measurements. To perform recovery, we consider the minimization of a convex regularizer subject to a data fit constraint. Given a model,…

Signal Processing · Electrical Eng. & Systems 2024-04-22 Yann Traonmilin , Rémi Gribonval , Samuel Vaiter

The geometric problem of estimating an unknown compact convex set from evaluations of its support function arises in a range of scientific and engineering applications. Traditional approaches typically rely on estimators that minimize the…

Statistics Theory · Mathematics 2021-02-26 Yong Sheng Soh , Venkat Chandrasekaran

Description of linear continuous functionals on a space of rapidly decreasing infinitely differentiable functions on an unbounded closed convex set in $\mathbb R^n$ in terms of their Fourier-Laplace transform is obtained.

Complex Variables · Mathematics 2010-03-18 I. Kh. Musin , P. V. Yakovleva

In this paper we study theoretical properties of the entropy-transport functional with repulsive cost functions. We provide sufficient conditions for the existence of a minimizer in a class of metric spaces and prove the…

Analysis of PDEs · Mathematics 2019-07-19 Augusto Gerolin , Anna Kausamo , Tapio Rajala

Based on a characterization of the optimality of a feasible solution of a convex entropy minimization problem, one shows that the feasible solutions obtained using formally the Lagrange multipliers method are optimal.

Optimization and Control · Mathematics 2017-08-29 Constantin Zalinescu

The minimization of a nonconvex composite function can model a variety of imaging tasks. A popular class of algorithms for solving such problems are majorization-minimization techniques which iteratively approximate the composite nonconvex…

Optimization and Control · Mathematics 2018-09-05 Jonas Geiping , Michael Moeller

A unified formulation of the density functional theory is constructed on the foundations of entropic inference in both the classical and the quantum regimes. The theory is introduced as an application of entropic inference for inhomogeneous…

Statistical Mechanics · Physics 2021-12-20 Ahmad Yousefi

We consider volume-constrained minimizers of the fractional perimeter with the addition of a potential energy in the form of a volume inte- gral. Such minimizers are solutions of the prescribed fractional curvature problem. We prove…

Analysis of PDEs · Mathematics 2016-03-01 Annalisa Cesaroni , Matteo Novaga

The aim of this paper is to extend worst risk minimization, also called worst average loss minimization, to the functional realm. This means finding a functional regression representation that will be robust to future distribution shifts on…

Statistics Theory · Mathematics 2025-04-15 Philip Kennerberg , Ernst C. Wit

Functions with uniform sublevel sets can represent orders, preference relations or other binary relations and thus turn out to be a tool for scalarization that can be used in multicriteria optimization, decision theory, mathematical…

Optimization and Control · Mathematics 2017-12-06 Petra Weidner

In this paper, we consider functionals of the form $H_\alpha(u)=F(u)+\alpha G(u)$ with $\alpha\in[0,+\infty)$, where $u$ varies in a set $U\neq\emptyset$ (without further structure). We first revisit a result stating that, excluding at most…

Optimization and Control · Mathematics 2025-01-28 Massimo Fornasier , Jona Klemenc , Alessandro Scagliotti

We establish Maximum Principles which apply to vectorial approximate minimizers of the general integral functional of Calculus of Variations. Our main result is a version of the Convex Hull Property. The primary advance compared to results…

Analysis of PDEs · Mathematics 2013-04-22 Nikolaos I. Katzourakis

Building on the recent work of Johnson (2007) and Yu (2008), we prove that entropy is a concave function with respect to the thinning operation T_a. That is, if X and Y are independent random variables on Z_+ with ultra-log-concave…

Information Theory · Computer Science 2009-09-24 Yaming Yu , Oliver Johnson

This paper establishes a strict mathematical relationship between an arbitrary continuous function on a compact set and its global minima, like the well-known first order optimality condition for convex and differentiable functions. By…

Optimization and Control · Mathematics 2019-05-27 Xiaopeng Luo

A considerable amount of literature in the theory of inequality is devoted to the study of Jensen's and Young's inequality. This article presents a number of new inequalities involving the log-convex functions and the geometrically convex…

Classical Analysis and ODEs · Mathematics 2022-02-10 Shigeru Furuichi , Hamid Reza Moradi , Supriyo Dutta

In this paper we consider quasi-concave set functions defined on antimatroids. There are many equivalent axiomatizations of antimatroids, that may be separated into two categories: antimatroids defined as set systems and antimatroids…

Combinatorics · Mathematics 2011-01-25 Vadim E. Levit , Yulia Kempner

Estimation of convex functions finds broad applications in engineering and science, while convex shape constraint gives rise to numerous challenges in asymptotic performance analysis. This paper is devoted to minimax optimal estimation of…

Statistics Theory · Mathematics 2013-06-11 Teresa M. Lebair , Jinglai Shen , Xiao Wang