English
Related papers

Related papers: Generalized entropy minimization under full margin…

200 papers

We show that the principle of maximum entropy, a variational method appearing in statistical inference, statistical physics, and the analysis of stochastic dynamical systems, admits a geometric description from gauge theory. Using the…

Mathematical Physics · Physics 2023-01-05 Dalton A R Sakthivadivel

In view of solving nonsmooth and nonconvex problems involving complex constraints (like standard NLP problems), we study general maximization-minimization procedures produced by families of strongly convex sub-problems. Using techniques…

Optimization and Control · Mathematics 2015-03-31 Jérôme Bolte , Edouard Pauwels

Derived from the concentration-compactness principle, the concept of generalized minimizer can be used to define generalized solutions of variational problems which may have components ``infinitely'' distant from each other. In this article…

Analysis of PDEs · Mathematics 2024-06-25 Jules Candau-Tilh

This work presents a novel general regularized distributed solution for the state estimation problem in networked systems. Resting on the graph-based representation of sensor networks and adopting a multivariate least-squares approach, the…

Systems and Control · Electrical Eng. & Systems 2021-11-17 Marco Fabris , Giulia Michieletto , Angelo Cenedese

We study the convergence of divergence-regularized optimal transport as the regularization parameter vanishes. Sharp rates for general divergences including relative entropy or $L^{p}$ regularization, general transport costs and…

Optimization and Control · Mathematics 2023-06-22 Stephan Eckstein , Marcel Nutz

We propose a family of "exactly solvable" probability distributions to approximate partition functions of two-dimensional statistical mechanics models. While these distributions lie strictly outside the mean-field framework, their free…

Statistical Mechanics · Physics 2021-06-09 Isaac H. Kim

In this paper, we will present a generalization for a minimization problem from I. Daubechies, M. Defrise, and C. Demol [3]. This generalization is useful for solving many practical problems in which more than one constraint are involved.…

Optimization and Control · Mathematics 2019-12-20 Saman Khoramian

Newton's method for finding an unconstrained minimizer for strictly convex functions, generally speaking, does not converge from any starting point. We introduce and study the damped regularized Newton's method (DRNM). It converges globally…

Optimization and Control · Mathematics 2017-06-27 Roman Polyak

In contrast to their seemingly simple and shared structure of independence and stationarity, L\'evy processes exhibit a wide variety of behaviors, from the self-similar Wiener process to piecewise-constant compound Poisson processes.…

Probability · Mathematics 2024-11-14 Julien Fageot , Alireza Fallah , Thibaut Horel

In this paper we extend a recent idea of formulating and regularizing inverse problems as minimization problems, so without using a forward operator, thus avoiding explicit evaluation of a parameter-to-state map. We do so by rephrasing…

Numerical Analysis · Mathematics 2020-04-28 Kha Van Huynh , Barbara Kaltenbacher

Purpose: This is an attempt to better bridge the gap between the mathematical and the engineering/physical aspects of the topic. We trace the different sources of non-convexification in the context of topology optimization problems starting…

Optimization and Control · Mathematics 2022-06-08 Mohamed Abdelhamid , Aleksander Czekanski

We study the problem of training neural stochastic differential equations, or diffusion models, to sample from a Boltzmann distribution without access to target samples. Existing methods for training such models enforce time-reversal of the…

Machine Learning · Computer Science 2026-02-05 Julius Berner , Lorenz Richter , Marcin Sendera , Jarrid Rector-Brooks , Nikolay Malkin

In this paper we apply the entropy principle to the relativistic version of the differential equations describing a standard fluid flow, that is, the equations for mass, momentum, and a system for the energy matrix. These are the second…

Mathematical Physics · Physics 2018-02-22 Hans Wilhelm Alt

An extension of the Gauss-Newton algorithm is proposed to find local minimizers of penalized nonlinear least squares problems, under generalized Lipschitz assumptions. Convergence results of local type are obtained, as well as an estimate…

Optimization and Control · Mathematics 2011-03-03 Saverio Salzo , Silvia Villa

We generalize the Brezzi-Rappaz-Raviart approximation theorem, which allows to obtain existence and a priori error estimates for approximations of solutions to some nonlinear partial differential equations. Our contribution lies in the fact…

Numerical Analysis · Mathematics 2026-05-08 Jules Berry , Olivier Ley , Francisco José Silva

This paper presents a particle-based optimization method designed for addressing minimization problems with equality constraints, particularly in cases where the loss function exhibits non-differentiability or non-convexity. The proposed…

Optimization and Control · Mathematics 2026-03-31 José A. Carrillo , Shi Jin , Haoyu Zhang , Yuhua Zhu

For statistical systems that violate one of the four Shannon-Khinchin axioms, entropy takes a more general form than the Boltzmann-Gibbs entropy. The framework of superstatistics allows one to formulate a maximum entropy principle with…

Classical Physics · Physics 2012-11-13 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

We solve explicitly a certain minimization problem for probability measures in one dimension involving an interaction energy that arises in the modelling of aggregation phenomena. We show that in a certain regime minimizers are absolutely…

Mathematical Physics · Physics 2021-09-21 Rupert L. Frank

We tackle the inverse problem of reconstructing an unknown finite measure $\mu$ from a noisy observation of a generalized moment of $\mu$ defined as the integral of a continuous and bounded operator $\Phi$ with respect to $\mu$. When only a…

Statistics Theory · Mathematics 2009-06-03 Jean-Michel Loubes , Paul Rochet

An Euler discretization of the Langevin diffusion is known to converge to the global minimizers of certain convex and non-convex optimization problems. We show that this property holds for any suitably smooth diffusion and that different…

Machine Learning · Statistics 2019-12-30 Murat A. Erdogdu , Lester Mackey , Ohad Shamir