English
Related papers

Related papers: Shannon-and von neumann-entropy regularizations of…

200 papers

It is well known that the minimum $\ell_2$-norm solution of the convex LASSO model, say $\mathbf{x}_{\star}$, is a continuous piecewise linear function of the regularization parameter $\lambda$, and its signed sparsity pattern is constant…

Optimization and Control · Mathematics 2024-11-13 Yi Zhang , Isao Yamada

We investigate entropy minimization problems for quantum states subject to convex block-separable constraints. Our principal result is a quantitative stability theorem: under a natural confining (fixed-support) hypothesis, if a state has…

Quantum Physics · Physics 2026-01-21 Hassan Nasreddine

An unsolved issue in widely used methods such as Support Vector Data Description (SVDD) and Small Sphere and Large Margin SVM (SSLM) for anomaly detection is their nonconvexity, which hampers the analysis of optimal solutions in a manner…

Machine Learning · Computer Science 2025-10-01 Hongying Liu , Hao Wang , Haoran Chu , Yibo Wu

This paper presents a convex optimization-based method for finding the globally optimal solutions of a class of mixed-integer non-convex optimal control problems. We consider problems that are non-convex in the input norm, which is a…

Optimization and Control · Mathematics 2019-11-20 Danylo Malyuta , Michael Szmuk , Behcet Acikmese

We consider the general polynomial optimization problem $P: f^*=\min \{f(x)\,:\,x\in K\}$ where $K$ is a compact basic semi-algebraic set. We first show that the standard Lagrangian relaxation yields a lower bound as close as desired to the…

Optimization and Control · Mathematics 2012-10-18 Jean Lasserre

From optimal transport to robust dimensionality reduction, a plethora of machine learning applications can be cast into the min-max optimization problems over Riemannian manifolds. Though many min-max algorithms have been analyzed in the…

Optimization and Control · Mathematics 2022-09-29 Michael I. Jordan , Tianyi Lin , Emmanouil-Vasileios Vlatakis-Gkaragkounis

Many problems in geometric optics or convex geometry can be recast as optimal transport problems: this includes the far-field reflector problem, Alexandrov's curvature prescription problem, etc. A popular way to solve these problems…

Numerical Analysis · Mathematics 2017-03-08 Jun Kitagawa , Quentin Mérigot , Boris Thibert

We consider convex relaxations for recovering low-rank tensors based on constrained minimization over a ball induced by the tensor nuclear norm, recently introduced in \cite{tensor_tSVD}. We build on a recent line of results that considered…

Optimization and Control · Mathematics 2023-08-04 Dan Garber , Atara Kaplan

This paper is concerned with six variational problems and their mutual connections: The quadratic Monge-Kantorovich optimal transport, the Schr\"odinger problem, Brenier's relaxed model for incompressible fluids, the so-called Br\"odinger…

Analysis of PDEs · Mathematics 2019-08-09 Aymeric Baradat , Léonard Monsaingeon

We consider the strictly correlated electron (SCE) limit of the fermionic quantum many-body problem in the second-quantized formalism. This limit gives rise to a multi-marginal optimal transport (MMOT) problem. Here the marginal state space…

Optimization and Control · Mathematics 2020-09-17 Yuehaw Khoo , Lin Lin , Michael Lindsey , Lexing Ying

Semi-Infinite Programming (SIP) has emerged as a powerful framework for modeling problems with infinite constraints, however, its theoretical development in the context of nonconvex and large-scale optimization remains limited. In this…

Optimization and Control · Mathematics 2025-10-15 Cody Melcher , Zeinab Alizadeh , Lindsey Hiett , Afrooz Jalilzadeh , Erfan Yazdandoost Hamedani

Developing a contemporary optimal transport (OT) solver requires navigating trade-offs among several critical requirements: GPU parallelization, scalability to high-dimensional problems, theoretical convergence guarantees, empirical…

Machine Learning · Computer Science 2025-04-04 Mete Kemertas , Amir-massoud Farahmand , Allan D. Jepson

We propose and analyze several inexact regularized Newton-type methods for finding a global saddle point of convex-concave unconstrained min-max optimization problems. Compared to first-order methods, our understanding of second-order…

Optimization and Control · Mathematics 2026-05-27 Tianyi Lin , Panayotis Mertikopoulos , Michael I. Jordan

The globally optimal robust adaptive beamforming (RAB) solution is studied for worst-case signal-to-interference-plus-noise ratio (SINR) maximization (the maximin SINR problem) under convex and closed uncertainty sets for the desired signal…

Signal Processing · Electrical Eng. & Systems 2026-04-17 Yongwei Huang , Zhenhui Huang , Sergiy A. Vorobyov , Zhi-Quan Luo

Signomial programs (SPs) are optimization problems specified in terms of signomials, which are weighted sums of exponentials composed with linear functionals of a decision variable. SPs are non-convex optimization problems in general, and…

Optimization and Control · Mathematics 2014-09-29 Venkat Chandrasekaran , Parikshit Shah

We propose that the LP-Newton method can be used to solve conic LPs over a conic box, whenever linear optimization over an otherwise unconstrained conic box is easy. In particular, if $\leq_\mathcal{K}$ is the partial order induced by a…

Optimization and Control · Mathematics 2017-08-16 Francesco Silvestri , Gerhard Reinelt

Our first result is a statement of a somewhat general form of a non-substitution theorem for linear programming problems, along with a very easy proof of the same. Subsequently, we provide an easy proof of theorem 1 in a 1979 paper of Olvi…

Optimization and Control · Mathematics 2025-04-08 Somdeb Lahiri

Motivated by some applications in signal processing and machine learning, we consider two convex optimization problems where, given a cone $K$, a norm $\|\cdot\|$ and a smooth convex function $f$, we want either 1) to minimize the norm over…

Optimization and Control · Mathematics 2013-03-29 Zaid Harchaoui , Anatoli Juditsky , Arkadi Nemirovski

Recently, linear regression models incorporating an optimal transport (OT) loss have been explored for applications such as supervised unmixing of spectra, music transcription, and mass spectrometry. However, these task-specific approaches…

Within a framework of utmost generality, we show that the entropy maximization procedure with linear constraints uniquely leads to the Shannon-Boltzmann-Gibbs entropy. Therefore, the use of this procedure with linear constraints should not…

Statistical Mechanics · Physics 2018-05-01 Thomas Oikonomou , G. Baris Bagci