English
Related papers

Related papers: Convex potentials and optimal shift generated obli…

200 papers

We derive optimal estimates for the Bergman kernel and the Bergman metric for certain model domains in $\mathbb{C}^2$ near boundary points that are of infinite type. Being unbounded models, these domains obey certain geometric constraints…

Complex Variables · Mathematics 2021-03-25 Gautam Bharali

We study the implicit bias of gradient flow (i.e., gradient descent with infinitesimal step size) on linear neural network training. We propose a tensor formulation of neural networks that includes fully-connected, diagonal, and…

Machine Learning · Computer Science 2021-09-13 Chulhee Yun , Shankar Krishnan , Hossein Mobahi

We introduce a novel family of invariant, convex, and non-quadratic functionals that we employ to derive regularized solutions of ill-posed linear inverse imaging problems. The proposed regularizers involve the Schatten norms of the Hessian…

Optimization and Control · Mathematics 2014-02-20 Stamatios Lefkimmiatis , John Paul Ward , Michael Unser

We extend the theory of operator-valued frames (resp. bases), hence the theory of frames (resp. bases), for Hilbert spaces and Hilbert C*-modules, in two folds. This extension leads us to develop the theory of operator-valued frames (resp.…

Operator Algebras · Mathematics 2018-10-04 K. Mahesh Krishna , P. Sam Johnson

Parallel and cyclic projection algorithms are proposed for minimizing the sum of a finite family of convex functions over the intersection of a finite family of closed convex subsets of a Hilbert space. These algorithms are of…

Optimization and Control · Mathematics 2019-01-08 Hong-Kun Xu , Vera Roshchina

We study random iterations of averaged operators in Hilbert spaces and prove that the associated residuals converge exponentially fast, both in expectation and almost surely. Our results provide quantitative bounds in terms of a single…

Functional Analysis · Mathematics 2025-09-15 James Tian

In this paper, we use composite optimization algorithms to solve sigmoid networks. We equivalently transfer the sigmoid networks to a convex composite optimization and propose the composite optimization algorithms based on the linearized…

Optimization and Control · Mathematics 2023-07-10 Huixiong Chen , Qi Ye

Image reconstruction enhanced by regularizers, e.g., to enforce sparsity, low rank or smoothness priors on images, has many successful applications in vision tasks such as computer photography, biomedical and spectral imaging. It has been…

Optimization and Control · Mathematics 2022-11-21 Samuel Pinilla , Tingting Mu , Neil Bourne , Jeyan Thiyagalingam

Based on the ideas of arXiv:1710.06612, we consider the problem of minimization of the Holder-continuous non-smooth functional $f$ with non-positive convex (generally, non-smooth) Lipschitz-continuous functional constraint. We propose some…

Optimization and Control · Mathematics 2022-01-03 Fedor Stonyakin , Alexey Stepanov , Alexander Gasnikov , Alexander Titov

Proximal operators with affine constraints arise in numerous models in nonconvex projection, composite optimization, and structured regularization. However, their efficient computation remains challenging due to the simultaneous presence of…

Optimization and Control · Mathematics 2026-03-02 Di Hou , Tianyun Tang , Kim-Chuan Toh , Shiwei Wang

We establish effective versions of Oppenheim's conjecture for generic inhomogeneous quadratic forms. We prove such results for fixed shift vectors and generic quadratic forms. When the shift is rational we prove a counting result which…

Number Theory · Mathematics 2020-08-18 Anish Ghosh , Dubi Kelmer , Shucheng Yu

We develop a new approximation theory for linear and quadratic interpolation models, suitable for use in convex-constrained derivative-free optimization (DFO). Most existing model-based DFO methods for constrained problems assume the…

Optimization and Control · Mathematics 2024-03-25 Lindon Roberts

This paper settles the existence question for a rather general class of convex optimal design problems with a volume constraint. In low dimensions, we prove the existence of an optimal configuration for general convex minimization problems…

Analysis of PDEs · Mathematics 2008-03-19 Eduardo V. Teixeira

Topology optimization of frame structures under free-vibration eigenvalue constraints constitutes a challenging nonconvex polynomial optimization problem with disconnected feasible sets. In this article, we first formulate it as a…

Optimization and Control · Mathematics 2025-09-08 Marek Tyburec , Michal Kočvara , Marouan Handa , Jan Zeman

We study sparsity and spectral properties of dual frames of a given finite frame. We show that any finite frame has a dual with no more than $n^2$ non-vanishing entries, where $n$ denotes the ambient dimension, and that for most frames no…

Functional Analysis · Mathematics 2012-04-24 Felix Krahmer , Gitta Kutyniok , Jakob Lemvig

A fundamental problem arising in many areas of machine learning is the evaluation of the likelihood of a given observation under different nominal distributions. Frequently, these nominal distributions are themselves estimated from data,…

Optimization and Control · Mathematics 2019-10-18 Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh , Man-Chung Yue , Daniel Kuhn , Wolfram Wiesemann

In this article, we study the binary classification problem with supervised data, in the case where the covariate-to-probability-of-success map is possibly spatially inhomogeneous. We devise nonparametric Bayesian procedures with…

Statistics Theory · Mathematics 2025-09-10 Matteo Giordano

Motivated by the computation of the non-parametric maximum likelihood estimator (NPMLE) and the Bayesian posterior in statistics, this paper explores the problem of convex optimization over the space of all probability distributions. We…

Statistics Theory · Mathematics 2023-11-03 Rentian Yao , Linjun Huang , Yun Yang

We develop a novel unified randomized block-coordinate primal-dual algorithm to solve a class of nonsmooth constrained convex optimization problems, which covers different existing variants and model settings from the literature. We prove…

Optimization and Control · Mathematics 2021-10-29 Quoc Tran-Dinh , Deyi Liu

Conventional inverse optimization inputs a solution and finds the parameters of an optimization model that render a given solution optimal. The literature mostly focuses on inferring the objective function in linear problems when accepted…

Optimization and Control · Mathematics 2024-10-10 Houra Mahmoudzadeh , Kimia Ghobadi