English
Related papers

Related papers: A characterization of proximity operators

200 papers

We present results about minimization of convex functionals defined over a finite set of vectors in a finite dimensional Hilbert space, that extend several known results for the Benedetto-Fickus frame potential. Our approach depends on…

Functional Analysis · Mathematics 2007-10-08 Pedro Massey , Mariano Ruiz

This paper focuses on a class of inclusion problems of maximal monotone operators in a multi-agent network, where each agent is characterized by an operator that is not available to any other agents, but the agents can cooperate by…

Optimization and Control · Mathematics 2023-10-25 Kai Gong , Liwei Zhang

The stochastic gradient descent has been widely used for solving composite optimization problems in big data analyses. Many algorithms and convergence properties have been developed. The composite functions were convex primarily and…

Machine Learning · Statistics 2020-03-03 Takayuki Kawashima , Hironori Fujisawa

We introduce and study a new class of generalized convex functions termed star quasiconvex functions. This class includes convex, star-convex, quasiconvex, quasar-convex, and positively homogeneous functions of any degree $p>0$ as special…

Optimization and Control · Mathematics 2026-05-27 Phan Quoc Khanh , Felipe Lara

Finding multiple solutions of non-convex optimization problems is a ubiquitous yet challenging task. Most past algorithms either apply single-solution optimization methods from multiple random initial guesses or search in the vicinity of…

Machine Learning · Computer Science 2023-03-03 Lingxiao Li , Noam Aigerman , Vladimir G. Kim , Jiajin Li , Kristjan Greenewald , Mikhail Yurochkin , Justin Solomon

Proximal distance algorithms combine the classical penalty method of constrained minimization with distance majorization. If $f(\boldsymbol{x})$ is the loss function, and $C$ is the constraint set in a constrained minimization problem, then…

Optimization and Control · Mathematics 2019-05-21 Kevin L. Keys , Hua Zhou , Kenneth Lange

Sparse Gaussian graphical models characterize sparse dependence relationships between random variables in a network. To estimate multiple related Gaussian graphical models on the same set of variables, we formulate a hierarchical model,…

Methodology · Statistics 2014-06-10 Yuancheng Zhu , Rina Foygel Barber

Many problems of theoretical and practical interest involve finding an optimum over a family of convex functions. For instance, finding the projection on the convex functions in $H^k(\Omega)$, and optimizing functionals arising from some…

Numerical Analysis · Mathematics 2008-04-11 Néstor E. Aguilera , Pedro Morin

We prove that operators satisfying the hypotheses of the extrapolation theorem for Muckenhoupt weights are bounded on weighted Morrey spaces. As a consequence, we obtain at once a number of results that have been proved individually for…

Functional Analysis · Mathematics 2017-10-23 Javier Duoandikoetxea , Marcel Rosenthal

We prove an extrapolation of compactness theorem for operators on Banach function spaces satisfying certain convexity and concavity conditions. In particular, we show that the boundedness of an operator $T$ in the weighted Lebesgue scale…

Classical Analysis and ODEs · Mathematics 2024-05-31 Emiel Lorist , Zoe Nieraeth

The relationship between the operator approximation property and the strong operator approximation property has deep significance in the theory of operator algebras. The original definitions of Effros and Ruan, unlike the classical…

Functional Analysis · Mathematics 2007-05-23 Corran Webster

This paper provides a set of sensitivity analysis and activity identification results for a class of convex functions with a strong geometric structure, that we coined "mirror-stratifiable". These functions are such that there is a…

Optimization and Control · Mathematics 2018-06-06 Jalal Fadili , Jérôme Malick , Gabriel Peyré

Many practical optimization problems lack strong convexity. Fortunately, recent studies have revealed that first-order algorithms also enjoy linear convergences under various weaker regularity conditions. While the relationship among…

Optimization and Control · Mathematics 2026-02-05 Feng-Yi Liao , Lijun Ding , Yang Zheng

Penalty methods are a well known class of algorithms for constrained optimization. They transform a constrained problem into a sequence of unconstrained \emph{penalized} problems in the hope that approximate solutions of the latter converge…

Optimization and Control · Mathematics 2025-12-01 Youssef Diouane , Maxence Gollier , Dominique Orban

In this paper, a convex optimization-based method is proposed for numerically solving dynamic programs in continuous state and action spaces. The key idea is to approximate the output of the Bellman operator at a particular state by the…

Optimization and Control · Mathematics 2020-10-23 Insoon Yang

Norm resolvent approximation for a wide class of point interactions in one dimension is constructed. To analyse the limit behaviour of Schr\"odinger operators with localized singular rank-two perturbations coupled with {\delta}-like…

Spectral Theory · Mathematics 2019-01-04 Yuriy Golovaty

We propose a unifying algorithm for non-smooth non-convex optimization. The algorithm approximates the objective function by a convex model function and finds an approximate (Bregman) proximal point of the convex model. This approximate…

Optimization and Control · Mathematics 2018-06-27 Peter Ochs , Jalal Fadili , Thomas Brox

Non-convex optimization is ubiquitous in modern machine learning. Researchers devise non-convex objective functions and optimize them using off-the-shelf optimizers such as stochastic gradient descent and its variants, which leverage the…

Machine Learning · Computer Science 2021-03-26 Tengyu Ma

We propose a new class of nonconvex penalty functions, based on data depth functions, for multitask sparse penalized regression. These penalties quantify the relative position of rows of the coefficient matrix from a fixed distribution…

Methodology · Statistics 2018-05-08 Subhabrata Majumdar , Snigdhansu Chatterjee

We study the problem of estimating the fixed point of a contractive operator defined on a separable Banach space. Focusing on a stochastic query model that provides noisy evaluations of the operator, we analyze a variance-reduced stochastic…

Statistics Theory · Mathematics 2022-11-30 Wenlong Mou , Koulik Khamaru , Martin J. Wainwright , Peter L. Bartlett , Michael I. Jordan