English
Related papers

Related papers: Trust-region and $p$-regularized subproblems: loca…

200 papers

We prove higher integrability for local minimizers of the double-phase orthotropic functional \[ \sum_{i=1}^{n}\int_\Omega\left(\left|u_{x_i}\right|^p+a(x)\left| u_{x_i}\right|^q\right)dx \] when the weight function $a \geq0$ is assumed to…

Analysis of PDEs · Mathematics 2025-07-25 Stefano Almi , Chiara Leone , Gianluigi Manzo

The minimum value function appearing in Tikhonov regularization technique is very useful in determining the regularization parameter, both theoretically and numerically. In this paper, we discuss the properties of the minimum value…

Optimization and Control · Mathematics 2009-10-23 K. Ito , T. Takeuchi

Hidden convex optimization is such a class of nonconvex optimization problems that can be globally solved in polynomial time via equivalent convex programming reformulations. In this paper, we focus on checking local optimality in hidden…

Optimization and Control · Mathematics 2021-09-08 Mengmeng Song , Yong Xia , Hongying Liu

We introduce a new regularization technique, using what we refer to as the Steklov regularization function, and apply this technique to devise an algorithm that computes a global minimizer of univariate coercive functions. First, we show…

Optimization and Control · Mathematics 2018-09-13 Orhan Arıkan , Regina S. Burachik , C. Yalçın Kaya

Minimizers in the least gradient problem with discontinuous boundary data need not be unique. However, all of them have a similar structure of level sets. Here, we give a full characterization of the set of minimizers in terms of any one of…

Analysis of PDEs · Mathematics 2017-09-08 Wojciech Górny

We consider the minimization of non-convex quadratic forms regularized by a cubic term, which exhibit multiple saddle points and poor local minima. Nonetheless, we prove that, under mild assumptions, gradient descent approximates the…

Optimization and Control · Mathematics 2022-08-31 Yair Carmon , John C. Duchi

We consider first-order methods with constant step size for minimizing locally Lipschitz coercive functions that are tame in an o-minimal structure on the real field. We prove that if the method is approximated by subgradient trajectories,…

Optimization and Control · Mathematics 2023-08-03 Cédric Josz , Lexiao Lai

We propose a bundle trust-region algorithm to minimize locally Lipschitz functions which are potentially nonsmooth and nonconvex. We prove global convergence of our method and show by way of an example that the classical convergence…

Optimization and Control · Mathematics 2015-04-03 Pierre Apkarian , Dominikus Noll , Laleh Ravanbod

We consider the convex optimization problem $\min \{f(x) : g_j(x)\leq 0, j=1,...,m\}$ where $f$ is convex, the feasible set K is convex and Slater's condition holds, but the functions $g_j$ are not necessarily convex. We show that for any…

Optimization and Control · Mathematics 2009-11-09 Jean B. Lasserre

The recent literature has intensively studied two classes of nonlocal variational problems, namely the ones related to the minimisation of energy functionals that act on functions in suitable Sobolev-Gagliardo spaces, and the ones related…

Analysis of PDEs · Mathematics 2020-09-15 Claudia Bucur , Serena Dipierro , Luca Lombardini , Enrico Valdinoci

We develop a globalized Proximal Newton method for composite and possibly non-convex minimization problems in Hilbert spaces. Additionally, we impose less restrictive assumptions on the composite objective functional considering…

Optimization and Control · Mathematics 2021-11-02 Bastian Pötzl , Anton Schiela , Patrick Jaap

We consider minimising $p$-harmonic maps from three-dimensional domains to the real projective plane, for $1<p<2$. These maps arise as least-energy configurations in variational models for nematic liquid crystals. We show that the singular…

Analysis of PDEs · Mathematics 2019-12-02 Giacomo Canevari , Giandomenico Orlandi

The unconstrained minimization of a sufficiently smooth objective function $f(x)$ is considered, for which derivatives up to order $p$, $p\geq 2$, are assumed to be available. An adaptive regularization algorithm is proposed that uses…

Optimization and Control · Mathematics 2021-05-31 Coralia Cartis , Nicholas I. M. Gould , Philippe L. Toint

We study the fundamental problem of estimating an unknown discrete distribution $p$ over $d$ symbols, given $n$ i.i.d. samples from the distribution. We are interested in minimizing the KL divergence between the true distribution and the…

Machine Learning · Statistics 2025-05-30 Jiayuan Ye , Vitaly Feldman , Kunal Talwar

An algorithm is proposed for solving stochastic and finite sum minimization problems. Based on a trust region methodology, the algorithm employs normalized steps, at least as long as the norms of the stochastic gradient estimates are within…

Optimization and Control · Mathematics 2018-06-27 Frank E. Curtis , Katya Scheinberg , Rui Shi

Minimax optimization problems arises from both modern machine learning including generative adversarial networks, adversarial training and multi-agent reinforcement learning, as well as from tradition research areas such as saddle point…

Optimization and Control · Mathematics 2020-04-22 Yu-HOng Dai , Liwei Zhang

In this paper, we propose a proximal iteratively reweighted algorithm with extrapolation based on block coordinate update aimed at solving a class of optimization problems which is the sum of a smooth possibly nonconvex loss function and a…

Optimization and Control · Mathematics 2023-12-13 Jie Zhang , Xinmin Yang

Despite its important applications in Machine Learning, min-max optimization of nonconvex-nonconcave objectives remains elusive. Not only are there no known first-order methods converging even to approximate local min-max points, but the…

Computational Complexity · Computer Science 2020-09-22 Constantinos Daskalakis , Stratis Skoulakis , Manolis Zampetakis

We study a nonlinear Neumann-to-Steklov limit generated by a family of interior weights concentrating at the boundary. On a class of admissible possibly irregular domains obtained from the unit ball by trace-compatible Sobolev…

Analysis of PDEs · Mathematics 2026-05-12 Alexander Menovschikov

We consider an energy functional motivated by the celebrated $K_{13}$ problem in the Oseen-Frank theory of nematic liquid crystals. It is defined for sphere-valued functions and appears as the usual Dirichlet energy with an additional…

Analysis of PDEs · Mathematics 2016-07-06 Stuart Day , Arghir Dani Zarnescu