English
Related papers

Related papers: Second-order edge-penalization in the Ambrosio-Tor…

200 papers

We give an algorithm to compute a one-dimensional shape-constrained function that best fits given data in weighted-$L_{\infty}$ norm. We give a single algorithm that works for a variety of commonly studied shape constraints including…

Data Structures and Algorithms · Computer Science 2019-05-30 David Durfee , Yu Gao , Anup B. Rao , Sebastian Wild

The eigenfunctions of the Laplace Beltrami operator (Manifold Harmonics) define a function basis that can be used in spectral analysis on manifolds. In [21] the authors recast the problem as an orthogonality constrained optimization problem…

Numerical Analysis · Mathematics 2018-04-23 Martin Huska , Damiana Lazzaro , Serena Morigi

In this paper, we propose a penalty dual-primal augmented lagrangian method for solving convex minimization problems under linear equality or inequality constraints. The proposed method combines a novel penalty technique with updates the…

Optimization and Control · Mathematics 2023-05-09 Jie Liu , Xiaoqing Ou , Jiawei Chen

We present in this paper first-order alternating linearization algorithms based on an alternating direction augmented Lagrangian approach for minimizing the sum of two convex functions. Our basic methods require at most $O(1/\epsilon)$…

Optimization and Control · Mathematics 2010-10-14 Donald Goldfarb , Shiqian Ma , Katya Scheinberg

We propose a new class of convex penalty functions, called \emph{variational Gram functions} (VGFs), that can promote pairwise relations, such as orthogonality, among a set of vectors in a vector space. These functions can serve as…

Optimization and Control · Mathematics 2017-04-13 Amin Jalali , Maryam Fazel , Lin Xiao

We consider the problem of inferring the unobserved edges of a graph from data supported on its nodes. In line with existing approaches, we propose a convex program for recovering a graph Laplacian that is approximately diagonalizable by a…

Signal Processing · Electrical Eng. & Systems 2020-10-16 T. Mitchell Roddenberry , Madeline Navarro , Santiago Segarra

Total Generalized Variation (TGV) has recently been introduced as penalty functional for modelling images with edges as well as smooth variations. It can be interpreted as a "sparse" penalization of optimal balancing from the first up to…

Numerical Analysis · Mathematics 2020-05-21 Kristian Bredies , Tuomo Valkonen

We develop a method for optimization in shape spaces, i.e., sets of surfaces modulo re-parametrization. Unlike previously proposed gradient flows, we achieve superlinear convergence rates through a subtle approximation of the shape Hessian,…

Computer Vision and Pattern Recognition · Computer Science 2014-04-15 J. Balzer , S. Soatto

We present first a brief review of the existing literature on shape optimization, stressing the recent use of Hamiltonian systems in topology optimization. In the second section, we collect some preliminaries on the implicit parametrization…

Optimization and Control · Mathematics 2022-11-23 Cornel Marius Murea , Dan Tiba

We consider the problem of estimation of a shift parameter of an unknown symmetric function in Gaussian white noise. We introduce a notion of semiparametric second-order efficiency and propose estimators that are semiparametrically…

Statistics Theory · Mathematics 2007-06-13 A. S. Dalalyan , G. K. Golubev , A. B. Tsybakov

We propose a novel second-order ODE as the continuous-time limit of a Riemannian accelerated gradient-based method on a manifold with curvature bounded from below. This ODE can be seen as a generalization of the ODE derived for Euclidean…

Optimization and Control · Mathematics 2020-03-10 Foivos Alimisis , Antonio Orvieto , Gary Bécigneul , Aurelien Lucchi

We consider the problem of minimizing a convex function over the intersection of finitely many simple sets which are easy to project onto. This is an important problem arising in various domains such as machine learning. The main difficulty…

Optimization and Control · Mathematics 2017-10-19 Achintya Kundu , Francis Bach , Chiranjib Bhattacharyya

We consider minimization of a smooth nonconvex function with inexact oracle access to gradient and Hessian (without assuming access to the function value) to achieve approximate second-order optimality. A novel feature of our method is that…

Optimization and Control · Mathematics 2024-03-27 Shuyao Li , Stephen J. Wright

This paper presents the Gaussian subordination framework to generate optimal one-sided approximations to multidimensional real-valued functions by functions of prescribed exponential type. Such extremal problems date back to the works of…

Classical Analysis and ODEs · Mathematics 2021-09-30 Emanuel Carneiro , Friedrich Littmann

We consider minimizing a function consisting of a quadratic term and a proximable term which is possibly nonconvex and nonsmooth. This problem is also known as scaled proximal operator. Despite its simple form, existing methods suffer from…

Optimization and Control · Mathematics 2024-03-01 Yiming Zhou , Wei Dai

Transforming into an exact penalty function model with convex compact constraints yields efficient infeasible approaches for optimization problems with orthogonality constraints. For smooth and $\ell_{2,1}$-norm regularized cases, these…

Optimization and Control · Mathematics 2021-10-06 Nachuan Xiao , Xin Liu , Ya-xiang Yuan

We study the Hamiltonian truncation for the two-dimensional $\lambda\phi^4$ theory within the framework of Hamiltonian truncation effective theory, where truncation artifacts are mitigated through a systematic inclusion of corrective terms…

High Energy Physics - Phenomenology · Physics 2026-02-16 Andrea Maestri , Simone Rodini , Barbara Pasquini

We develop a second order primal-dual method for optimization problems in which the objective function is given by the sum of a strongly convex twice differentiable term and a possibly nondifferentiable convex regularizer. After introducing…

Optimization and Control · Mathematics 2020-08-31 Neil K. Dhingra , Sei Zhen Khong , Mihailo R. Jovanović

An algorithm is proposed for solving optimization problems arising in neural network training for supervised learning. The unique feature of the algorithm is the use of an auxiliary loss, in addition to the original loss employed for model…

Optimization and Control · Mathematics 2026-05-11 Yunlang Zhu , Lingjun Guo , Zahra Khatti , Xiaoyi Qu , Chia-Yuan Wu , Lara Zebiane , Frank E. Curtis

A class of second-order algorithms is proposed for minimizing smooth nonconvex functions that alternates between regularized Newton and negative curvature steps in an iteration-dependent subspace. In most cases, the Hessian matrix is…

Optimization and Control · Mathematics 2023-08-22 Serge Gratton , Sadok Jerad , Philippe L. Toint