English
Related papers

Related papers: Yau's Affine Normal Descent: Algorithmic Framework…

200 papers

We propose a new approach to solving bilevel optimization problems, intermediate between solving full-system optimality conditions with a Newton-type approach, and treating the inner problem as an implicit function. The overall idea is to…

Optimization and Control · Mathematics 2024-05-08 Ensio Suonperä , Tuomo Valkonen

We propose a descent subgradient algorithm for unconstrained nonsmooth nonconvex multiobjective optimization problems. To find a descent direction, we present an iterative process that efficiently approximates the Goldstein subdifferential…

Optimization and Control · Mathematics 2024-06-24 Morteza Maleknia , Majid Soleimani-damaneh

We consider several classes of highly important semidefinite optimization problems that involve both a convex objective function (smooth or nonsmooth) and additional linear or nonlinear smooth and convex constraints, which are ubiquitous in…

Optimization and Control · Mathematics 2025-04-08 Dan Garber , Atara Kaplan

Adaptive gradient methods such as AdaGrad and its variants update the stepsize in stochastic gradient descent on the fly according to the gradients received along the way; such methods have gained widespread use in large-scale optimization…

Machine Learning · Statistics 2021-04-20 Rachel Ward , Xiaoxia Wu , Leon Bottou

We introduce an adjoint-based aerodynamic shape optimization framework that integrates a diffusion model trained on existing designs to learn a smooth manifold of aerodynamically viable shapes. This manifold is enforced as an equality…

Computational Engineering, Finance, and Science · Computer Science 2025-08-01 Long Chen , Emre Oezkaya , Jan Rottmayer , Nicolas R. Gauger , Zebang Shen , Yinyu Ye

Affine correspondences have received significant attention due to their benefits in tasks like image matching and pose estimation. Existing methods for extracting affine correspondences still have many limitations in terms of performance;…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Pengju Sun , Banglei Guan , Zhenbao Yu , Yang Shang , Qifeng Yu , Daniel Barath

We propose an extension of a special form of gradient descent -- in the literature known as linearised Bregman iteration -- to a larger class of non-convex functions. We replace the classical (squared) two norm metric in the gradient…

Optimization and Control · Mathematics 2021-05-26 Martin Benning , Marta M. Betcke , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb

We introduce a new family of affine metrics on a locally strictly convex surface $M$ in affine 4-space. Then, we define the symmetric and antisymmetric equiaffine planes associated with each metric. We show that if $M$ is immersed in a…

Differential Geometry · Mathematics 2014-04-11 Juan J. Nuño Ballesteros , Luis Sánchez

In this paper, a globally convergent Newton-type proximal gradient method is developed for composite multi-objective optimization problems where each objective function can be represented as the sum of a smooth function and a nonsmooth…

Optimization and Control · Mathematics 2024-10-25 Md Abu Talhamainuddin Ansary

Natural Gradient Descent (NGD) is a second-order neural network training that preconditions the gradient descent with the inverse of the Fisher Information Matrix (FIM). Although NGD provides an efficient preconditioner, it is not…

Machine Learning · Computer Science 2022-10-12 Tran Van Sang , Mhd Irvan , Rie Shigetomi Yamaguchi , Toshiyuki Nakata

We consider the problem of unconstrained minimization of a smooth function in the derivative-free setting using. In particular, we propose and study a simplified variant of the direct search method (of direction type), which we call…

Optimization and Control · Mathematics 2014-11-14 Jakub Konečný , Peter Richtárik

A functional for joint variational object segmentation and shape matching is developed. The formulation is based on optimal transport w.r.t. geometric distance and local feature similarity. Geometric invariance and modelling of…

Computer Vision and Pattern Recognition · Computer Science 2014-12-30 Bernhard Schmitzer , Christoph Schnörr

Mesh denoising is a critical technology in geometry processing that aims to recover high-fidelity 3D mesh models of objects from their noise-corrupted versions. In this work, we propose a learning-based normal filtering scheme for mesh…

Graphics · Computer Science 2019-11-15 Wenbo Zhao , Xianming Liu , Yongsen Zhao , Xiaopeng Fan , Debin Zhao

Conformal symmetries, i.e.\ coordinate transformations that preserve angles, play a key role in many fields, including physics, mathematics, computer vision and (geometric) machine learning. Here we build a neural network that is…

Machine Learning · Computer Science 2025-05-20 Maksim Zhdanov , Nabil Iqbal , Erik Bekkers , Patrick Forré

In this study, a new Anomaly Detection (AD) approach for industrial and medical images is proposed. This method leverages the theoretical strengths of unsupervised learning and the data availability of both normal and abnormal classes.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Arnaud Bougaham , Valentin Delchevalerie , Mohammed El Adoui , Benoît Frénay

Here is an English summary of the abstract: This research investigates a geometric dynamical mechanism within a specific class of domains that contain a fixed convex core. By using a radial structure that links the boundaries of the core…

Dynamical Systems · Mathematics 2026-05-13 Mohammed Barkatou , Mohamed El Morsalani

In this paper, we consider the problem of minimizing the sum of two convex functions subject to linear linking constraints. The classical alternating direction type methods usually assume that the two convex functions have relatively easy…

Optimization and Control · Mathematics 2015-07-10 Tianyi Lin , Shiqian Ma , Shuzhong Zhang

Line-search methods are commonly used to solve optimization problems. The simplest line search method is steepest descent where one always moves in the direction of the negative gradient. Newton's method on the other hand is a second-order…

Optimization and Control · Mathematics 2025-08-15 Shikhar Saxena , Tejas Bodas , Arti Yardi

Sign-based optimization methods have become popular in machine learning due to their favorable communication cost in distributed optimization and their surprisingly good performance in neural network training. Furthermore, they are closely…

Machine Learning · Computer Science 2020-02-20 Lukas Balles , Fabian Pedregosa , Nicolas Le Roux

Adaptive gradient methods, such as AdaGrad, have become fundamental tools in deep learning. Despite their widespread use, the asymptotic convergence of AdaGrad remains poorly understood in non-convex scenarios. In this work, we present the…

Optimization and Control · Mathematics 2026-01-06 Ruinan Jin , Xiaoyu Wang