English
Related papers

Related papers: Extended convergence analysis of the Scholtes-type…

200 papers

Developments in numerical methods for problems governed by nonlinear partial differential equations underpin simulations with sound arguments in diverse areas of science and engineering. In this paper, we explore the regularization method…

Analysis of PDEs · Mathematics 2020-09-29 Vo Anh Khoa , Mai Thanh Nhat Truong , Nguyen Ho Minh Duy , Nguyen Huy Tuan

Employing two distinct types of regularization terms, we propose two regularized extragradient methods for solving equilibrium problems on Hadamard manifolds. The sequences generated by these extragradient algorithms converge to a solution…

Optimization and Control · Mathematics 2026-01-06 Shikher Sharmaa , Pankaj Gautam , Simeon Reich

We study the Tikhonov regularization for ill-posed non-linear operator equations in Hilbert scales. Our focus is on the interplay between the smoothness-promoting properties of the penalty and the smoothness inherent in the solution. The…

Numerical Analysis · Mathematics 2018-01-17 Bernd Hofmann , Peter Mathé

Matrix-valued optimization tasks, including those involving symmetric positive definite (SPD) matrices, arise in a wide range of applications in machine learning, data science and statistics. Classically, such problems are solved via…

Optimization and Control · Mathematics 2024-10-15 Andrew Cheng , Melanie Weber

The scalable adaptive cubic regularization method ($\mathrm{ARC_{q}K}$: Dussault et al. in Math. Program. Ser. A 207(1-2): 191-225, 2024) has been recently proposed for unconstrained optimization. It has excellent convergence properties,…

Optimization and Control · Mathematics 2026-03-17 Yonggang Pei , Yubing Lin , Shuai Shao , Mauricio Silva Louzeiro , Detong Zhu

In this paper, we present a unified analysis of methods for such a wide class of problems as variational inequalities, which includes minimization problems and saddle point problems. We develop our analysis on the modified Extra-Gradient…

Optimization and Control · Mathematics 2023-04-18 Aleksandr Beznosikov , Alexander Gasnikov , Karina Zainulina , Alexander Maslovskiy , Dmitry Pasechnyuk

This paper provides a new regularization method which is particularly suitable for linear exponentially ill-posed problems. Under logarithmic source conditions (which have a natural interpretation in terms of Sobolev spaces in the…

Numerical Analysis · Mathematics 2020-07-08 Walter Cedric Simo Tao Lee

We introduce a novel formulation for curvature regularization by penalizing normal curvatures from multiple directions. This total normal curvature regularization is capable of producing solutions with sharp edges and precise isotropic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Tianle Lu , Ke Chen , Yuping Duan

This paper pursues a two-fold goal. Firstly, we aim to derive novel second-order characterizations of important robust stability properties of perturbed Karush-Kuhn-Tucker systems for a broadclass of constrained optimization problems…

Optimization and Control · Mathematics 2020-04-15 Ashkan Mohammadi , Boris Mordukhovich , Ebrahim Sarabi

In this paper, we consider the asymptotical regularization with convex constraints for nonlinear ill-posed problems. The method allows to use non-smooth penalty terms, including the L1-like and the total variation-like penalty functionals,…

Numerical Analysis · Mathematics 2022-03-23 Min Zhong , Wei Wang

Stochastic composition optimization draws much attention recently and has been successful in many emerging applications of machine learning, statistical analysis, and reinforcement learning. In this paper, we focus on the composition…

Machine Learning · Computer Science 2018-01-01 Zhouyuan Huo , Bin Gu , Ji Liu , Heng Huang

We construct a series of classic vorticity solutions for incompressible Euler equation on $\mathbb S^2$, which constitute the $C^1$ type regularization for a general traveling point vortex system. The construction is accomplished by…

Analysis of PDEs · Mathematics 2024-11-26 Takashi Sakajo , Changjun Zou

We analyze the performance of a variant of Newton method with quadratic regularization for solving composite convex minimization problems. At each step of our method, we choose regularization parameter proportional to a certain power of the…

Optimization and Control · Mathematics 2022-08-12 Nikita Doikov , Konstantin Mishchenko , Yurii Nesterov

We analyze continuous optimal transport problems in the so-called Kantorovich form, where we seek a transport plan between two marginals that are probability measures on compact subsets of Euclidean space. We consider the case of…

Optimization and Control · Mathematics 2020-10-28 Christian Clason , Dirk A. Lorenz , Hinrich Mahler , Benedikt Wirth

In this article, we propose and study a stochastic and relaxed preconditioned Douglas--Rachford splitting method to solve saddle-point problems that have separable dual variables. We prove the almost sure convergence of the iteration…

Optimization and Control · Mathematics 2024-10-01 Yakun Dong , Kristian Bredies , Hongpeng Sun

We present successive convexification, a real-time-capable solution method for nonconvex trajectory optimization, with continuous-time constraint satisfaction and guaranteed convergence, that only requires first-order information. The…

Optimization and Control · Mathematics 2024-04-26 Purnanand Elango , Dayou Luo , Abhinav G. Kamath , Samet Uzun , Taewan Kim , Behçet Açıkmeşe

The graduated optimization approach, also known as the continuation method, is a popular heuristic to solving non-convex problems that has received renewed interest over the last decade. Despite its popularity, very little is known in terms…

Machine Learning · Computer Science 2015-07-28 Elad Hazan , Kfir Y. Levy , Shai Shalev-Shwartz

Variational regularisation is the primary method for solving inverse problems, and recently there has been considerable work leveraging deeply learned regularisation for enhanced performance. However, few results exist addressing the…

Optimization and Control · Mathematics 2024-06-18 Zakhar Shumaylov , Jeremy Budd , Subhadip Mukherjee , Carola-Bibiane Schönlieb

Tikhonov regularization is one of the most commonly used methods of regularization of ill-posed problems. In the setting of finite element solutions of elliptic partial differential control problems, Tikhonov regularization amounts to…

Numerical Analysis · Mathematics 2016-09-19 Erik Burman , Peter Hansbo , Mats Larson

In this paper, we consider a class of non-convex and non-smooth sparse optimization problems, which encompass most existing nonconvex sparsity-inducing terms. We show the second-order optimality conditions only depend on the nonzeros of the…

Optimization and Control · Mathematics 2024-12-13 Luwei Bai , Yaohua Hu , Hao Wang , Xiaoqi Yang