English
Related papers

Related papers: Approximation Properties of a Gradient Recovery Op…

200 papers

In this paper we study proximal conditional-gradient (CG) and proximal gradient-projection type algorithms for a block-structured constrained nonconvex optimization model, which arises naturally from tensor data analysis. First, we…

Optimization and Control · Mathematics 2014-10-16 Bo Jiang , Shuzhong Zhang

Proximal algorithms have gained popularity in recent years in large-scale and distributed optimization problems. One such problem is the phase retrieval problem, for which proximal operators have been proposed recently. The phase retrieval…

Optimization and Control · Mathematics 2018-08-16 Biel Roig-Solvas , Lee Makowski , Dana H. Brooks

This paper proposes a Riemannian Multiobjective Proximal Gradient Method (RMPGM) for composite optimization problems on manifolds. Unlike scalarization-based approaches, the proposed framework directly handles vector-valued objectives and…

Optimization and Control · Mathematics 2026-05-19 Kangming Chen

Many crucial tasks of image processing and computer vision are formulated as inverse problems. Thus, it is of great importance to design fast and robust algorithms to solve these problems. In this paper, we focus on generalized projected…

Image and Video Processing · Electrical Eng. & Systems 2025-12-09 Ali Joundi , Yann Traonmilin , Alasdair Newson

This paper presents an algorithm tailored for the efficient recovery of sparse probability measures incorporating $\ell_0$-sparse regularization within the probability simplex constraint. Employing the Bregman proximal gradient method, our…

Optimization and Control · Mathematics 2024-11-26 Jianting Pan , Ming Yan

This paper considers stochastic optimization problems for a large class of objective functions, including convex and continuous submodular. Stochastic proximal gradient methods have been widely used to solve such problems; however, their…

Optimization and Control · Mathematics 2018-11-13 Aryan Mokhtari , Hamed Hassani , Amin Karbasi

We study the optimal recovery problem for isotropic functions defined by second-order differential operators using both function and gradient values. We derive the upper bound for n-th optimal error with an explicit constant, which is…

Functional Analysis · Mathematics 2025-10-20 Bo Ling , Yi Gu

We present a proximal gradient method for solving convex multiobjective optimization problems, where each objective function is the sum of two convex functions, with one assumed to be continuously differentiable. The algorithm incorporates…

Optimization and Control · Mathematics 2024-04-18 Yunier Bello-Cruz , J. G. Melo , L. F. Prudente , R. V. G. Serra

The low-rank matrix recovery problem often arises in various fields, including signal processing, machine learning, and imaging science. The Riemannian gradient descent (RGD) algorithm has proven to be an efficient algorithm for solving…

Optimization and Control · Mathematics 2023-05-05 Fengmiao Bian , Jian-Feng Cai , Rui Zhang

Cone-beam computed tomography (CBCT) systems, with their flexibility, present a promising avenue for direct point-of-care medical imaging, particularly in critical scenarios such as acute stroke assessment. However, the integration of CBCT…

In this paper, we propose a descent method for composite optimization problems with linear operators. Specifically, we first design a structure-exploiting preconditioner tailored to the linear operator so that the resulting preconditioned…

Optimization and Control · Mathematics 2026-03-20 Jian Chen , Xinmin Yang

In this paper, we consider the composite optimization problem, where the objective function integrates a continuously differentiable loss function with a nonsmooth regularization term. Moreover, only the function values for the…

Optimization and Control · Mathematics 2024-01-09 Shanglin Liu , Lei Wang , Nachuan Xiao , Xin Liu

We design and numerically validate a recovery based linear finite element method for solving the biharmonic equation. The main idea is to replace the gradient operator $\nabla$ on linear finite element space by $G(\nabla)$ in the weak…

Numerical Analysis · Mathematics 2018-06-15 Yunqing Huang , Huayi Wei , Wei Yang , Nianyu Yi

Existing work has linked properties of a function's gradient to the difficulty of function approximation. Motivated by these insights, we study how gradient information can be leveraged to improve neural network's ability to approximate…

Machine Learning · Computer Science 2026-02-11 Yangchen Pan , Qizhen Ying , Philip Torr , Bo Liu

We study approximately orthogonality (in the sense of Dragomir) preserving and reversing operators. We show that for some orthogonality notations, an operator defined from a finite-dimensional Banach space to a normed linear space is…

Functional Analysis · Mathematics 2025-12-11 Divya Khurana

Adaptive optimization algorithms -- such as Adagrad, Adam, and their variants -- have found widespread use in machine learning, signal processing and many other settings. Several methods in this family are not rotationally equivariant,…

Machine Learning · Computer Science 2026-02-17 Adela DePavia , Jose Cruzado , Jiayou Liang , Vasileios Charisopoulos , Rebecca Willett

We consider blind ptychography, an imaging technique which aims to reconstruct an object of interest from a set of its diffraction patterns, each obtained by a local illumination. As the distribution of the light within the illuminated…

Numerical Analysis · Mathematics 2023-06-16 Oleh Melnyk

We address composite optimization problems, which consist in minimizing the sum of a smooth and a merely lower semicontinuous function, without any convexity assumptions. Numerical solutions of these problems can be obtained by proximal…

Optimization and Control · Mathematics 2024-02-14 Alberto De Marchi

Direct optimization is an appealing framework that replaces integration with optimization of a random objective for approximating gradients in models with discrete random variables. A$^\star$ sampling is a framework for optimizing such…

Machine Learning · Computer Science 2020-10-26 Guy Lorberbom , Chris J. Maddison , Nicolas Heess , Tamir Hazan , Daniel Tarlow

We consider perturbation-based extremum seeking, which recovers an approximate gradient of an analytically unknown objective function through measurements. Using classical needle variation analysis, we are able to explicitly quantify the…

Systems and Control · Computer Science 2018-09-13 Stefan Wildhagen , Simon Michalowsky , Jan Feiling , Christian Ebenbauer