English
Related papers

Related papers: Approximation Properties of a Gradient Recovery Op…

200 papers

Recovering high-resolution images from limited sensory data typically leads to a serious ill-posed inverse problem, demanding inversion algorithms that effectively capture the prior information. Learning a good inverse mapping from training…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Morteza Mardani , Qingyun Sun , Shreyas Vasawanala , Vardan Papyan , Hatef Monajemi , John Pauly , David Donoho

Single image super-resolution traditionally assumes spatially-invariant degradation models, yet real-world imaging systems exhibit complex distance-dependent effects including atmospheric scattering, depth-of-field variations, and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Tianhao Guo , Bingjie Lu , Feng Wang , Zhengyang Lu

We consider the problem of minimizing a non-convex function over a smooth manifold $\mathcal{M}$. We propose a novel algorithm, the Orthogonal Directions Constrained Gradient Method (ODCGM) which only requires computing a projection onto a…

Optimization and Control · Mathematics 2023-03-17 Sholom Schechtman , Daniil Tiapkin , Michael Muehlebach , Eric Moulines

In this paper, we propose a probabilistic optimization method, named probabilistic incremental proximal gradient (PIPG) method, by developing a probabilistic interpretation of the incremental proximal gradient algorithm. We explicitly model…

Optimization and Control · Mathematics 2019-06-20 Ömer Deniz Akyildiz , Émilie Chouzenoux , Víctor Elvira , Joaquín Míguez

In this paper, we consider a broad class of nonconvex and nonsmooth optimization problems, where one objective component is a nonsmooth weakly convex function composed with a linear operator. By integrating variable smoothing techniques…

Optimization and Control · Mathematics 2025-11-03 Xian-Jun Long , Kang Zeng , Gao-Xi Li , Minh N. Dao , Zai-Yun Peng

In this manuscript, we analyze the sparse signal recovery (compressive sensing) problem from the perspective of convex optimization by stochastic proximal gradient descent. This view allows us to significantly simplify the recovery analysis…

Data Structures and Algorithms · Computer Science 2013-04-19 Rong Jin , Tianbao Yang , Shenghuo Zhu

Using backpropagation to compute gradients of objective functions for optimization has remained a mainstay of machine learning. Backpropagation, or reverse-mode differentiation, is a special case within the general family of automatic…

Machine Learning · Computer Science 2022-02-18 Atılım Güneş Baydin , Barak A. Pearlmutter , Don Syme , Frank Wood , Philip Torr

The gradient boosting machine is a powerful ensemble-based machine learning method for solving regression problems. However, one of the difficulties of its using is a possible discontinuity of the regression function, which arises when…

Machine Learning · Computer Science 2020-06-22 Andrei V. Konstantinov , Lev V. Utkin

The proximal gradient method is a splitting algorithm for the minimization of the sum of two convex functions, one of which is smooth. It has applications in areas such as mechanics, inverse problems, machine learning, image reconstruction,…

Optimization and Control · Mathematics 2025-05-14 Patrick L. Combettes

We consider a class of statistical inverse problems involving the estimation of a regression operator from a Polish space to a separable Hilbert space, where the target lies in a vector-valued reproducing kernel Hilbert space induced by an…

Machine Learning · Statistics 2026-04-28 Jia-Qi Yang , Lei Shi

This paper expands the Cyclic Block Proximal Gradient method for block separable composite minimization by allowing for inexactly computed gradients and proximal maps. The resultant algorithm, the Inexact Cyclic Block Proximal Gradient…

Optimization and Control · Mathematics 2022-01-05 Leandro Maia , David Huckleberry Gutman , Ryan Christopher Hughes

We consider non-differentiable dynamic optimization problems such as those arising in robotics and subspace tracking. Given the computational constraints and the time-varying nature of the problem, a low-complexity algorithm is desirable,…

Optimization and Control · Mathematics 2019-02-20 Rishabh Dixit , Amrit Singh Bedi , Ruchi Tripathi , Ketan Rajawat

Differentiable rendering aims to compute the derivative of the image rendering function with respect to the rendering parameters. This paper presents a novel algorithm for 6-DoF pose estimation through gradient-based optimization using a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Ramchander Rao Bhaskara , Roshan Thomas Eapen , Manoranjan Majji

In contrast with many other convex optimization classes, state-of-the-art semidefinite programming solvers are yet unable to efficiently solve large scale instances. This work aims to reduce this scalability gap by proposing a novel…

Optimization and Control · Mathematics 2018-12-20 Mario Souto , Joaquim D. Garcia , Alvaro Veiga

When attempting to recover functions from observational data, one naturally seeks to do so in an optimal manner with respect to some modeling assumption. With a focus put on the worst-case setting, this is the standard goal of Optimal…

Optimization and Control · Mathematics 2020-04-02 Mahmood Ettehad , Simon Foucart

A novel recovery-based error indicator for high-order Finite Difference Methods, based on post-processing of the Finite Difference values is presented. The values obtained on the Finite Difference grid are interpolated into a suitable…

Numerical Analysis · Mathematics 2026-01-19 Ferhat Sindy , Annalisa Buffa , Marco Picasso

Interpreting gradient methods as fixed-point iterations, we provide a detailed analysis of those methods for minimizing convex objective functions. Due to their conceptual and algorithmic simplicity, gradient methods are widely used in…

Machine Learning · Statistics 2017-08-16 Alexander Jung

Hamiltonian Operator Inference has been introduced in [Sharma, H., Wang, Z., Kramer, B., Physica D: Nonlinear Phenomena, 431, p.133122, 2022] to learn structure-preserving reduced-order models (ROMs) for Hamiltonian systems. This approach…

Numerical Analysis · Mathematics 2024-05-10 Yuwei Geng , Jasdeep Singh , Lili Ju , Boris Kramer , Zhu Wang

Based on a plane-wave expansion of the observation data in quasi-planar multi-static scattering scenarios, an improved formalism for image creation utilizing back-projection in the spatial domain is derived. The underlying integral…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Matthias M. Saurer , Marius Brinkmann , Han Na , Quanfeng Wang , Thomas Eibert

In this paper we introduce discrete gradient methods to discretize irreversible port-Hamiltonian systems showing that the main qualitative properties of the continuous system are preserved using this kind discretizations methods.

Numerical Analysis · Mathematics 2023-03-15 Alexandre Anahory Simoes , David Martín de Diego , Bernhard Maschke
‹ Prev 1 4 5 6 7 8 10 Next ›