English
Related papers

Related papers: Learning Firmly Nonexpansive Operators

200 papers

We in this paper study the nonexpansive operators equipped with arbitrary metric and investigate the connections between firm nonexpansiveness, cocoerciveness and averagedness. The convergence of the associated fixed-point iterations is…

Optimization and Control · Mathematics 2022-10-11 Feng Xue

The proximal point algorithm is a widely used tool for solving a variety of convex optimization problems such as finding zeros of maximally monotone operators, fixed points of nonexpansive mappings, as well as minimizing convex functions.…

Optimization and Control · Mathematics 2018-04-19 Laurentiu Leustean , Adriana Nicolae , Andrei Sipos

The primal--dual hybrid gradient method (PDHGM, also known as the Chambolle--Pock method) has proved very successful for convex optimization problems involving linear operators arising in image processing and inverse problems. In this…

Optimization and Control · Mathematics 2019-04-01 Christian Clason , Stanislav Mazurenko , Tuomo Valkonen

Soft robotic manipulators offer operational advantage due to their compliant and deformable structures. However, their inherently nonlinear dynamics presents substantial challenges. Traditional analytical methods often depend on simplifying…

Robotics · Computer Science 2024-10-28 Uljad Berdica , Matthew Jackson , Niccolò Enrico Veronese , Jakob Foerster , Perla Maiolino

The continuous dynamical system approach to deep learning is explored in order to devise alternative frameworks for training algorithms. Training is recast as a control problem and this allows us to formulate necessary optimality conditions…

Machine Learning · Computer Science 2018-06-05 Qianxiao Li , Long Chen , Cheng Tai , Weinan E

State-space models (SSM) are common in signal processing, where Kalman smoothing (KS) methods are state-of-the-art. However, traditional KS techniques lack expressivity as they do not incorporate spatial prior information. Recently, [1]…

Image and Video Processing · Electrical Eng. & Systems 2026-02-16 Benjamin Hawkes , Mike Davies , Victor Elvira , Audrey Repetti

In this paper we present a novel derivation for an existing node-based algorithm for distributed optimisation termed the primal-dual method of multipliers (PDMM). In contrast to its initial derivation, in this work monotone operator theory…

Optimization and Control · Mathematics 2017-11-07 Thomas Sherson , Richard Heusdens , W. Bastiaan Kleijn

In this paper we describe a systematic procedure to analyze the convergence of degenerate preconditioned proximal point algorithms. We establish weak convergence results under mild assumptions that can be easily employed in the context of…

Optimization and Control · Mathematics 2021-09-24 Kristian Bredies , Enis Chenchene , Dirk A. Lorenz , Emanuele Naldi

This paper proposes a novel approach for learning a data-driven quadratic manifold from high-dimensional data, then employing this quadratic manifold to derive efficient physics-based reduced-order models. The key ingredient of the approach…

Numerical Analysis · Mathematics 2022-12-29 Rudy Geelen , Stephen Wright , Karen Willcox

This paper develops an adaptive proximal alternating direction method of multipliers (ADMM) for solving linearly constrained, composite optimization problems under the assumption that the smooth component of the objective is weakly convex,…

Optimization and Control · Mathematics 2026-05-04 Leandro Farias Maia , David H. Gutman , Renato D. C. Monteiro , Gilson N. Silva

The correspondence between the class of nonexpansive mappings and the class of maximally monotone operators via the reflected resolvents of the latter has played an instrumental role in the convergence analysis of the splitting methods.…

Optimization and Control · Mathematics 2022-05-19 Leon Liu , Walaa M. Moursi , Jon Vanderwerff

In most state-of-the-art image restoration methods, the sum of a data-fidelity and a regularization term is optimized using an iterative algorithm such as ADMM (alternating direction method of multipliers). In recent years, the possibility…

Image and Video Processing · Electrical Eng. & Systems 2020-01-08 Ruturaj G. Gavaskar , Kunal N. Chaudhury

For image recovery problems, plug-and-play (PnP) methods have been developed that replace the proximal step in an optimization algorithm with a call to an application-specific denoiser, often implemented using a deep neural network.…

Information Theory · Computer Science 2022-02-14 Saurav K Shastri , Rizwan Ahmad , Christopher A Metzler , Philip Schniter

In this work we propose an efficient stochastic plug-and-play (PnP) algorithm for imaging inverse problems. The PnP stochastic gradient descent methods have been recently proposed and shown improved performance in some imaging applications…

Optimization and Control · Mathematics 2020-06-24 Junqi Tang , Mike Davies

We study the incremental knapsack problem, where one wishes to sequentially pack items into a knapsack whose capacity expands over a finite planning horizon, with the objective of maximizing time-averaged profits. While various…

Data Structures and Algorithms · Computer Science 2020-10-16 Ali Aouad , Danny Segev

Physics-Informed Neural Networks (PINNs), which incorporate PDEs as soft constraints, train with a composite loss function that contains multiple training point types: different types of collocation points chosen during training to enforce…

Machine Learning · Computer Science 2024-04-15 Gregory Kang Ruey Lau , Apivich Hemachandra , See-Kiong Ng , Bryan Kian Hsiang Low

Nonlinear Parametric Optimization Network (NLPOpt-Net) is an unsupervised learning architecture to solve constrained nonlinear programs (NLP). Given the structure of an NLP, it learns the parametric solution maps with guaranteed constraint…

Machine Learning · Computer Science 2026-05-04 Bimol Nath Roy , Rahul Golder , MM Faruque Hasan

In this paper we propose a primal-dual dynamical approach to the minimization of a structured convex function consisting of a smooth term, a nonsmooth term, and the composition of another nonsmooth term with a linear continuous operator. In…

Optimization and Control · Mathematics 2020-08-03 Radu Ioan Bot , Ernö Robert Csetnek , Szilard Laszlo

In this paper, we aim to accelerate a preconditioned alternating direction method of multipliers (pADMM), whose proximal terms are convex quadratic functions, for solving linearly constrained convex optimization problems. To achieve this,…

Optimization and Control · Mathematics 2024-12-10 Defeng Sun , Yancheng Yuan , Guojun Zhang , Xinyuan Zhao

We introduce the class of $\alpha$-firmly nonexpansive and quasi $\alpha$-firmly nonexpansive operators on $r$-uniformly convex Banach spaces. This extends the existing notion from Hilbert spaces, where $\alpha$-firmly nonexpansive…

Functional Analysis · Mathematics 2025-03-11 Arian Bërdëllima , Gabriele Steidl