English
Related papers

Related papers: Nesterov Accelerated ADMM for Fast Diffeomorphic I…

200 papers

Deformable image registration and regression are important tasks in medical image analysis. However, they are computationally expensive, especially when analyzing large-scale datasets that contain thousands of images. Hence, cluster…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Zhipeng Ding , Greg Fleishman , Xiao Yang , Paul Thompson , Roland Kwitt , Marc Niethammer

Nesterov's accelerated gradient method (NAG) is widely used in problems with machine learning background including deep learning, and is corresponding to a continuous-time differential equation. From this connection, the property of the…

Optimization and Control · Mathematics 2022-04-05 Yasong Feng , Weiguo Gao

We further develop a new framework, called PDE Acceleration, by applying it to calculus of variations problems defined for general functions on $\mathbb{R}^n$, obtaining efficient numerical algorithms to solve the resulting class of…

Numerical Analysis · Computer Science 2018-10-02 Minas Benyamin , Jeff Calder , Ganesh Sundaramoorthi , Anthony Yezzi

We derive efficient algorithms to compute weakly Pareto optimal solutions for smooth, convex and unconstrained multiobjective optimization problems in general Hilbert spaces. To this end, we define a novel inertial gradient-like dynamical…

Optimization and Control · Mathematics 2022-07-27 Konstantin Sonntag , Sebastian Peitz

We present a fast learning-based algorithm for deformable, pairwise 3D medical image registration. Current registration methods optimize an objective function independently for each pair of images, which can be time-consuming for large…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Guha Balakrishnan , Amy Zhao , Mert R. Sabuncu , John Guttag , Adrian V. Dalca

Score-based diffusion models, while achieving remarkable empirical performance, often suffer from low sampling speed, due to extensive function evaluations needed during the sampling phase. Despite a flurry of recent activities towards…

Machine Learning · Computer Science 2024-03-07 Gen Li , Yu Huang , Timofey Efimov , Yuting Wei , Yuejie Chi , Yuxin Chen

In this paper, we try to uncover the second-order essence of several first-order optimization methods. For Nesterov Accelerated Gradient, we rigorously prove that the algorithm makes use of the difference between past and current gradients,…

Machine Learning · Computer Science 2019-12-23 Yuzheng Hu , Licong Lin , Shange Tang

Registration is an essential tool in image analysis. Deep learning based alternatives have recently become popular, achieving competitive performance at a faster speed. However, many contemporary techniques are limited to volumetric…

Image and Video Processing · Electrical Eng. & Systems 2021-09-29 Balder Croquet , Daan Christiaens , Seth M. Weinberg , Michael Bronstein , Dirk Vandermeulen , Peter Claes

The alternating direction method of multipliers (ADMM) were extensively investigated in the past decades for solving separable convex optimization problems. Fewer researchers focused on exploring its convergence properties for the nonconvex…

Numerical Analysis · Mathematics 2019-07-02 Jianchao Bai , Junli Liang , Ke Guo , Yang Jing

Modern large-scale finite-sum optimization relies on two key aspects: distribution and stochastic updates. For smooth and strongly convex problems, existing decentralized algorithms are slower than modern accelerated variance-reduced…

Optimization and Control · Mathematics 2020-05-22 Hadrien Hendrikx , Francis Bach , Laurent Massoulie

Image registration, the process of aligning two or more images, is the core technique of many (semi-)automatic medical image analysis tasks. Recent studies have shown that deep learning methods, notably convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Bob D. de Vos , Floris F. Berendsen , Max A. Viergever , Hessam Sokooti , Marius Staring , Ivana Isgum

We present a totally asynchronous algorithm for convex optimization that is based on a novel generalization of Nesterov's accelerated gradient method. This algorithm is developed for fast convergence under "total asynchrony," i.e., allowing…

Optimization and Control · Mathematics 2024-06-17 Ellie Pond , April Sebok , Zachary Bell , Matthew Hale

The alternating direction method of multipliers (ADMM) has been widely adopted in low-rank approximation and low-order model identification tasks; however, the performance of nonconvex ADMM is highly reliant on the choice of penalty…

Optimization and Control · Mathematics 2023-09-11 Qingyuan Liu , Zhengchao Huang , Hao Ye , Dexian Huang , Chao Shang

We propose a framework to use Nesterov's accelerated method for constrained convex optimization problems. Our approach consists of first reformulating the original problem as an unconstrained optimization problem using a continuously…

Optimization and Control · Mathematics 2021-03-12 Priyank Srivastava , Jorge Cortes

We propose regularization schemes for deformable registration and efficient algorithms for their numerical approximation. We treat image registration as a variational optimal control problem. The deformation map is parametrized by its…

Optimization and Control · Mathematics 2016-09-09 Andreas Mang , George Biros

Deformable registration consists of finding the best dense correspondence between two different images. Many algorithms have been published, but the clinical application was made difficult by the high calculation time needed to solve the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Théo Estienne , Maria Vakalopoulou , Enzo Battistella , Theophraste Henry , Marvin Lerousseau , Amaury Leroy , Nikos Paragios , Eric Deutsch

Purpose: This study aims to explore training strategies to improve convolutional neural network-based image-to-image deformable registration for abdominal imaging. Methods: Different training strategies, loss functions, and transfer…

Image and Video Processing · Electrical Eng. & Systems 2023-02-28 Javier Pérez de Frutos , André Pedersen , Egidijus Pelanis , David Bouget , Shanmugapriya Survarachakan , Thomas Langø , Ole-Jakob Elle , Frank Lindseth

We consider the problem of rigid registration, where we wish to jointly register multiple point sets via rigid transforms. This arises in applications such as sensor network localization, multiview registration, and protein structure…

Optimization and Control · Mathematics 2019-07-19 Aditya V. Singh , Kunal N. Chaudhury

We introduce a new algorithm to solve a regularized spatial-spectral image estimation problem. Our approach is based on the linearized alternating directions method of multipliers (LADMM), which is a variation of the popular ADMM algorithm.…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Yunsong Liu , Debdut Mandal , Congyu Liao , Kawin Setsompop , Justin P. Haldar

This paper presents a new algorithm, Accelerated Wirtinger Flow (AWF), for ptychographic image reconstruction from phaseless diffraction pattern measurements. AWF is based on combining Nesterov's acceleration approach with Wirtinger…

Image and Video Processing · Electrical Eng. & Systems 2018-06-29 Rui Xu , Mahdi Soltanolkotabi , Justin P. Haldar , Walter Unglaub , Joshua Zusman , Anthony F. J. Levi , Richard M. Leahy