English
Related papers

Related papers: Nesterov Accelerated ADMM for Fast Diffeomorphic I…

200 papers

Alternating Direction Method of Multipliers (ADMM) has been used successfully in many conventional machine learning applications and is considered to be a useful alternative to Stochastic Gradient Descent (SGD) as a deep learning optimizer.…

Optimization and Control · Mathematics 2021-07-07 Junxiang Wang , Fuxun Yu , Xiang Chen , Liang Zhao

Nesterov's accelerated gradient descent method (AGD) is a seminal deterministic first-order method known to achieve the optimal order of iteration complexity for solving convex smooth optimization problems. Two distinct sequences of…

Optimization and Control · Mathematics 2026-03-10 Yan Wu , Yipeng Zhang , Lu Liu , Yuyuan Ouyang

In this paper, we propose a new stochastic alternating direction method of multipliers (ADMM) algorithm, which incrementally approximates the full gradient in the linearized ADMM formulation. Besides having a low per-iteration complexity as…

Machine Learning · Computer Science 2013-08-19 Leon Wenliang Zhong , James T. Kwok

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

Machine Learning · Computer Science 2020-05-19 Zonghao Huang , Yanmin Gong

Diffusion models (DMs) have shown promising results on single-image super-resolution and other image-to-image translation tasks. Benefiting from more computational resources and longer inference times, they are able to yield more realistic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yuanting Fan , Chengxu Liu , Nengzhong Yin , Changlong Gao , Xueming Qian

Deep Learning in Image Registration (DLIR) methods have been tremendously successful in image registration due to their speed and ability to incorporate weak label supervision at training time. However, existing DLIR methods forego many of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Rohit Jena , Pratik Chaudhari , James C. Gee

Alternating Direction Method of Multipliers (ADMM) is a popular method for solving large-scale Machine Learning problems. Stochastic ADMM was proposed to reduce the per iteration computational complexity, which is more suitable for big data…

Numerical Analysis · Computer Science 2023-04-25 Chao Zhang , Zebang Shen , Hui Qian , Tengfei Zhou , Jianya Zhou , Jianying Zhou

In deep learning, different kinds of deep networks typically need different optimizers, which have to be chosen after multiple trials, making the training process inefficient. To relieve this issue and consistently improve the model…

Machine Learning · Computer Science 2024-12-02 Xingyu Xie , Pan Zhou , Huan Li , Zhouchen Lin , Shuicheng Yan

Purpose: Diffeomorphic image registration is essential in many medical imaging applications. Several registration algorithms of such type have been proposed, but primarily for intra-contrast alignment. Currently, efficient…

Image and Video Processing · Electrical Eng. & Systems 2022-09-14 Nima Masoumi , Hassan Rivaz , M. Omair Ahmad , Yiming Xiao

Nesterov's accelerated gradient descent (AGD), an instance of the general family of "momentum methods", provably achieves faster convergence rate than gradient descent (GD) in the convex setting. However, whether these methods are superior…

Machine Learning · Computer Science 2017-11-29 Chi Jin , Praneeth Netrapalli , Michael I. Jordan

The nonconvex and nonsmooth finite-sum optimization problem with linear constraint has attracted much attention in the fields of artificial intelligence, computer, and mathematics, due to its wide applications in machine learning and the…

Optimization and Control · Mathematics 2023-07-11 Yuxuan Zeng , Zhiguo Wang , Jianchao Bai , Xiaojing Shen

Proximal gradient-based optimization is one of the most common strategies to solve inverse problem of images, and it is easy to implement. However, these techniques often generate heavy artifacts in image reconstruction. One of the most…

Image and Video Processing · Electrical Eng. & Systems 2023-10-13 Xiaohong Fan , Yin Yang , Ke Chen , Yujie Feng , Jianping Zhang

The use of digitally reconstructed radiographs (DRRs) to solve inverse problems such as slice-to-volume registration and 3D reconstruction is well-studied in preoperative settings. In intraoperative imaging, the utility of DRRs is limited…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Vivek Gopalakrishnan , Polina Golland

Blind super-resolution methods based on stable diffusion showcase formidable generative capabilities in reconstructing clear high-resolution images with intricate details from low-resolution inputs. However, their practical applicability is…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Rui Xie , Chen Zhao , Kai Zhang , Zhenyu Zhang , Jun Zhou , Jian Yang , Ying Tai

Ultrasound strain imaging, which delineates mechanical properties to detect tissue abnormalities, involves estimating the time-delay between two radio-frequency (RF) frames collected before and after tissue deformation. The existing…

Image and Video Processing · Electrical Eng. & Systems 2022-09-14 Md Ashikuzzaman , Hassan Rivaz

Real-world image super-resolution (Real-ISR) aims to reconstruct high-resolution images from low-resolution inputs degraded by complex, unknown processes. While many Stable Diffusion (SD)-based Real-ISR methods have achieved remarkable…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Bin Chen , Gehui Li , Rongyuan Wu , Xindong Zhang , Jie Chen , Jian Zhang , Lei Zhang

Diffusion Probabilistic Models (DPMs) have shown remarkable potential in image generation, but their sampling efficiency is hindered by the need for numerous denoising steps. Most existing solutions accelerate the sampling process by…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Guangyi Wang , Yuren Cai , Lijiang Li , Wei Peng , Songzhi Su

In plug-and-play image restoration, the regularization is performed using powerful denoisers such as nonlocal means (NLM) or BM3D. This is done within the framework of alternating direction method of multipliers (ADMM), where the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-21 Unni V. S. , Sanjay Ghosh , Kunal N. Chaudhury

The purpose of this work is to contribute to the state of the art of deep-learning methods for diffeomorphic registration. We propose an adversarial learning LDDMM method for pairs of 3D mono-modal images based on Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Ubaldo Ramon , Monica Hernandez , Elvira Mayordomo

The Alternating Direction Method of Multipliers (ADMM) provides a natural way of solving inverse problems with multiple partial differential equations (PDE) forward models and nonsmooth regularization. ADMM allows splitting these…

Numerical Analysis · Mathematics 2021-04-29 Luke Lozenski , Umberto Villa