English
Related papers

Related papers: A new iterative algorithm for generating gradient …

200 papers

Magnetic Resonance Imaging (MRI) is a powerful medical imaging modality, but unfortunately suffers from long scan times which, aside from increasing operational costs, can lead to image artifacts due to patient motion. Motion during the…

Image and Video Processing · Electrical Eng. & Systems 2023-10-02 Brett Levac , Sidharth Kumar , Ajil Jalal , Jonathan I. Tamir

In-vivo examination of the physical connectivity of axonal projections through the white matter of the human brain is made possible by diffusion weighted magnetic resonance imaging (dMRI) Analysis of dMRI commonly considers derived scalar…

Image and Video Processing · Electrical Eng. & Systems 2019-12-03 Haraldur T. Hallgrimsson , Richika Sharan , Scott T. Grafton , Ambuj K. Singh

In deep learning, stochastic gradient descent (SGD) and its momentum-based variants are widely used for optimization. However, the internal dynamics of these methods remain underexplored. In this paper, we analyze gradient behavior through…

Machine Learning · Computer Science 2025-03-11 Zhipeng Yao , Rui Yu , Guisong Chang , Ying Li , Yu Zhang , Dazhou Li

We propose a new technique that boosts the convergence of training generative adversarial networks. Generally, the rate of training deep models reduces severely after multiple iterations. A key reason for this phenomenon is that a deep…

Machine Learning · Statistics 2018-06-15 Atsushi Nitanda , Taiji Suzuki

Medical images used in clinical practice are heterogeneous and not the same quality as scans studied in academic research. Preprocessing breaks down in extreme cases when anatomy, artifacts, or imaging parameters are unusual or protocols…

Image and Video Processing · Electrical Eng. & Systems 2022-08-31 Mostafa Mehdipour Ghazi , Mads Nielsen

Accurately modeling longitudinal brain MRI progression is crucial for understanding neurodegenerative diseases and predicting individualized structural changes. Existing state-of-the-art approaches, such as Brain Latent Progression (BrLP),…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Cheng Wan , Bahram Jafrasteh , Ehsan Adeli , Miaomiao Zhang , Qingyu Zhao

This paper proposed a retinal image segmentation method based on conditional Generative Adversarial Network (cGAN) to segment optic disc. The proposed model consists of two successive networks: generator and discriminator. The generator…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Vivek Kumar Singh , Hatem Rashwan , Farhan Akram , Nidhi Pandey , Md. Mostaf Kamal Sarker , Adel Saleh , Saddam Abdulwahab , Najlaa Maaroof , Santiago Romani , Domenec Puig

We propose a new variant of AMSGrad, a popular adaptive gradient based optimization algorithm widely used for training deep neural networks. Our algorithm adds prior knowledge about the sequence of consecutive mini-batch gradients and…

Machine Learning · Statistics 2020-11-04 Jun-Kun Wang , Xiaoyun Li , Belhal Karimi , Ping Li

Standard gradient-based iteration algorithms for optimization, such as gradient descent and its various proximal-based extensions to nonsmooth problems, are known to converge slowly for ill-conditioned problems, sometimes requiring many…

Numerical Analysis · Mathematics 2026-03-24 G. H. M. Araújo , O. A. Krzysik , H. De Sterck

We consider the inverse problem of estimating the spatially varying pulse wave velocity in blood vessels in the brain from dynamic MRI data, as it appears in the recently proposed imaging technique of Magnetic Resonance Advection Imaging…

Numerical Analysis · Mathematics 2020-01-13 Simon Hubmer , Andreas Neubauer , Ronny Ramlau , Henning U. Voss

Undirected graphical models are powerful tools for uncovering complex relationships among high-dimensional variables. This paper aims to fully recover the structure of an undirected graphical model when the data naturally take matrix form,…

Methodology · Statistics 2025-08-08 Minsub Shin , Johan Lim , Seongoh Park

Even for the gradient descent (GD) method applied to neural network training, understanding its optimization dynamics, including convergence rate, iterate trajectories, function value oscillations, and especially its implicit acceleration,…

Machine Learning · Computer Science 2026-05-22 Alexander Tyurin

Attribution algorithms are frequently employed to explain the decisions of neural network models. Integrated Gradients (IG) is an influential attribution method due to its strong axiomatic foundation. The algorithm is based on integrating…

Machine Learning · Computer Science 2023-12-19 Chase Walker , Sumit Jha , Kenny Chen , Rickard Ewetz

Diffusion-weighted magnetic resonance imaging (DW-MRI) allows for non-invasive imaging of the local fiber architecture of the human brain at a millimetric scale. Multiple classical approaches have been proposed to detect both single (e.g.,…

Sparse inverse covariance estimation (i.e., edge de-tection) is an important research problem in recent years, wherethe goal is to discover the direct connections between a set ofnodes in a networked system based upon the observed…

Machine Learning · Computer Science 2021-01-15 Hang Yin , Xinyue Liu , Xiangnan Kong

The techniques of data-driven backmapping from coarse-grained (CG) to fine-grained (FG) representation often struggle with accuracy, unstable training, and physical realism, especially when applied to complex systems such as proteins. In…

Machine Learning · Computer Science 2025-05-26 Georgios Kementzidis , Erin Wong , John Nicholson , Ruichen Xu , Yuefan Deng

Alternating Direction Method of Multipliers (ADMM) has been used successfully in many conventional machine learning applications and is considered to be a useful alternative to Stochastic Gradient Descent (SGD) as a deep learning optimizer.…

Optimization and Control · Mathematics 2021-07-07 Junxiang Wang , Fuxun Yu , Xiang Chen , Liang Zhao

Analog neuromorphic computing systems emulate the parallelism and connectivity of the human brain, promising greater expressivity and energy efficiency compared to digital systems. Though many devices have emerged as candidates for…

Mesoscale and Nanoscale Physics · Physics 2023-10-05 Samuel Liu , Deji Akinwande , Dmitry Kireev , Jean Anne C. Incorvia

Several brain disorders can be detected by observing alterations in the brain's structural and functional connectivities. Neurological findings suggest that early diagnosis of brain disorders, such as mild cognitive impairment (MCI), can…

Neurons and Cognition · Quantitative Biology 2021-10-22 Alpay Tekin , Ahmed Nebli , Islem Rekik

In this paper, we aim to develop an efficient and compact deep network for RGB-D salient object detection, where the depth image provides complementary information to boost performance in complex scenarios. Starting from a coarse initial…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Shuhan Chen , Yun Fu