English
Related papers

Related papers: A new iterative algorithm for generating gradient …

200 papers

Gradient index (GRIN) acoustic devices have spatially inhomogeneous refractive index profile and allow flexible control of the propagation of acoustic waves. Previous GRIN acoustic lenses are mostly inherently two-dimensional designs that…

Applied Physics · Physics 2018-05-31 Yangbo Xie , Steven A. Cummer

Background: Regarding the importance of right diagnosis in medical applications, various methods have been exploited for processing medical images solar. The method of segmentation is used to analyze anal to miscall structures in medical…

Image and Video Processing · Electrical Eng. & Systems 2019-07-24 Amir Javadpour , Alireza Mohammadi

Binary Neural Networks (BNNs) significantly reduce computational complexity and memory usage in machine and deep learning by representing weights and activations with just one bit. However, most existing training algorithms for BNNs rely on…

Machine Learning · Computer Science 2025-12-08 Luca Colombo , Fabrizio Pittorino , Manuel Roveri

Over the last four decades, the amazing success of deep learning has been driven by the use of Stochastic Gradient Descent (SGD) as the main optimization technique. The default implementation for the computation of the gradient for SGD is…

Neural and Evolutionary Computing · Computer Science 2024-12-31 Qianli Liao , Liu Ziyin , Yulu Gan , Brian Cheung , Mark Harnett , Tomaso Poggio

In this work, we propose a (linearized) Alternating Direction Method-of-Multipliers (ADMM) algorithm for minimizing a convex function subject to a nonconvex constraint. We focus on the special case where such constraint arises from the…

Machine Learning · Computer Science 2019-07-09 Fabian Latorre Gómez , Armin Eftekhari , Volkan Cevher

Gravitational-wave detection strategies are based on a signal analysis technique known as matched filtering. Despite the success of matched filtering, due to its computational cost, there has been recent interest in developing deep…

General Relativity and Quantum Cosmology · Physics 2022-11-03 Dwyer S. Deighan , Scott E. Field , Collin D. Capano , Gaurav Khanna

In this work, we present a hardware compatible neural network training algorithm in which we used alternating direction method of multipliers (ADMM) and iterative least-square methods. The motive behind this approach was to conduct a method…

Machine Learning · Computer Science 2020-09-08 Seyedeh Niusha Alavi Foumani , Ce Guo , Wayne Luk

Stochastic gradient descent (SGD) algorithm and its variations have been effectively used to optimize neural network models. However, with the rapid growth of big data and deep learning, SGD is no longer the most suitable choice due to its…

Machine Learning · Computer Science 2024-02-13 Anuraganand Sharma

Unrolled neural networks have recently achieved state-of-the-art accelerated MRI reconstruction. These networks unroll iterative optimization algorithms by alternating between physics-based consistency and neural-network based…

Image and Video Processing · Electrical Eng. & Systems 2022-07-19 Batu Ozturkler , Arda Sahiner , Tolga Ergen , Arjun D Desai , Christopher M Sandino , Shreyas Vasanawala , John M Pauly , Morteza Mardani , Mert Pilanci

Distributed optimization is fundamental to large-scale machine learning and control applications. Among existing methods, the alternating direction method of multipliers (ADMM) has gained popularity due to its strong convergence guarantees…

Machine Learning · Computer Science 2026-04-15 Henri Doerks , Paul Häusner , Daniel Hernández Escobar , Jens Sjölund

The method 3D polarised light imaging (3D-PLI) measures the birefringence of histological brain sections to determine the spatial course of nerve fibres (myelinated axons). While the in-plane fibre directions can be determined with high…

Biological Physics · Physics 2022-04-12 Miriam Menzel , Jan A. Reuter , David Gräßel , Irene Costantini , Katrin Amunts , Markus Axer

We present a novel method for estimation of the fiber orientation distribution (FOD) function based on diffusion-weighted Magnetic Resonance Imaging (D-MRI) data. We formulate the problem of FOD estimation as a regression problem through…

Applications · Statistics 2016-12-23 Hao Yan , Owen Carmichael , Debashis Paul , Jie Peng

We present Re-weighted Gradient Descent (RGD), a novel optimization technique that improves the performance of deep neural networks through dynamic sample re-weighting. Leveraging insights from distributionally robust optimization (DRO)…

Machine Learning · Computer Science 2024-10-15 Ramnath Kumar , Kushal Majmundar , Dheeraj Nagaraj , Arun Sai Suggala

Deep neural networks (DNN) are typically optimized using stochastic gradient descent (SGD). However, the estimation of the gradient using stochastic samples tends to be noisy and unreliable, resulting in large gradient variance and bad…

Machine Learning · Computer Science 2021-05-18 Xingyi Yang

Diffusion weighted MRI (dMRI) provides a non invasive virtual reconstruction of the brain's white matter structures through tractography. Analyzing dMRI measures along the trajectory of white matter bundles can provide a more specific…

Quantitative Methods · Quantitative Biology 2019-06-21 Samuel St-Jean , Maxime Chamberland , Max A. Viergever , Alexander Leemans

We propose a stochastic optimization method for minimizing loss functions, expressed as an expected value, that adaptively controls the batch size used in the computation of gradient approximations and the step size used to move along such…

Machine Learning · Computer Science 2020-03-04 Achraf Bahamou , Donald Goldfarb

Image segmentation is the process of partitioning the image into significant regions easier to analyze. Nowadays, segmentation has become a necessity in many practical medical imaging methods as locating tumors and diseases. Hidden Markov…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 EL-Hachemi Guerrout , Samy Ait-Aoudia , Dominique Michelucci , Ramdane Mahiou

Automatic neonatal brain tissue segmentation in preterm born infants is a prerequisite for evaluation of brain development. However, automatic segmentation is often hampered by motion artifacts caused by infant head movements during image…

Image and Video Processing · Electrical Eng. & Systems 2019-06-12 N. Khalili , E. Turk , M. Zreik , M. A. Viergever , M. J. N. L. Benders , I. Isgum

Algebraic Multigrid (AMG) methods are state-of-the-art algebraic solvers for partial differential equations. Still, their efficiency depends heavily on the choice of suitable parameters and/or ingredients. Paradigmatic examples include the…

Numerical Analysis · Mathematics 2026-01-01 Paola F. Antonietti , Matteo Caldana , Lorenzo Gentile , Marco Verani

Recent research highlights that the Directed Accumulator (DA), through its parametrization of geometric priors into neural networks, has notably improved the performance of medical image recognition, particularly with small and imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Hang Zhang , Renjiu Hu , Xiang Chen , Rongguang Wang , Jinwei Zhang , Jiahao Li