English
Related papers

Related papers: GS-EMA: Integrating Gradient Surgery Exponential M…

200 papers

Stochastic optimization plays a crucial role in the advancement of deep learning technologies. Over the decades, significant effort has been dedicated to improving the training efficiency and robustness of deep neural networks, via various…

Machine Learning · Computer Science 2024-08-21 Huixiu Jiang , Ling Yang , Yu Bao , Rutong Si , Sikun Yang

Many popular adaptive gradient methods such as Adam and RMSProp rely on an exponential moving average (EMA) to normalize their stepsizes. While the EMA makes these methods highly responsive to new gradient information, recent research has…

Machine Learning · Computer Science 2021-10-13 Brett Daley , Christopher Amato

The deep learning technique has been shown to be effectively addressed several image analysis tasks in the computer-aided diagnosis scheme for mammography. The training of an efficacious deep learning model requires large data with diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Zheren Li , Zhiming Cui , Lichi Zhang , Sheng Wang , Chenjin Lei , Xi Ouyang , Dongdong Chen , Xiangyu Zhao , Yajia Gu , Zaiyi Liu , Chunling Liu , Dinggang Shen , Jie-Zhi Cheng

Radiologists use various imaging modalities to aid in different tasks like diagnosis of disease, lesion visualization, surgical planning and prognostic evaluation. Most of these tasks rely on the the accurate delineation of the anatomical…

Image and Video Processing · Electrical Eng. & Systems 2019-08-22 Ronnie Rajan , Rachana Sathish , Debdoot Sheet

Accurate segmentation of brain tumors from multi-modal Magnetic Resonance (MR) images is essential in brain tumor diagnosis and treatment. However, due to the existence of domain shifts among different modalities, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Kelei He , Wen Ji , Tao Zhou , Zhuoyuan Li , Jing Huo , Xin Zhang , Yang Gao , Dinggang Shen , Bing Zhang , Junfeng Zhang

The multi-task learning ($MTL$) paradigm aims to simultaneously learn multiple tasks within a single model capturing higher-level, more general hidden patterns that are shared by the tasks. In deep learning, a significant challenge in the…

Machine Learning · Computer Science 2025-06-09 Thomas Borsani , Andrea Rosani , Giuseppe Nicosia , Giuseppe Di Fatta

Digitization techniques for biomedical images yield different visual patterns in radiological exams. These differences may hamper the use of data-driven approaches for inference over these images, such as Deep Neural Networks. Another…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Hugo Oliveira , Edemir Ferreira , Jefersson A. dos Santos

Deep learning-based medical image segmentation is increasingly used to support clinical diagnosis and develop new treatment strategies. However, model performance remains limited by the scarcity of high-quality annotated data and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Nathan Molinier , Hendrik Möller , Thomas Dagonneau , Anna Curto-Vilalta , Robert Graf , Matan Atad , Daniel Rueckert , Jan S. Kirschke , Julien Cohen-Adad

Accurate identification and quantification of unruptured intracranial aneurysms (UIAs) is crucial for the risk assessment and treatment of this cerebrovascular disorder. Current 2D manual assessment on 3D magnetic resonance angiography…

Image and Video Processing · Electrical Eng. & Systems 2024-03-21 Amirhossein Rasoulian , Arash Harirpoush , Soorena Salari , Yiming Xiao

Magnetic resonance imaging (MRI) is commonly used for brain tumor segmentation, which is critical for patient evaluation and treatment planning. To reduce the labor and expertise required for labeling, weakly-supervised semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yu-Jen Chen , Xinrong Hu , Yiyu Shi , Tsung-Yi Ho

Cine cardiac magnetic resonance (CMR) has become the gold standard for the non-invasive evaluation of cardiac function. In particular, it allows the accurate quantification of functional parameters including the chamber volumes and ejection…

Image and Video Processing · Electrical Eng. & Systems 2020-08-28 Cian M. Scannell , Amedeo Chiribiri , Mitko Veta

Developing a deep learning method for medical segmentation tasks heavily relies on a large amount of labeled data. However, the annotations require professional knowledge and are limited in number. Recently, semi-supervised learning has…

Image and Video Processing · Electrical Eng. & Systems 2023-12-05 Wanqin Ma , Huifeng Yao , Yiqun Lin , Jiarong Guo , Xiaomeng Li

Due to the cross-domain distribution shift aroused from diverse medical imaging systems, many deep learning segmentation methods fail to perform well on unseen data, which limits their real-world applicability. Recent works have shown the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Shangqi Gao , Hangqi Zhou , Yibo Gao , Xiahai Zhuang

This paper introduces a novel family of generalized exponentiated gradient (EG) updates derived from an Alpha-Beta divergence regularization function. Collectively referred to as EGAB, the proposed updates belong to the category of…

Machine Learning · Computer Science 2024-12-30 Andrzej Cichocki , Sergio Cruces , Auxiliadora Sarmiento , Toshihisa Tanaka

Despite recent improvements in medical image segmentation, the ability to generalize across imaging contrasts remains an open issue. To tackle this challenge, we implement Feature-wise Linear Modulation (FiLM) to leverage physics knowledge…

Image and Video Processing · Electrical Eng. & Systems 2020-06-05 Olivier Vincent , Charley Gros , Joseph Paul Cohen , Julien Cohen-Adad

We present a method combining affinity prediction with region agglomeration, which improves significantly upon the state of the art of neuron segmentation from electron microscopy (EM) in accuracy and scalability. Our method consists of a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Jan Funke , Fabian David Tschopp , William Grisaitis , Arlo Sheridan , Chandan Singh , Stephan Saalfeld , Srinivas C. Turaga

Ankle exoskeletons have garnered considerable interest for their potential to enhance mobility and reduce fall risks, particularly among the aging population. The efficacy of these devices relies on accurate real-time prediction of the…

Systems and Control · Electrical Eng. & Systems 2024-11-26 Silas Ruhrberg Estévez , Josée Mallah , Dominika Kazieczko , Chenyu Tang , Luigi G. Occhipinti

Unrolled neural networks have recently achieved state-of-the-art accelerated MRI reconstruction. These networks unroll iterative optimization algorithms by alternating between physics-based consistency and neural-network based…

Image and Video Processing · Electrical Eng. & Systems 2022-07-19 Batu Ozturkler , Arda Sahiner , Tolga Ergen , Arjun D Desai , Christopher M Sandino , Shreyas Vasanawala , John M Pauly , Morteza Mardani , Mert Pilanci

Segmentation is one of the most important tasks in the medical imaging pipeline as it influences a number of image-based decisions. To be effective, fully supervised segmentation approaches require large amounts of manually annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Tyler Ward , Aaron Moseley , Abdullah-Al-Zubaer Imran

According to the 2021 World Health Organization (WHO) Classification scheme for gliomas, glioma segmentation is a very important basis for diagnosis and genotype prediction. In general, 3D multimodal brain MRI is an effective diagnostic…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Xiaoyu Shi , Shurong Chai , Yinhao Li , Jingliang Cheng , Jie Bai , Guohua Zhao , Yen-Wei Chen