English
Related papers

Related papers: A Learnable Variational Model for Joint Multimodal…

200 papers

Multimodal Magnetic Resonance (MR) Imaging plays a crucial role in disease diagnosis due to its ability to provide complementary information by analyzing a relationship between multimodal images on the same subject. Acquiring all MR…

Image and Video Processing · Electrical Eng. & Systems 2024-02-02 Jihoon Cho , Xiaofeng Liu , Fangxu Xing , Jinsong Ouyang , Georges El Fakhri , Jinah Park , Jonghye Woo

Positron Emission Tomography and Magnetic Resonance Imaging (PET-MRI) systems can obtain functional and anatomical scans. PET suffers from a low signal-to-noise ratio. Meanwhile, the k-space data acquisition process in MRI is…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Taofeng Xie , Zhuo-Xu Cui , Chen Luo , Huayu Wang , Congcong Liu , Yuanzhi Zhang , Xuemei Wang , Yanjie Zhu , Guoqing Chen , Dong Liang , Qiyu Jin , Yihang Zhou , Haifeng Wang

We develop a novel transfer learning framework to tackle the challenge of limited training data in image reconstruction problems. The proposed framework consists of two training steps, both of which are formed as bi-level optimizations. In…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yunmei Chen , Chi Ding , Xiaojing Ye

Acquiring images of the same anatomy with multiple different contrasts increases the diversity of diagnostic information available in an MR exam. Yet, scan time limitations may prohibit acquisition of certain contrasts, and images for some…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Salman Ul Hassan Dar , Mahmut Yurt , Levent Karacan , Aykut Erdem , Erkut Erdem , Tolga Çukur

Magnetic resonance imaging (MRI) reconstruction is an active inverse problem which can be addressed by conventional compressed sensing (CS) MRI algorithms that exploit the sparse nature of MRI in an iterative optimization-based manner.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Yuxiang Dai , Peixian Zhuang

High spatiotemporal resolution dynamic magnetic resonance imaging (MRI) is a powerful clinical tool for imaging moving structures as well as to reveal and quantify other physical and physiological dynamics. The low speed of MRI necessitates…

Image and Video Processing · Electrical Eng. & Systems 2019-10-14 Yuhua Chen , Jaime L. Shaw , Yibin Xie , Debiao Li , Anthony G. Christodoulou

To overcome the imbalanced multimodal learning problem, where models prefer the training of specific modalities, existing methods propose to control the training of uni-modal encoders from different perspectives, taking the inter-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yake Wei , Siwei Li , Ruoxuan Feng , Di Hu

Deep learning-based methods have achieved encouraging performances in the field of magnetic resonance (MR) image reconstruction. Nevertheless, to properly learn a powerful and robust model, these methods generally require large quantities…

Image and Video Processing · Electrical Eng. & Systems 2023-04-18 Ruoyou Wu , Cheng Li , Juan Zou , Qiegen Liu , Hairong Zheng , Shanshan Wang

In the area of magnetic resonance imaging (MRI), an extensive range of non-linear reconstruction algorithms have been proposed that can be used with general Fourier subsampling patterns. However, the design of these subsampling patterns has…

Image and Video Processing · Electrical Eng. & Systems 2018-05-04 Baran Gözcü , Rabeeh Karimi Mahabadi , Yen-Huan Li , Efe Ilıcak , Tolga Çukur , Jonathan Scarlett , Volkan Cevher

Magnetic Resonance Imaging (MRI) is a powerful medical imaging modality, but unfortunately suffers from long scan times which, aside from increasing operational costs, can lead to image artifacts due to patient motion. Motion during the…

Image and Video Processing · Electrical Eng. & Systems 2023-10-02 Brett Levac , Sidharth Kumar , Ajil Jalal , Jonathan I. Tamir

This work focuses on learning useful and robust deep world models using multiple, possibly unreliable, sensors. We find that current methods do not sufficiently encourage a shared representation between modalities; this can cause poor…

Machine Learning · Computer Science 2021-07-07 Kaiqi Chen , Yong Lee , Harold Soh

Multi-modal Magnetic Resonance Imaging (MRI) translation leverages information from source MRI sequences to generate target modalities, enabling comprehensive diagnosis while overcoming the limitations of acquiring all sequences. While…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Jiyao Liu , Shangqi Gao , Yuxin Li , Lihao Liu , Xin Gao , Zhaohu Xing , Junzhi Ning , Yanzhou Su , Xiao-Yong Zhang , Junjun He , Ningsheng Xu , Xiahai Zhuang

Retinal diseases spanning a broad spectrum can be effectively identified and diagnosed using complementary signals from multimodal data. However, multimodal diagnosis in ophthalmic practice is typically challenged in terms of data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Lu Zhang , Huizhen Yu , Zuowei Wang , Fu Gui , Yatu Guo , Wei Zhang , Mengyu Jia

Magnetic Resonance Imaging (MRI) scans are time consuming and precarious, since the patients remain still in a confined space for extended periods of time. To reduce scanning time, some experts have experimented with undersampled k spaces,…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Kyler Larsen , Arghya Pal , Yogesh Rathi

Magnetic resonance imaging has been widely applied in clinical diagnosis, however, is limited by its long data acquisition time. Although imaging can be accelerated by sparse sampling and parallel imaging, achieving promising reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 Tieyuan Lu , Xinlin Zhang , Yihui Huang , Yonggui Yang , Gang Guo , Lijun Bao , Feng Huang , Di Guo , Xiaobo Qu

Data-driven approaches recently achieved remarkable success in magnetic resonance imaging (MRI) reconstruction, but integration into clinical routine remains challenging due to a lack of generalizability and interpretability. In this paper,…

Image and Video Processing · Electrical Eng. & Systems 2023-10-20 Martin Zach , Florian Knoll , Thomas Pock

Reconstruction of magnetic resonance imaging (MRI) data has been positively affected by deep learning. A key challenge remains: to improve generalisation to distribution shifts between the training and testing data. Most approaches aim to…

Image and Video Processing · Electrical Eng. & Systems 2024-02-15 Yuyang Xue , Chen Qin , Sotirios A. Tsaftaris

Self-supervised learning is crucial for clinical imaging applications, given the lack of explicit labels in healthcare. However, conventional approaches that rely on precise vision-language alignment are not always feasible in complex…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jielin Qiu , Peide Huang , Makiya Nakashima , Jaehyun Lee , Jiacheng Zhu , Wilson Tang , Pohao Chen , Christopher Nguyen , Byung-Hak Kim , Debbie Kwon , Douglas Weber , Ding Zhao , David Chen

This work addresses a central topic in Magnetic Resonance Imaging (MRI) which is the motion-correction problem in a joint reconstruction and registration framework. From a set of multiple MR acquisitions corrupted by motion, we aim at -…

Deep learning models such as convolutional neural net- work have been widely used in 3D biomedical segmentation and achieve state-of-the-art performance. However, most of them often adapt a single modality or stack multiple modalities as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Kuan-Lun Tseng , Yen-Liang Lin , Winston Hsu , Chung-Yang Huang