English
Related papers

Related papers: A Learnable Variational Model for Joint Multimodal…

200 papers

We propose a model-based deep learning architecture for the reconstruction of highly accelerated diffusion magnetic resonance imaging (MRI) that enables high resolution imaging. The proposed reconstruction jointly recovers all the diffusion…

Image and Video Processing · Electrical Eng. & Systems 2020-01-24 Merry P. Mani , Hemant K. Aggarwal , Sanjay Ghosh , Mathews Jacob

Undersampling the k-space in MRI allows saving precious acquisition time, yet results in an ill-posed inversion problem. Recently, many deep learning techniques have been developed, addressing this issue of recovering the fully sampled MR…

Image and Video Processing · Electrical Eng. & Systems 2020-07-28 Mélanie Gaillochet , Kerem C. Tezcan , Ender Konukoglu

The application of compressed sensing (CS)-enabled data reconstruction for accelerating magnetic resonance imaging (MRI) remains a challenging problem. This is due to the fact that the information lost in k-space from the acceleration mask…

Image and Video Processing · Electrical Eng. & Systems 2023-06-22 Guoyao Shen , Boran Hao , Mengyu Li , Chad W. Farris , Ioannis Ch. Paschalidis , Stephan W. Anderson , Xin Zhang

Multimodal learning has been lacking principled ways of combining information from different modalities and learning a low-dimensional manifold of meaningful representations. We study multimodal learning and sensor fusion from a latent…

Machine Learning · Computer Science 2019-04-24 Lijiang Guo

Combining complementary information from multiple modalities is intuitively appealing for improving the performance of learning-based approaches. However, it is challenging to fully leverage different modalities due to practical challenges…

Machine Learning · Statistics 2018-05-31 Kuan Liu , Yanen Li , Ning Xu , Prem Natarajan

Magnetic Resonance Imaging (MRI) is widely used in clinical practice, but suffered from prolonged acquisition time. Although deep learning methods have been proposed to accelerate acquisition and demonstrate promising performance, they rely…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Hao Zhang , Qi Wang , Jian Sun , Zhijie Wen , Jun Shi , Shihui Ying

Magnetic Resonance Imaging (MRI) represents an important diagnostic modality; however, its inherently slow acquisition process poses challenges in obtaining fully-sampled $k$-space data under motion. In the absence of fully-sampled…

Image and Video Processing · Electrical Eng. & Systems 2024-12-23 George Yiasemis , Nikita Moriakov , Clara I. Sánchez , Jan-Jakob Sonke , Jonas Teuwen

The key to dynamic or multi-contrast magnetic resonance imaging (MRI) reconstruction lies in exploring inter-frame or inter-contrast information. Currently, the unrolled model, an approach combining iterative MRI reconstruction steps with…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Bingyu Xin , Meng Ye , Leon Axel , Dimitris N. Metaxas

Multimodal MR image synthesis aims to generate missing modality images by effectively fusing and mapping from a subset of available MRI modalities. Most existing methods adopt an image-to-image translation paradigm, treating multiple…

Image and Video Processing · Electrical Eng. & Systems 2025-04-29 Tao Song , Yicheng Wu , Minhao Hu , Xiangde Luo , Linda Wei , Guotai Wang , Yi Guo , Feng Xu , Shaoting Zhang

Multi-modality (or multi-channel) imaging is becoming increasingly important and more widely available, e.g. hyperspectral imaging in remote sensing, spectral CT in material sciences as well as multi-contrast MRI and PET-MR in medicine.…

Image and Video Processing · Electrical Eng. & Systems 2020-12-25 Leon Bungert , Matthias J. Ehrhardt

Image reconstruction from undersampled k-space data has been playing an important role for fast MRI. Recently, deep learning has demonstrated tremendous success in various fields and also shown potential to significantly speed up MR…

Image and Video Processing · Electrical Eng. & Systems 2019-07-30 Dong Liang , Jing Cheng , Ziwen Ke , Leslie Ying

Fast data acquisition in Magnetic Resonance Imaging (MRI) is vastly in demand and scan time directly depends on the number of acquired k-space samples. Recently, the deep learning-based MRI reconstruction techniques were suggested to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Ali Pour Yazdanpanah , Onur Afacan , Simon K. Warfield

Multi-modal medical images provide complementary soft-tissue characteristics that aid in the screening and diagnosis of diseases. However, limited scanning time, image corruption and various imaging protocols often result in incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Zhang , Chengtao Peng , Qiuli Wang , Dan Song , Kaiyan Li , S. Kevin Zhou

Synthesizing missing modalities in multi-modal magnetic resonance imaging (MRI) is vital for ensuring diagnostic completeness, particularly when full acquisitions are infeasible due to time constraints, motion artifacts, and patient…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yue Zhang , Zhizheng Zhuo , Siyao Xu , Shan Lv , Zhaoxi Liu , Jun Qiu , Qiuli Wang , Yaou Liu , S. Kevin Zhou

In multi-contrast magnetic resonance imaging (MRI), compressed sensing theory can accelerate imaging by sampling fewer measurements within each contrast. The conventional optimization-based models suffer several limitations: strict…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Liyan Sun , Zhiwen Fan , Yue Huang , Xinghao Ding , John Paisley

Meta-learning has recently been an emerging data-efficient learning technique for various medical imaging operations and has helped advance contemporary deep learning models. Furthermore, meta-learning enhances the knowledge generalization…

Image and Video Processing · Electrical Eng. & Systems 2023-07-14 Sriprabha Ramanarayanan , Arun Palla , Keerthi Ram , Mohanasankar Sivaprakasam

Recently, deep neural networks have greatly advanced undersampled Magnetic Resonance Image (MRI) reconstruction, wherein most studies follow the one-anatomy-one-network fashion, i.e., each expert network is trained and evaluated for a…

Image and Video Processing · Electrical Eng. & Systems 2022-06-17 Jiangpeng Yan , Chenghui Yu , Hanbo Chen , Zhe Xu , Junzhou Huang , Xiu Li , Jianhua Yao

Following the success of deep learning in a wide range of applications, neural network-based machine learning techniques have received interest as a means of accelerating magnetic resonance imaging (MRI). A number of ideas inspired by deep…

Signal Processing · Electrical Eng. & Systems 2019-04-03 Florian Knoll , Kerstin Hammernik , Chi Zhang , Steen Moeller , Thomas Pock , Daniel K. Sodickson , Mehmet Akcakaya

Motion degradation is a central problem in Magnetic Resonance Imaging (MRI). This work addresses the problem of how to obtain higher quality, super-resolved motion-free, reconstructions from highly undersampled MRI data. In this work, we…

Image and Video Processing · Electrical Eng. & Systems 2019-08-19 Veronica Corona , Angelica I. Aviles-Rivero , Noémie Debroux , Carole Le Guyader , Carola-Bibiane Schönlieb

Multi-contrast MRI images provide complementary contrast information about the characteristics of anatomical structures and are commonly used in clinical practice. Recently, a multi-flip-angle (FA) and multi-echo GRE method (MULTIPLEX MRI)…

Image and Video Processing · Electrical Eng. & Systems 2021-05-19 Eric Z. Chen , Yongquan Ye , Xiao Chen , Jingyuan Lyu , Zhongqi Zhang , Yichen Hu , Terrence Chen , Jian Xu , Shanhui Sun