English
Related papers

Related papers: A Learnable Variational Model for Joint Multimodal…

200 papers

Magnetic resonance imaging (MRI) is a crucial medical imaging modality. However, long acquisition times remain a significant challenge, leading to increased costs, and reduced patient comfort. Recent studies have shown the potential of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Amirmohammad Shamaei , Alexander Stebner , Salome , Bosshart , Johanna Ospel , Gouri Ginde , Mariana Bento , Roberto Souza

Magnetic resonance imaging (MRI) is a powerful medical imaging modality, but long acquisition times limit throughput, patient comfort, and clinical accessibility. Diffusion-based generative models serve as strong image priors for reducing…

Machine Learning · Computer Science 2026-02-13 Sriram Ravula , Brett Levac , Yamin Arefeen , Ajil Jalal , Alexandros G. Dimakis , Jonathan I. Tamir

Multimodal learning typically relies on the assumption that all modalities are fully available during both the training and inference phases. However, in real-world scenarios, consistently acquiring complete multimodal data presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Donggeun Kim , Taesup Kim

We propose a multimodal latent diffusion model that jointly synthesizes volumetric magnetic resonance imaging (MRI) and tabular clinical data within a shared latent space via cross-attention. This approach enables coherent joint…

Image and Video Processing · Electrical Eng. & Systems 2026-05-11 Daniel Mensing , Jan Kapar , Jochen G. Hirsch , Matthias Günther , Horst Hahn , Marvin N. Wright

We present a tool for resolution recovery in multimodal clinical magnetic resonance imaging (MRI). Such images exhibit great variability, both biological and instrumental. This variability makes automated processing with neuroimaging…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Mikael Brudfors , Yael Balbastre , Parashkev Nachev , John Ashburner

This paper presents a deep learning method for faster magnetic resonance imaging (MRI) by reducing k-space data with sub-Nyquist sampling strategies and provides a rationale for why the proposed approach works well. Uniform subsampling is…

Machine Learning · Statistics 2019-05-14 Chang Min Hyun , Hwa Pyung Kim , Sung Min Lee , Sungchul Lee , Jin Keun Seo

Deep learning has demonstrated strong potential for MRI reconstruction. However, conventional supervised learning requires high-quality, high-SNR references for network training, which are often difficult or impossible to obtain in…

Image and Video Processing · Electrical Eng. & Systems 2026-01-01 Haoyang Pei , Nikola Janjuvsevic , Renqing Luo , Ding Xia , Xiang Xu , William Moore , Yao Wang , Hersh Chandarana , Li Feng

Multi-modal Magnetic Resonance Imaging (MRI) offers complementary diagnostic information, but some modalities are limited by the long scanning time. To accelerate the whole acquisition process, MRI reconstruction of one modality from highly…

Image and Video Processing · Electrical Eng. & Systems 2025-01-09 Hao Zhang , Qi Wang , Jun Shi , Shihui Ying , Zhijie Wen

Accelerating magnetic resonance image (MRI) reconstruction process is a challenging ill-posed inverse problem due to the excessive under-sampling operation in k-space. In this paper, we propose a recurrent transformer model, namely…

Image and Video Processing · Electrical Eng. & Systems 2022-01-31 Pengfei Guo , Yiqun Mei , Jinyuan Zhou , Shanshan Jiang , Vishal M. Patel

The reconstruction of a high resolution image given a low resolution observation is an ill-posed inverse problem in imaging. Deep learning methods rely on training data to learn an end-to-end mapping from a low-resolution input to a…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Iman Marivani , Evaggelia Tsiligianni , Bruno Cornelis , Nikos Deligiannis

Multi-contrast MRI acquisitions of an anatomy enrich the magnitude of information available for diagnosis. Yet, excessive scan times associated with additional contrasts may be a limiting factor. Two mainstream approaches for enhanced scan…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Salman Ul Hassan Dar , Mahmut Yurt , Mohammad Shahdloo , Muhammed Emrullah Ildız , Tolga Çukur

This paper introduces an innovative multi-modal fusion deep learning approach to overcome the drawbacks of traditional single-modal recognition techniques. These drawbacks include incomplete information and limited diagnostic accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xiaoyi Liu , Hongjie Qiu , Muqing Li , Zhou Yu , Yutian Yang , Yafeng Yan

Multimodal deep learning has been used to predict clinical endpoints and diagnoses from clinical routine data. However, these models suffer from scaling issues: they have to learn pairwise interactions between each piece of information in…

Due to the ever-growing diversity of the data source, multi-modality feature learning has attracted more and more attention. However, most of these methods are designed by jointly learning feature representation from multi-modalities that…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Danfeng Hong , Jocelyn Chanussot , Naoto Yokoya , Jian Kang , Xiao Xiang Zhu

Self-supervised learning is an efficient pre-training method for medical image analysis. However, current research is mostly confined to specific-modality data pre-training, consuming considerable time and resources without achieving…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yiwen Ye , Yutong Xie , Jianpeng Zhang , Ziyang Chen , Qi Wu , Yong Xia

We propose a novel technique for producing high-quality 3D models that match a given target object image or scan. Our method is based on retrieving an existing shape from a database of 3D models and then deforming its parts to match the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Mikaela Angelina Uy , Vladimir G. Kim , Minhyuk Sung , Noam Aigerman , Siddhartha Chaudhuri , Leonidas Guibas

Inverse problems in imaging are typically ill-posed and are usually solved by employing regularized optimization techniques. The usage of appropriate constraints can restrict the solution space, thus making it feasible for a reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2025-11-14 Jasleen Birdi , Tamal Majumder , Debanjan Halder , Muskan Kularia , Kedar Khare

Following the success of deep learning in a wide range of applications, neural network-based machine-learning techniques have received significant interest for accelerating magnetic resonance imaging (MRI) acquisition and reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2022-03-11 Arghya Pal , Yogesh Rathi

Free-breathing cardiac MRI schemes are emerging as competitive alternatives to breath-held cine MRI protocols, enabling applicability to pediatric and other population groups that cannot hold their breath. Because the data from the slices…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 Qing Zou , Abdul Haseeb Ahmed , Prashant Nagpal , Sarv Priya , Rolf F Schulte , Mathews Jacob

Multimodal MRI offers complementary multi-scale information to characterize the brain structure. However, it remains challenging to effectively integrate multimodal MRI while achieving neuroscience interpretability. Here we propose to use…

Neurons and Cognition · Quantitative Biology 2025-12-15 Chengzhi Xia , Jianwei Chen , Yixuan Jiang , Qi Yan , Chao Li