English
Related papers

Related papers: Deep Learning based Multi-modal Computing with Fea…

200 papers

Physiological motion can affect the diagnostic quality of magnetic resonance imaging (MRI). While various retrospective motion correction methods exist, many struggle to generalize across different motion types and body regions. In…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Qi Wang , Veronika Ecker , Marcel Früh , Sergios Gatidis , Thomas Küstner

This paper reviewed the deep learning-based studies for medical imaging synthesis and its clinical application. Specifically, we summarized the recent developments of deep learning-based methods in inter- and intra-modality image synthesis…

Medical Physics · Physics 2020-04-23 Tonghe Wang , Yang Lei , Yabo Fu , Walter J. Curran , Tian Liu , Xiaofeng Yang

Image denoising is of great importance for medical imaging system, since it can improve image quality for disease diagnosis and downstream image analyses. In a variety of applications, dynamic imaging techniques are utilized to capture the…

Image and Video Processing · Electrical Eng. & Systems 2021-06-24 Junshen Xu , Elfar Adalsteinsson

Hyperspectral imaging is one of the most promising techniques for intraoperative tissue characterisation. Snapshot mosaic cameras, which can capture hyperspectral data in a single exposure, have the potential to make a real-time…

Image and Video Processing · Electrical Eng. & Systems 2021-12-02 Peichao Li , Michael Ebner , Philip Noonan , Conor Horgan , Anisha Bahl , Sebastien Ourselin , Jonathan Shapey , Tom Vercauteren

Brain tumor segmentation is often based on multiple magnetic resonance imaging (MRI). However, in clinical practice, certain modalities of MRI may be missing, which presents a more difficult scenario. To cope with this challenge, Knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Tianyi Liu , Zhaorui Tan , Muyin Chen , Xi Yang , Haochuan Jiang , Kaizhu Huang

Algorithmic detection of facial palsy offers the potential to improve current practices, which usually involve labor-intensive and subjective assessment by clinicians. In this paper, we present a multimodal fusion-based deep learning model…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Heng Yim Nicole Oo , Min Hun Lee , Jeong Hoon Lim

This paper proposes a multi-channel image reconstruction method, named DeepcomplexMRI, to accelerate parallel MR imaging with residual complex convolutional neural network. Different from most existing works which rely on the utilization of…

Image and Video Processing · Electrical Eng. & Systems 2019-07-30 Shanshan Wang , Huitao Cheng , Leslie Ying , Taohui Xiao , Ziwen Ke , Xin Liu , Hairong Zheng , Dong Liang

Medical imaging plays a critical role in various clinical applications. However, due to multiple considerations such as cost and risk, the acquisition of certain image modalities could be limited. To address this issue, many cross-modality…

Image and Video Processing · Electrical Eng. & Systems 2019-07-09 Dong Nie , Lei Xiang , Qian Wang , Dinggang Shen

In many clinical settings, the use of both Computed Tomography (CT) and Magnetic Resonance (MRI) is necessary to pursue a thorough understanding of the patient's anatomy and to plan a suitable therapeutical strategy; this is often the case…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Leonardo Crespi , Samuele Camnasio , Damiano Dei , Nicola Lambri , Pietro Mancosu , Marta Scorsetti , Daniele Loiacono

Computed tomography (CT) is a widely used imaging modality for medical diagnosis and treatment. In electroencephalography (EEG), CT imaging is necessary for co-registering with magnetic resonance imaging (MRI) and for creating more accurate…

Medical Physics · Physics 2019-06-12 Andreas D. Lauritzen , Xenophon Papademetris , Sergei Turovets , John A. Onofrey

Dynamic magnetic resonance imaging (MRI) plays an indispensable role in cardiac diagnosis. To enable fast imaging, the k-space data can be undersampled but the image reconstruction poses a great challenge of high-dimensional processing.…

Image and Video Processing · Electrical Eng. & Systems 2024-10-03 Zi Wang , Min Xiao , Yirong Zhou , Chengyan Wang , Naiming Wu , Yi Li , Yiwen Gong , Shufu Chang , Yinyin Chen , Liuhong Zhu , Jianjun Zhou , Congbo Cai , He Wang , Di Guo , Guang Yang , Xiaobo Qu

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov

Multi-modality image fusion aims at fusing modality-specific (complementarity) and modality-shared (correlation) information from multiple source images. To tackle the problem of the neglect of inter-feature relationships, high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xiaoli Zhang , Liying Wang , Libo Zhao , Xiongfei Li , Siwei Ma

Multi-contrast magnetic resonance imaging (MRI) is the most common management tool used to characterize neurological disorders based on brain tissue contrasts. However, acquiring high-resolution MRI scans is time-consuming and infeasible…

Image and Video Processing · Electrical Eng. & Systems 2023-06-08 Ye Mao , Lan Jiang , Xi Chen , Chao Li

Deep models suffer from limited generalization capability to unseen domains, which has severely hindered their clinical applicability. Specifically for the retinal vessel segmentation task, although the model is supposed to learn the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Dewei Hu , Hao Li , Han Liu , Xing Yao , Jiacheng Wang , Ipek Oguz

Pathologists need to combine information from differently stained pathology slices for accurate diagnosis. Deformable image registration is a necessary technique for fusing multi-modal pathology slices. This paper proposes a hybrid deep…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Chulong Zhang , Yuming Jiang , Na Li , Zhicheng Zhang , Md Tauhidul Islam , Jingjing Dai , Lin Liu , Wenfeng He , Wenjian Qin , Jing Xiong , Yaoqin Xie , Xiaokun Liang

The task of automatically segmenting 3-D surfaces representing boundaries of objects is important for quantitative analysis of volumetric images, and plays a vital role in biomedical image analysis. Recently, graph-based methods with a…

Computer Vision and Pattern Recognition · Computer Science 2018-01-10 Abhay Shah , Michael Abramoff , Xiaodong Wu

Magnetic Resonance Imaging can produce detailed images of the anatomy and physiology of the human body that can assist doctors in diagnosing and treating pathologies such as tumours. However, MRI suffers from very long acquisition times…

Image and Video Processing · Electrical Eng. & Systems 2022-03-30 George Yiasemis , Jan-Jakob Sonke , Clarisa Sánchez , Jonas Teuwen

Multi-modal image registration is a challenging problem that is also an important clinical task for many real applications and scenarios. As a first step in analysis, deformable registration among different image modalities is often…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Fengze Liu , Jinzheng Cai , Yuankai Huo , Chi-Tung Cheng , Ashwin Raju , Dakai Jin , Jing Xiao , Alan Yuille , Le Lu , ChienHung Liao , Adam P Harrison

Medical image synthesis is crucial for alleviating data scarcity and privacy constraints. However, fine-tuning general text-to-image (T2I) models remains challenging, mainly due to the significant modality gap between complex visual details…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Xin Huang , Junjie Liang , Qingshan Hou , Peng Cao , Jinzhu Yang , Xiaoli Liu , Osmar R. Zaiane