English
Related papers

Related papers: M2Diff: Multi-Modality Multi-Task Enhanced Diffusi…

200 papers

Automated retinal image medical description generation is crucial for streamlining medical diagnosis and treatment planning. Existing challenges include the reliance on learned retinal image representations, difficulties in handling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Nagur Shareef Shaik , Teja Krishna Cherukuri , Dong Hye Ye

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Reconstruction of PET images is an ill-posed inverse problem and often requires iterative algorithms to achieve good image quality for reliable clinical use in practice, at huge computational costs. In this paper, we consider the PET…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Jieqing Jiao , Sebastien Ourselin

Alzheimer's Disease (AD) is an irreversible neurodegenerative disease characterized by progressive cognitive decline as its main symptom. In the research field of deep learning-assisted diagnosis of AD, traditional convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Yang Ming , Jiang Shi Zhong , Zhou Su Juan

While electron microscopy offers crucial atomic-resolution insights into structure-property relationships, radiation damage severely limits its use on beam-sensitive materials like proteins and 2D materials. To overcome this challenge, we…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Zifei Wang , Zian Mao , Xiaoya He , Xi Huang , Haoran Zhang , Chun Cheng , Shufen Chu , Tingzheng Hou , Xiaoqin Zeng , Yujun Xie

The success of deep convolutional neural networks is partially attributed to the massive amount of annotated training data. However, in practice, medical data annotations are usually expensive and time-consuming to be obtained. Considering…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Kang Li , Lequan Yu , Shujun Wang , Pheng-Ann Heng

Magnetic Resonance Imaging (MRI) is a critical tool in modern medical diagnostics, yet its prolonged acquisition time remains a critical limitation, especially in time-sensitive clinical scenarios. While undersampling strategies can…

Image and Video Processing · Electrical Eng. & Systems 2025-10-09 Mohammed Alsubaie , Wenxi Liu , Linxia Gu , Ovidiu C. Andronesi , Sirani M. Perera , Xianqi Li

In multi-modal learning, some modalities are more influential than others, and their absence can have a significant impact on classification/segmentation accuracy. Addressing this challenge, we propose a novel approach called Meta-learned…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Hu Wang , Salma Hassan , Yuyuan Liu , Congbo Ma , Yuanhong Chen , Qing Li , Jiahui Geng , Bingjie Wang , Yu Tian , Yutong Xie , Jodie Avery , Louise Hull , Ian Reid , Mohammad Yaqub , Gustavo Carneiro

Deep learning-based positron emission tomography (PET) image denoising offers the potential to reduce radiation exposure and scanning time by transforming low-count images into high-count equivalents. However, existing methods typically…

Image and Video Processing · Electrical Eng. & Systems 2025-03-06 Menghua Xia , Huidong Xie , Qiong Liu , Bo Zhou , Hanzhong Wang , Biao Li , Axel Rominger , Quanzheng Li , Ramsey D. Badawi , Kuangyu Shi , Georges El Fakhri , Chi Liu

Finding appropriate low dimensional representations of high-dimensional multi-modal data can be challenging, since each modality embodies unique deformations and interferences. In this paper, we address the problem using manifold learning,…

Signal Processing · Electrical Eng. & Systems 2018-08-23 Tal Shnitzer , Mirela Ben-Chen , Leonidas Guibas , Ronen Talmon , Hau-Tieng Wu

Low-dose computed tomography (LDCT) reduces radiation exposure but suffers from image artifacts and loss of detail due to quantum and electronic noise, potentially impacting diagnostic accuracy. Transformer combined with diffusion models…

Image and Video Processing · Electrical Eng. & Systems 2025-07-01 Qiqing Liu , Guoquan Wei , Zekun Zhou , Yiyang Wen , Liu Shi , Qiegen Liu

Recent years have witnessed the remarkable performance of diffusion models in various vision tasks. However, for image restoration that aims to recover clear images with sharper details from given degraded observations, diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Liyan Wang , Qinyu Yang , Cong Wang , Wei Wang , Jinshan Pan , Zhixun Su

Magnetic resonance (MR) protocols rely on several sequences to assess pathology and organ status properly. Despite advances in image analysis, we tend to treat each sequence, here termed modality, in isolation. Taking advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Agisilaos Chartsias , Giorgos Papanastasiou , Chengjia Wang , Scott Semple , David E. Newby , Rohan Dharmakumar , Sotirios A. Tsaftaris

Multimodal Magnetic Resonance Imaging (MRI) provides essential complementary information for analyzing brain tumor subregions. While methods using four common MRI modalities for automatic segmentation have shown success, they often face…

Image and Video Processing · Electrical Eng. & Systems 2024-11-14 Runze Cheng , Zhongao Sun , Ye Zhang , Chun Li

Score-based generative models have demonstrated highly promising results for medical image reconstruction tasks in magnetic resonance imaging or computed tomography. However, their application to Positron Emission Tomography (PET) is still…

Image and Video Processing · Electrical Eng. & Systems 2024-01-24 Imraj RD Singh , Alexander Denker , Riccardo Barbano , Željko Kereta , Bangti Jin , Kris Thielemans , Peter Maass , Simon Arridge

Multimodal fusion leverages information across modalities to learn better feature representations with the goal of improving performance in fusion-based tasks. However, multimodal datasets, especially in medical settings, are typically…

Machine Learning · Computer Science 2025-02-05 Alejandro Guerra-Manzanares , Farah E. Shamout

Recent advances in tuning-free personalized image generation based on diffusion models are impressive. However, to improve subject fidelity, existing methods either retrain the diffusion model or infuse it with dense visual embeddings, both…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Zhichao Wei , Qingkun Su , Long Qin , Weizhi Wang

Retinal diseases spanning a broad spectrum can be effectively identified and diagnosed using complementary signals from multimodal data. However, multimodal diagnosis in ophthalmic practice is typically challenged in terms of data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Lu Zhang , Huizhen Yu , Zuowei Wang , Fu Gui , Yatu Guo , Wei Zhang , Mengyu Jia

One of the most challenges in medical imaging is the lack of data and annotated data. It is proven that classical segmentation methods such as U-NET are useful but still limited due to the lack of annotated data. Using a weakly supervised…

Image and Video Processing · Electrical Eng. & Systems 2020-03-20 Amine Amyar , Romain Modzelewski , Pierre Vera , Vincent Morard , Su Ruan

Alzheimer's Disease (AD) is a complex neurodegenerative disorder marked by memory loss, executive dysfunction, and personality changes. Early diagnosis is challenging due to subtle symptoms and varied presentations, often leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Yifei Chen , Shenghao Zhu , Zhaojie Fang , Chang Liu , Binfeng Zou , Yuhe Wang , Shuo Chang , Fan Jia , Feiwei Qin , Jin Fan , Yong Peng , Changmiao Wang