English
Related papers

Related papers: EI: Early Intervention for Multimodal Imaging base…

200 papers

Large-scale multi-modal deep learning models have revolutionized domains such as healthcare, highlighting the importance of computational power. However, in resource-constrained regions like Low and Middle-Income Countries (LMICs), limited…

Image feature matching, a foundational task in computer vision, remains challenging for multimodal image applications, often necessitating intricate training on specific datasets. In this paper, we introduce a Unified Feature Matching…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Yide Di , Yun Liao , Hao Zhou , Kaijun Zhu , Qing Duan , Junhui Liu , Mingyu Lu

Multi-modal Magnetic Resonance Imaging (MRI) translation leverages information from source MRI sequences to generate target modalities, enabling comprehensive diagnosis while overcoming the limitations of acquiring all sequences. While…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Jiyao Liu , Shangqi Gao , Yuxin Li , Lihao Liu , Xin Gao , Zhaohu Xing , Junzhi Ning , Yanzhou Su , Xiao-Yong Zhang , Junjun He , Ningsheng Xu , Xiahai Zhuang

Early cancer detection remains one of the most critical challenges in modern healthcare, where delayed diagnosis significantly reduces survival outcomes. Recent advancements in artificial intelligence, particularly deep learning, have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Emmanuella Avwerosuoghene Oghenekaro

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

Multimodal learning has been a popular area of research, yet integrating electroencephalogram (EEG) data poses unique challenges due to its inherent variability and limited availability. In this paper, we introduce a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kang Yin , Hye-Bin Shin , Dan Li , Seong-Whan Lee

The integration of Artificial Intelligence (AI) in medical diagnostics is often hindered by model opacity, where high-accuracy systems function as "black boxes" without transparent reasoning. This limitation is critical in clinical…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Pascal Passigan , Vayd Ramkumar

Medical images are often more difficult to acquire than natural images due to the specialism of the equipment and technology, which leads to less medical image datasets. So it is hard to train a strong pretrained medical vision model. How…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Haijiang Tian , Jingkun Yue , Xiaohong Liu , Guoxing Yang , Zeyu Jiang , Guangyu Wang

Multimodal deep learning harnesses diverse imaging modalities, such as MRI sequences, to enhance diagnostic accuracy in medical imaging. A key challenge is determining the optimal timing for integrating these modalities-specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Valerio Guarrasi , Klara Mogensen , Sara Tassinari , Sara Qvarlander , Paolo Soda

Recent advancements in the acquisition of various brain data sources have created new opportunities for integrating multimodal brain data to assist in early detection of complex brain disorders. However, current data integration approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-05-26 Reza Shirkavand , Liang Zhan , Heng Huang , Li Shen , Paul M. Thompson

Recent studies show that deep learning models achieve good performance on medical imaging tasks such as diagnosis prediction. Among the models, multimodality has been an emerging trend, integrating different forms of data such as chest…

Machine Learning · Computer Science 2022-02-10 Haodi Zhang , Chenyu Xu , Peirou Liang , Ke Duan , Hao Ren , Weibin Cheng , Kaishun Wu

Edge illumination (EI) is a non-interferometric X-ray phase contrast imaging (XPCI) method that has been successfully implemented with conventional polychromatic sources, thanks to its relaxed coherence requirements. Like other XPCI…

Medical Physics · Physics 2017-09-27 G. K. Kallon , F. A. Vittoria , M. Endrizzi , P. C. Diemoz , C. K. Hagen , A. Zamir , D. Basta , A. Olivo

Alzheimer's disease is a progressive neurological disorder characterized by cognitive impairment and memory loss. With the increasing aging population, the incidence of AD is continuously rising, making early diagnosis and intervention an…

Image and Video Processing · Electrical Eng. & Systems 2023-11-23 Guian Fang , Mengsha Liu , Yi Zhong , Zhuolin Zhang , Jiehui Huang , Zhenchao Tang , Calvin Yu-Chian Chen

Fast and accurate MRI reconstruction is a key concern in modern clinical practice. Recently, numerous Deep-Learning methods have been proposed for MRI reconstruction, however, they usually fail to reconstruct sharp details from the…

Image and Video Processing · Electrical Eng. & Systems 2023-06-21 Hanhui Yang , Juncheng Li , Lok Ming Lui , Shihui Ying , Jun Shi , Tieyong Zeng

In this paper, we consider the problem of disease diagnosis. Unlike the conventional learning paradigm that treats labels independently, we propose a knowledge-enhanced framework, that enables training visual representation with the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Chaoyi Wu , Xiaoman Zhang , Yanfeng Wang , Ya Zhang , Weidi Xie

We present EmbodiedMAE, a unified 3D multi-modal representation for robot manipulation. Current approaches suffer from significant domain gaps between training datasets and robot manipulation tasks, while also lacking model architectures…

Robotics · Computer Science 2025-05-16 Zibin Dong , Fei Ni , Yifu Yuan , Yinchuan Li , Jianye Hao

Accurate and robust medical image classification is paramount for early disease diagnosis and treatment planning. However, challenges such as limited annotated data, high intra-class variability, and subtle inter-class differences often…

Image and Video Processing · Electrical Eng. & Systems 2026-05-22 Joao Florindo , Viviane Moura

Clinical decision-making reflects diverse strategies shaped by regional patient populations and institutional protocols. However, most existing medical artificial intelligence (AI) models are trained on highly prevalent data patterns, which…

Alzheimers Disease (AD) is a progressive neurodegenerative disorder that poses significant challenges in its early diagnosis, often leading to delayed treatment and poorer outcomes for patients. Traditional diagnostic methods, typically…

Machine Learning · Computer Science 2025-08-06 Tatwadarshi P Nagarhalli , Sanket Patil , Vishal Pande , Uday Aswalekar , Prafulla Patil

With the increasing availability of multimodal data, many fields urgently require advanced architectures capable of effectively integrating these diverse data sources to address specific problems. This study proposes a hybrid recommendation…

Information Retrieval · Computer Science 2024-12-17 Jingyu Xu , Yang Wang