English
Related papers

Related papers: Joint Explicit and Implicit Cross-Modal Interactio…

200 papers

The integration of DNA methylation data with a Whole Slide Image (WSI) offers significant potential for enhancing the diagnostic precision of central nervous system (CNS) tumor classification in neuropathology. While existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Omnia Alwazzan , Amaya Gallagher-Syed , Thomas O. Millner , Sebastian Brandner , Ioannis Patras , Silvia Marino , Gregory Slabaugh

The classification of medical images is a pivotal aspect of disease diagnosis, often enhanced by deep learning techniques. However, traditional approaches typically focus on unimodal medical image data, neglecting the integration of diverse…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Jun-En Ding , Chien-Chin Hsu , Chi-Hsiang Chu , Shuqiang Wang , Feng Liu

We introduce eCLIP, an enhanced version of the CLIP model that integrates expert annotations in the form of radiologist eye-gaze heatmaps. It tackles key challenges in contrastive multi-modal medical imaging analysis, notably data scarcity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yogesh Kumar , Pekka Marttinen

Integrating brain imaging data with clinical reports offers a valuable opportunity to leverage complementary multimodal information for more effective and timely diagnosis in practical clinical settings. This approach has gained significant…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jing Zhang , Xiaowei Yu , Minheng Chen , Lu Zhang , Tong Chen , Yan Zhuang , Chao Cao , Yanjun Lyu , Li Su , Tianming Liu , Dajiang Zhu

Computer-aided diagnosis (CAD) has significantly advanced automated chest X-ray diagnosis but remains isolated from clinical workflows and lacks reliable decision support and interpretability. Human-AI collaboration seeks to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Shaoxuan Wu , Jingkun Chen , Chong Ma , Cong Shen , Xiao Zhang , Jun Feng

Accurate early prediction of Acute Kidney Injury (AKI) is critical for timely clinical intervention. However, existing deep learning models struggle with irregularly sampled data and suffer from the opaque "black-box" nature of sequential…

Machine Learning · Computer Science 2026-04-23 Weizhi Nie , Haolin Chen

Convolutional Neural Networks (CNNs) are being increasingly used to address the problem of iris presentation attack detection. In this work, we propose attention-guided iris presentation attack detection (AG-PAD) to augment CNNs with…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Cunjian Chen , Arun Ross

Multi-modal ophthalmic image classification plays a key role in diagnosing eye diseases, as it integrates information from different sources to complement their respective performances. However, recent improvements have mainly focused on…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Ke Zou , Tian Lin , Zongbo Han , Meng Wang , Xuedong Yuan , Haoyu Chen , Changqing Zhang , Xiaojing Shen , Huazhu Fu

Accurate prognosis of non-small cell lung cancer (NSCLC) patients undergoing immunotherapy is essential for personalized treatment planning, enabling informed patient decisions, and improving both treatment outcomes and quality of life.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Qilong Xing , Zikai Song , Bingxin Gong , Lian Yang , Junqing Yu , Wei Yang

The automatic and objective medical diagnostic model can be valuable to achieve early cancer detection, and thus reducing the mortality rate. In this paper, we propose a highly efficient multi-level malignant tissue detection through the…

Image and Video Processing · Electrical Eng. & Systems 2020-07-01 Chuang Zhu , Ke Mei , Ting Peng , Yihao Luo , Jun Liu , Ying Wang , Mulan Jin

Current AI-assisted skin image diagnosis has achieved dermatologist-level performance in classifying skin cancer, driven by rapid advancements in deep learning architectures. However, unlike traditional vision tasks, skin images in general…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Xin Hu , Janet Wang , Jihun Hamm , Rie R Yotsu , Zhengming Ding

Breast cancer is a leading cause of cancer-related mortality worldwide, and timely accurate diagnosis is critical to improving survival outcomes. While convolutional neural networks (CNNs) have demonstrated strong performance on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Aditya Shribhagwan Khandelwal , Mohammad Samar Ansari , Asra Aslam

Emotional Mimicry Intensity (EMI) estimation plays a pivotal role in understanding human social behavior and advancing human-computer interaction. The core challenges lie in dynamic correlation modeling and robust fusion of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jun Yu , Lingsi Zhu , Yanjun Chi , Yunxiang Zhang , Yang Zheng , Yongqi Wang , Xilong Lu

Mild Cognitive Impairment (MCI) serves as a prodromal stage of Alzheimer's Disease (AD), where early identification and intervention can effectively slow the progression to dementia. However, diagnosing AD remains a significant challenge in…

Artificial Intelligence · Computer Science 2025-11-07 Yutao Jin , Haowen Xiao , Junyong Zhai , Yuxiao Li , Jielei Chu , Fengmao Lv , Yuxiao Li

The purpose of emotion recognition in conversation (ERC) is to identify the emotion category of an utterance based on contextual information. Previous ERC methods relied on simple connections for cross-modal fusion and ignored the…

Computation and Language · Computer Science 2024-05-29 Haoxiang Shi , Xulong Zhang , Ning Cheng , Yong Zhang , Jun Yu , Jing Xiao , Jianzong Wang

Deep learning methods based on Convolutional Neural Networks (CNNs) have shown great potential to improve early and accurate diagnosis of Alzheimer's disease (AD) dementia based on imaging data. However, these methods have yet to be widely…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Wenjie Kang , Lize Jiskoot , Peter De Deyn , Geert Biessels , Huiberdina Koek , Jurgen Claassen , Huub Middelkoop , Wiesje Flier , Willemijn J. Jansen , Stefan Klein , Esther Bron

Postoperative infection diagnosis is a common and serious complication that generally poses a high diagnostic challenge. This study focuses on PJI, a type of postoperative infection. X-ray examination is an imaging examination for suspected…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Xianjie Liu , Hongwei Shi

Cross-modal fusion of different types of neuroimaging data has shown great promise for predicting the progression of Alzheimer's Disease(AD). However, most existing methods applied in neuroimaging can not efficiently fuse the functional and…

Image and Video Processing · Electrical Eng. & Systems 2022-07-15 Junren Pan , Shuqiang Wang

Medical artificial intelligence (AI) systems, particularly multimodal vision-language models (VLM), often exhibit intersectional biases where models are systematically less confident in diagnosing marginalised patient subgroups. Such bias…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Yupeng Zhang , Adam G. Dunn , Usman Naseem , Jinman Kim

Inter-cell interference (ICI) suppression is critical for multi-cell multi-user networks. In this paper, we investigate advanced precoding techniques for coordinated multi-point (CoMP) with downlink coherent joint transmission, an effective…

Signal Processing · Electrical Eng. & Systems 2024-03-29 Xinyu Bian , Yuhao Liu , Yizhou Xu , Tianqi Hou , Wenjie Wang , Yuyi Mao , Jun Zhang