English
Related papers

Related papers: MedSynapse-V: Bridging Visual Perception and Clini…

200 papers

With the advancement of telemedicine, both researchers and medical practitioners are working hand-in-hand to develop various techniques to automate various medical operations, such as diagnosis report generation. In this paper, we first…

Computation and Language · Computer Science 2023-09-28 Abhisek Tiwari , Anisha Saha , Sriparna Saha , Pushpak Bhattacharyya , Minakshi Dhar

Multimodal (MM) learning is emerging as a promising paradigm in biomedical artificial intelligence (AI) applications, integrating complementary modality, which highlight different aspects of patient health. The scarcity of large…

Artificial Intelligence · Computer Science 2025-12-01 Niccolo Marini , Zhaohui Liang , Sivaramakrishnan Rajaraman , Zhiyun Xue , Sameer Antani

Adapting to latent confounded shift remains a core challenge in modern AI. This setting is driven by hidden variables that induce spurious correlations between inputs and outputs during training, leading models to rely on non-causal…

Machine Learning · Computer Science 2026-05-14 Jialin Yu , Yuxiang Zhou , Haoxuan Li , Junchi Yu , Mengyue Yang , Yulan He , Nevin L. Zhang , Philip Torr , Ricardo Silva

Deep learning models in medical imaging often achieve strong in-distribution performance but struggle to generalise under distribution shifts, frequently relying on spurious correlations instead of clinically meaningful features. We…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Valentina Corbetta , Floris Six Dijkstra , Regina Beets-Tan , Hoel Kervadec , Kristoffer Wickstrøm , Wilson Silva

We present InfoVAE-Med3D, a latent-representation learning approach for 3D brain MRI that targets interpretable biomarkers of cognitive decline. Standard statistical models and shallow machine learning often lack power, while most deep…

Deep learning models are prone to learning shortcut solutions to problems using spuriously correlated yet irrelevant features of their training data. In high-risk applications such as medical image analysis, this phenomenon may prevent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Christopher Boland , Sotirios Tsaftaris , Sonia Dahdouh

Medical visual question answering (Med-VQA) aims to answer clinically relevant questions grounded in medical images. However, existing multimodal large language models (MLLMs) often exhibit shortcut answering, producing plausible responses…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Zhisong Wang , Ziyang Chen , Zanting Ye , Hongze Zhu , Yefeng Zheng , Yong Xia

Interpretability is significant in computational pathology, leading to the development of multimodal information integration from histopathological image and corresponding text data.However, existing multimodal methods have limited…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Kangcheng Zhou , Jun Jiang , Qing Zhang , Shuang Zheng , Qingli Li , Shugong Xu

The transition of Large Language Models (LLMs) from passive knowledge retrievers to autonomous clinical agents demands a shift in evaluation-from static accuracy to dynamic behavioral reliability. To explore this boundary in dentistry, a…

Computation and Language · Computer Science 2026-01-21 Hongyang Ma , Tiantian Gu , Huaiyuan Sun , Huilin Zhu , Yongxin Wang , Jie Li , Wubin Sun , Zeliang Lian , Yinghong Zhou , Yi Gao , Shirui Wang , Zhihui Tang

Clinical outcome or severity prediction from medical images has largely focused on learning representations from single-timepoint or snapshot scans. It has been shown that disease progression can be better characterized by temporal imaging.…

Image and Video Processing · Electrical Eng. & Systems 2022-04-01 Aishik Konwer , Xuan Xu , Joseph Bae , Chao Chen , Prateek Prasanna

Contextual clinical reasoning demands robust inference grounded in complex, heterogeneous clinical records. While state-of-the-art fine-tuning, in-context learning (ICL), and retrieval-augmented generation (RAG) enable knowledge exposure,…

Quantitative Methods · Quantitative Biology 2026-04-09 Chuang Zhao , Hongke Zhao , Xiaofang Zhou , Xiaomeng Li

Causal machine learning (CML) has experienced increasing popularity in healthcare. Beyond the inherent capabilities of adding domain knowledge into learning systems, CML provides a complete toolset for investigating how a system would react…

Machine Learning · Computer Science 2022-06-01 Pedro Sanchez , Jeremy P. Voisey , Tian Xia , Hannah I. Watson , Alison Q. ONeil , Sotirios A. Tsaftaris

Recent advancements have enhanced the capability of Multimodal Large Language Models (MLLMs) to comprehend multi-image information. However, existing benchmarks primarily evaluate answer correctness, overlooking whether models genuinely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Pengfei Wang , Guohai Xu , Weinong Wang , Junjie Yang , Jie Lou , Yunhua Xue

Class-incremental learning (CIL) in medical image-guided diagnosis requires retaining prior diagnostic knowledge while adapting to newly emerging disease categories, which is critical for scalable clinical deployment. This problem is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xinyao Wu , Zhe Xu , Cheng Chen , Jiawei Ma , Yefeng Zheng , Raymond Kai-yu Tong

Deep learning has shown great potential for automated medical image segmentation to improve the precision and speed of disease diagnostics. However, the task presents significant difficulties due to variations in the scale, shape, texture,…

Image and Video Processing · Electrical Eng. & Systems 2024-09-06 Shahzaib Iqbal , Tariq M. Khan , Syed S. Naqvi , Asim Naveed , Erik Meijering

Cross-modal medical image-report retrieval task plays a significant role in clinical diagnosis and various medical generative tasks. Eliminating heterogeneity between different modalities to enhance semantic consistency is the key challenge…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Zeqiang Wei , Kai Jin , Xiuzhuang Zhou

Medical image understanding plays a crucial role in enabling automated diagnosis and data-driven clinical decision support. However, its progress is impeded by two primary challenges: the limited availability of high-quality annotated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Tianchen Fang , Guiru Liu

Multimodal latent reasoning has emerged as a promising paradigm that replaces explicit Chain-of-Thought (CoT) decoding with implicit feature propagation, simultaneously enhancing representation informativeness and reducing inference…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yudong Han , Yong Wang , Zaiquan Yang , Zhen Qu , Liyuan Pan , Xiangxiang Chu

Knowledge Tracing (KT) models students' evolving knowledge states to predict future performance, serving as a foundation for personalized education. While traditional deep learning models achieve high accuracy, they often lack…

Computation and Language · Computer Science 2026-03-25 Runze Li , Kedi Chen , Guwei Feng , Mo Yu , Jun Wang , Wei Zhang

Comprehensively understanding surgical scenes in Surgical Visual Question Answering (Surgical VQA) requires reasoning over multiple objects. Previous approaches address this task using cross-modal fusion strategies to enhance reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Wenjun Hou , Yi Cheng , Kaishuai Xu , Yan Hu , Wenjie Li , Jiang Liu