English
Related papers

Related papers: Prototype-Enhanced Confidence Modeling for Cross-M…

200 papers

Recently, prototype learning has emerged in semi-supervised medical image segmentation and achieved remarkable performance. However, the scarcity of labeled data limits the expressiveness of prototypes in previous methods, potentially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Lijian Li , Yuanpeng He , Chi-Man Pun

Multi-modality (or multi-channel) imaging is becoming increasingly important and more widely available, e.g. hyperspectral imaging in remote sensing, spectral CT in material sciences as well as multi-contrast MRI and PET-MR in medicine.…

Image and Video Processing · Electrical Eng. & Systems 2020-12-25 Leon Bungert , Matthias J. Ehrhardt

Adoption of machine learning models in healthcare requires end users' trust in the system. Models that provide additional supportive evidence for their predictions promise to facilitate adoption. We define consistent evidence to be both…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Peiqi Wang , Ruizhi Liao , Daniel Moyer , Seth Berkowitz , Steven Horng , Polina Golland

Medical decision-making requires integrating diverse medical information, from imaging to clinical narratives. These medical modalities are often acquired in a many-to-many manner. However, current medical vision-language pretraining models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuan Gao , Sangwook Kim , Jianzhong You , Chris McIntosh

Evidence-based medicine (EBM) holds a crucial role in clinical application. Given suitable medical articles, doctors effectively reduce the incidence of misdiagnoses. Researchers find it efficient to use large language models (LLMs)…

Computation and Language · Computer Science 2025-11-07 Mengzhou Sun , Sendong Zhao , Jianyu Chen , Haochun Wang , Bing Qin

Interpretability is often an essential requirement in medical imaging. Advanced deep learning methods are required to address this need for explainability and high performance. In this work, we investigate whether additional information…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Luisa Gallee , Meinrad Beer , Michael Goetz

Models based on human-understandable concepts have received extensive attention to improve model interpretability for trustworthy artificial intelligence in the field of medical image analysis. These methods can provide convincing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Hongmei Wang , Junlin Hou , Hao Chen

Confidence estimation, a task that aims to evaluate the trustworthiness of the model's prediction output during deployment, has received lots of research attention recently, due to its importance for the safe deployment of deep models.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Haoxuan Qu , Yanchao Li , Lin Geng Foo , Jason Kuen , Jiuxiang Gu , Jun Liu

Joint embeddings between medical imaging modalities and associated radiology reports have the potential to offer significant benefits to the clinical community, ranging from cross-domain retrieval to conditional generation of reports to the…

Machine Learning · Computer Science 2018-11-28 Tzu-Ming Harry Hsu , Wei-Hung Weng , Willie Boag , Matthew McDermott , Peter Szolovits

Pathology reports are rich in clinical and pathological details but are often presented in free-text format. The unstructured nature of these reports presents a significant challenge limiting the accessibility of their content. In this…

Computation and Language · Computer Science 2024-11-28 Ethar Alzaid , Gabriele Pergola , Harriet Evans , David Snead , Fayyaz Minhas

Developing reliable and generalizable deep learning systems for medical imaging faces significant obstacles due to spurious correlations, data imbalances, and limited text annotations in datasets. Addressing these challenges requires…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Amar Kumar , Anita Kriz , Mohammad Havaei , Tal Arbel

Automatic medical image report generation has drawn growing attention due to its potential to alleviate radiologists' workload. Existing work on report generation often trains encoder-decoder networks to generate complete reports. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Jianmo Ni , Chun-Nan Hsu , Amilcare Gentili , Julian McAuley

Designing powerful tools that support cooking activities has rapidly gained popularity due to the massive amounts of available data, as well as recent advances in machine learning that are capable of analyzing them. In this paper, we…

Computation and Language · Computer Science 2018-05-01 Micael Carvalho , Rémi Cadène , David Picard , Laure Soulier , Nicolas Thome , Matthieu Cord

Deep learning models for pulmonary disease screening from Computed Tomography (CT) scans promise to alleviate the immense workload on radiologists. Still, their high computational cost, stemming from processing entire 3D volumes, remains a…

Image and Video Processing · Electrical Eng. & Systems 2026-03-19 Qian Shao , Bang Du , Yixuan Wu , Zepeng Li , Qiyuan Chen , Qianqian Tang , Jian Wu , Jintai Chen , Hongxia Xu

Cancer detection and prognosis relies heavily on medical imaging, particularly CT and PET scans. Deep Neural Networks (DNNs) have shown promise in tumor segmentation by fusing information from these modalities. However, a critical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Numan Saeed , Shahad Hardan , Muhammad Ridzuan , Nada Saadi , Karthik Nandakumar , Mohammad Yaqub

Multimodal retrieval systems are expected to operate in a semantic space, agnostic to the language or cultural origin of the query. In practice, however, retrieval outcomes systematically reflect perspectival biases: deviations shaped by…

Modeling multi-modal time-series data is critical for capturing system-level dynamics, particularly in biosignals where modalities such as ECG, PPG, EDA, and accelerometry provide complementary perspectives on interconnected physiological…

Machine Learning · Computer Science 2025-10-14 Wanting Mao , Maxwell A Xu , Harish Haresamudram , Mithun Saha , Santosh Kumar , James Matthew Rehg

Integrating multi-modal data to promote medical image analysis has recently gained great attention. This paper presents a novel scheme to learn the mutual benefits of different modalities to achieve better segmentation results for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jie Yang , Ye Zhu , Chaoqun Wang , Zhen Li , Ruimao Zhang

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Developing advanced medical imaging retrieval systems is challenging due to the varying definitions of `similar images' across different medical contexts. This challenge is compounded by the lack of large-scale, high-quality medical imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Tengfei Zhang , Ziheng Zhao , Chaoyi Wu , Xiao Zhou , Ya Zhang , Yanfeng Wang , Weidi Xie