中文
相关论文

相关论文: Using Multi-modal Data for Improving Generalizabil…

200 篇论文

The ability to predict lung and heart based diseases using deep learning techniques is central to many researchers, particularly in the medical field around the world. In this paper, we present a unique outlook of a very familiar problem of…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Sairamvinay Vijayaraghavan , David Haddad , Shikun Huang , Seongwoo Choi

Multimodal deep learning has been used to predict clinical endpoints and diagnoses from clinical routine data. However, these models suffer from scaling issues: they have to learn pairwise interactions between each piece of information in…

Automatic radiology report generation is critical in clinics which can relieve experienced radiologists from the heavy workload and remind inexperienced radiologists of misdiagnosis or missed diagnose. Existing approaches mainly formulate…

图像与视频处理 · 电气工程与系统科学 2022-11-08 Shuxin Yang , Xian Wu , Shen Ge , Shaohua Kevin Zhou , Li Xiao

Multi-label classification of chest X-ray images is frequently performed using discriminative approaches, i.e. learning to map an image directly to its binary labels. Such approaches make it challenging to incorporate auxiliary information…

人工智能 · 计算机科学 2021-03-11 Anjany Sekuboyina , Daniel Oñoro-Rubio , Jens Kleesiek , Brandon Malone

Medical image interpretation is central to most clinical applications such as disease diagnosis, treatment planning, and prognostication. In clinical practice, radiologists examine medical images and manually compile their findings into…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Nurbanu Aksoy , Nishant Ravikumar , Alejandro F Frangi

Deep learning has brought significant progress to medical image classification, yet most existing methods still rely on isolated visual evidence and cannot effectively leverage similar cases or external knowledge. In clinical practice,…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Yiming Xu , Yixuan Liu , Yuhang Zhang , Ling Zheng , Yihan Wang , Qi Song

The continually increasing number of complex datasets each year necessitates ever improving machine learning methods for robust and accurate categorization of these data. This paper introduces Random Multimodel Deep Learning (RMDL): a new…

机器学习 · 计算机科学 2018-06-01 Kamran Kowsari , Mojtaba Heidarysafa , Donald E. Brown , Kiana Jafari Meimandi , Laura E. Barnes

Medical patient data is always multimodal. Images, text, age, gender, histopathological data are only few examples for different modalities in this context. Processing and integrating this multimodal data with deep learning based methods is…

人工智能 · 计算机科学 2025-09-11 Christian Gapp , Elias Tappeiner , Martin Welk , Rainer Schubert

Despite recent advances in medical vision-language pretraining, existing models still struggle to capture the diagnostic workflow: radiographs are typically treated as context-agnostic images, while radiologists' gaze -- a crucial cue for…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Kang Liu , Zhuoqi Ma , Siyu Liang , Yunan Li , Xiyue Gao , Chao Liang , Kun Xie , Qiguang Miao

When analysing screening mammograms, radiologists can naturally process information across two ipsilateral views of each breast, namely the cranio-caudal (CC) and mediolateral-oblique (MLO) views. These multiple related images provide…

计算机视觉与模式识别 · 计算机科学 2022-09-22 Yuanhong Chen , Hu Wang , Chong Wang , Yu Tian , Fengbei Liu , Michael Elliott , Davis J. McCarthy , Helen Frazer , Gustavo Carneiro

Data is one of the essential ingredients to power deep learning research. Small datasets, especially specific to medical institutes, bring challenges to deep learning training stage. This work aims to develop a practical deep multimodal…

机器学习 · 计算机科学 2019-02-26 Faik Aydin , Maggie Zhang , Michelle Ananda-Rajah , Gholamreza Haffari

Understanding radiologists' eye movement during Computed Tomography (CT) reading is crucial for developing effective interpretable computer-aided diagnosis systems. However, CT research in this area has been limited by the lack of publicly…

The potential of deep learning, especially in medical imaging, initiated astonishing results and improved the methodologies after every passing day. Deep learning in radiology provides the opportunity to classify, detect and segment…

计算机视觉与模式识别 · 计算机科学 2022-03-28 Shaheer Khan , Azib Farooq , Israr Khan , Muhammad Gulraiz Khan , Abdul Razzaq

Transformer-based deep learning models have demonstrated exceptional performance in medical imaging by leveraging attention mechanisms for feature representation and interpretability. However, these models are prone to learning spurious…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Shelley Zixin Shu , Haozhe Luo , Alexander Poellinger , Mauricio Reyes

The expansion of artificial intelligence (AI) in pathology tasks has intensified the demand for doctors' annotations in AI development. However, collecting high-quality annotations from doctors is costly and time-consuming, creating a…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Hongyan Gu , Zihan Yan , Ayesha Alvi , Brandon Day , Chunxu Yang , Zida Wu , Shino Magaki , Mohammad Haeri , Xiang 'Anthony' Chen

There are at least two categories of errors in radiology screening that can lead to suboptimal diagnostic decisions and interventions:(i)human fallibility and (ii)complexity of visual search. Computer aided diagnostic (CAD) tools are…

计算机视觉与模式识别 · 计算机科学 2018-10-15 Naji Khosravan , Haydar Celik , Baris Turkbey , Elizabeth Jones , Bradford Wood , Ulas Bagci

Medical imaging is a cornerstone of therapy and diagnosis in modern medicine. However, the choice of imaging modality for a particular theranostic task typically involves trade-offs between the feasibility of using a particular modality…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Mayur Mallya , Ghassan Hamarneh

Generating radiology reports is time-consuming and requires extensive expertise in practice. Therefore, reliable automatic radiology report generation is highly desired to alleviate the workload. Although deep learning techniques have been…

图像与视频处理 · 电气工程与系统科学 2019-07-24 Jianbo Yuan , Haofu Liao , Rui Luo , Jiebo Luo

Billions of X-ray images are taken worldwide each year. Machine learning, and deep learning in particular, has shown potential to help radiologists triage and diagnose images. However, deep learning requires large datasets with reliable…

图像与视频处理 · 电气工程与系统科学 2021-05-10 Christian Garbin , Pranav Rajpurkar , Jeremy Irvin , Matthew P. Lungren , Oge Marques

Automatic radiology report generation has been an attracting research problem towards computer-aided diagnosis to alleviate the workload of doctors in recent years. Deep learning techniques for natural image captioning are successfully…

计算机视觉与模式识别 · 计算机科学 2020-02-20 Yixiao Zhang , Xiaosong Wang , Ziyue Xu , Qihang Yu , Alan Yuille , Daguang Xu