中文
相关论文

相关论文: MMLN: Leveraging Domain Knowledge for Multimodal D…

200 篇论文

Projecting visual features into word embedding space has become a significant fusion strategy adopted by Multimodal Large Language Models (MLLMs). However, its internal mechanisms have yet to be explored. Inspired by multilingual research,…

计算与语言 · 计算机科学 2025-05-21 Jiahao Huo , Yibo Yan , Boren Hu , Yutao Yue , Xuming Hu

Globally, there is a substantial unmet need to diagnose various diseases effectively. The complexity of the different disease mechanisms and underlying symptoms of the patient population presents massive challenges to developing the early…

机器学习 · 计算机科学 2022-01-03 Md Manjurul Ahsan , Zahed Siddique

Current machine learning methods for medical image analysis primarily focus on developing models tailored for their specific tasks, utilizing data within their target domain. These specialized models tend to be data-hungry and often exhibit…

图像与视频处理 · 电气工程与系统科学 2024-07-08 Ece Ozkan , Xavier Boix

Recent advances in artificial intelligence, particularly large language models LLMs, have shown promising capabilities in transforming rare disease research. This survey paper explores the integration of LLMs in the analysis of rare…

计算与语言 · 计算机科学 2025-05-26 Valentina Carbonari , Pierangelo Veltri , Pietro Hiram Guzzi

Retrieving visual and textual information from medical literature and hospital records can enhance diagnostic accuracy for clinical image interpretation. However, multimodal retrieval-augmented diagnosis is highly challenging. We explore a…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Nir Mazor , Tom Hope

In medical image analysis, the expertise scarcity and the high cost of data annotation limits the development of large artificial intelligence models. This paper investigates the potential of transfer learning with pre-trained…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Jiajin Zhang , Ge Wang , Mannudeep K. Kalra , Pingkun Yan

Machine learning (ML) applications in medical artificial intelligence (AI) systems have shifted from traditional and statistical methods to increasing application of deep learning models. This survey navigates the current landscape of…

机器学习 · 计算机科学 2024-01-23 Elisa Warner , Joonsang Lee , William Hsu , Tanveer Syeda-Mahmood , Charles Kahn , Olivier Gevaert , Arvind Rao

Oral cancer is frequently diagnosed at later stages due to its similarity to other lesions. Existing research on computer aided diagnosis has made progress using deep learning; however, most approaches remain limited by small, imbalanced…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Joy Naoum , Revana Salama , Ali Hamdi

This study investigates the effects of including patients' clinical information on the performance of deep learning (DL) classifiers for disease location in chest X-ray images. Although current classifiers achieve high performance using…

图像与视频处理 · 电气工程与系统科学 2023-12-29 Chihcheng Hsieh , Isabel Blanco Nobre , Sandra Costa Sousa , Chun Ouyang , Margot Brereton , Jacinto C. Nascimento , Joaquim Jorge , Catarina Moreira

In this paper, we consider the problem of disease diagnosis. Unlike the conventional learning paradigm that treats labels independently, we propose a knowledge-enhanced framework, that enables training visual representation with the…

计算机视觉与模式识别 · 计算机科学 2023-02-28 Chaoyi Wu , Xiaoman Zhang , Yanfeng Wang , Ya Zhang , Weidi Xie

Machine learning (ML) and deep learning (DL) techniques have been widely applied to analyze electroencephalography (EEG) signals for disease diagnosis and brain-computer interfaces (BCI). The integration of multimodal data has been shown to…

信号处理 · 电气工程与系统科学 2025-01-16 Siqi Zhao , Wangyang Li , Xiru Wang , Stevie Foglia , Hongzhao Tan , Bohan Zhang , Ameer Hamoodi , Aimee Nelson , Zhen Gao

Respiratory diseases remain major global health challenges, and traditional auscultation is often limited by subjectivity, environmental noise, and inter-clinician variability. This study presents an explainable multimodal deep learning…

声音 · 计算机科学 2025-12-02 S M Asiful Islam Saky , Md Rashidul Islam , Md Saiful Arefin , Shahaba Alam

Data is one of the essential ingredients to power deep learning research. Small datasets, especially specific to medical institutes, bring challenges to deep learning training stage. This work aims to develop a practical deep multimodal…

机器学习 · 计算机科学 2019-02-26 Faik Aydin , Maggie Zhang , Michelle Ananda-Rajah , Gholamreza Haffari

The recent development of imaging and sequencing technologies enables systematic advances in the clinical study of lung cancer. Meanwhile, the human mind is limited in effectively handling and fully utilizing the accumulation of such…

机器学习 · 计算机科学 2022-03-29 Yawei Li , Xin Wu , Ping Yang , Guoqian Jiang , Yuan Luo

This paper explores machine learning (ML) models for classifying lung cancer levels to improve diagnostic accuracy and prognosis. Through parameter tuning and rigorous evaluation, we assess various ML algorithms. Techniques like minimum…

人工智能 · 计算机科学 2024-12-05 Mohsen Asghari Ilani , Saba Moftakhar Tehran , Ashkan Kavei , Hamed Alizadegan

Deep learning (DL) models are being deployed at medical centers to aid radiologists for diagnosis of lung conditions from chest radiographs. Such models are often trained on a large volume of publicly available labeled radiographs. These…

计算机视觉与模式识别 · 计算机科学 2020-12-22 Abhishek K Dubey , Michael T Young , Christopher Stanley , Dalton Lunga , Jacob Hinkle

Advanced diagnostic instruments are crucial for the accurate detection and treatment of lung diseases, which affect millions of individuals globally. This study examines the effectiveness of deep learning and transfer learning models using…

图像与视频处理 · 电气工程与系统科学 2025-06-23 Shuvashis Sarker , Shamim Rahim Refat , Faika Fairuj Preotee , Tanvir Rouf Shawon , Raihan Tanvir

Lung disease poses a substantial global health challenge, with pneumonia being a prevalent concern. This research focuses on leveraging deep learning techniques to detect and assess pneumonia, addressing two interconnected objectives.…

计算机视觉与模式识别 · 计算机科学 2025-02-11 S Kumar Reddy Mallidi

Classifying chest radiographs is a time-consuming and challenging task, even for experienced radiologists. This provides an area for improvement due to the difficulty in precisely distinguishing between conditions such as pleural effusion,…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Maria Efimovich , Jayden Lim , Vedant Mehta , Ethan Poon

Deep learning has brought significant progress to medical image classification, yet most existing methods still rely on isolated visual evidence and cannot effectively leverage similar cases or external knowledge. In clinical practice,…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Yiming Xu , Yixuan Liu , Yuhang Zhang , Ling Zheng , Yihan Wang , Qi Song