中文
相关论文

相关论文: MMLN: Leveraging Domain Knowledge for Multimodal D…

200 篇论文

With the rapid growth of large language models (LLMs) and vision-language models (VLMs) in medicine, simply integrating clinical text and medical imaging does not guarantee reliable reasoning. Existing multimodal models often produce…

人工智能 · 计算机科学 2025-12-29 Zelin Zang , Wenyi Gu , Siqi Ma , Dan Yang , Yue Shen , Zhu Zhang , Guohui Fan , Wing-Kuen Ling , Fuji Yang

The research explores the utilization of a deep learning model employing an attention mechanism in medical text mining. It targets the challenge of analyzing unstructured text information within medical data. This research seeks to enhance…

计算与语言 · 计算机科学 2024-06-04 Lingxi Xiao , Muqing Li , Yinqiu Feng , Meiqi Wang , Ziyi Zhu , Zexi Chen

Medical images from different healthcare centers exhibit varied data distributions, posing significant challenges for adapting lung nodule detection due to the domain shift between training and application phases. Traditional unsupervised…

计算机视觉与模式识别 · 计算机科学 2024-08-05 Haifeng Zhao , Lixiang Jiang , Leilei Ma , Dengdi Sun , Yanping Fu

The application of machine learning in medicine and healthcare has led to the creation of numerous diagnostic and prognostic models. However, despite their success, current approaches generally issue predictions using data from a single…

机器学习 · 计算机科学 2025-05-13 Fergus Imrie , Stefan Denner , Lucas S. Brunschwig , Klaus Maier-Hein , Mihaela van der Schaar

Deep learning algorithms have demonstrated tremendous success on challenging medical imaging problems. However, post-deployment, these algorithms are susceptible to data distribution variations owing to \emph{limited data issues} and…

计算机视觉与模式识别 · 计算机科学 2018-12-05 Rahul Venkataramani , Hariharan Ravishankar , Saihareesh Anamandra

This study proposes a novel perspective on multimodal deep learning for biomedical signal classification, systematically analyzing how complementary feature domains impact model performance. While fusing multiple domains often presumes…

机器学习 · 计算机科学 2025-08-05 Timothy Oladunni , Alex Wong

Deep learning integration into medical imaging systems has transformed disease detection and diagnosis processes with a focus on pneumonia identification. The study introduces an intricate deep learning system using Convolutional Neural…

图像与视频处理 · 电气工程与系统科学 2025-10-02 P K Dutta , Anushri Chowdhury , Anouska Bhattacharyya , Shakya Chakraborty , Sujatra Dey

Chest imaging plays an essential role in diagnosing and predicting patients with COVID-19 with evidence of worsening respiratory status. Many deep learning-based approaches for pneumonia recognition have been developed to enable…

图像与视频处理 · 电气工程与系统科学 2024-01-17 Shengchao Chen , Sufen Ren , Guanjun Wang , Mengxing Huang , Chenyang Xue

Multimodal Large Language Models (MLLMs) have shown transformative potential in medical applications, yet their performance is hindered by conventional data curation strategies that rely on coarse-grained partitioning by modality or…

计算与语言 · 计算机科学 2026-04-29 Jianghang Lin , Haihua Yang , Deli Yu , Kai Wu , Kai Ye , Jinghao Lin , Zihan Wang , Yuhang Wu , Liujuan Cao

Accurate and interpretable multi-disease diagnosis remains a critical challenge in medical research, particularly when leveraging heterogeneous multimodal medical data. Current approaches often rely on single-modal data, limiting their…

图像与视频处理 · 电气工程与系统科学 2025-06-25 Yuting Zhang , Kaishen Yuan , Hao Lu , Yutao Yue , Jintai Chen , Kaishun Wu

Medical deep learning models depend heavily on domain-specific knowledge to perform well on knowledge-intensive clinical tasks. Prior work has primarily leveraged unimodal knowledge graphs, such as the Unified Medical Language System…

人工智能 · 计算机科学 2025-05-26 Xiaochen Wang , Yuan Zhong , Lingwei Zhang , Lisong Dai , Ting Wang , Fenglong Ma

Pulmonary diseases can cause severe respiratory problems, leading to sudden death if not treated timely. Many researchers have utilized deep learning systems to diagnose pulmonary disorders using chest X-rays (CXRs). However, such systems…

图像与视频处理 · 电气工程与系统科学 2022-01-17 Mehreen Sirshar , Taimur Hassan , Muhammad Usman Akram , Shoab Ahmed Khan

This study presents a multimodal AI framework designed for precisely classifying medical diagnostic images. Utilizing publicly available datasets, the proposed system compares the strengths of convolutional neural networks (CNNs) and…

图像与视频处理 · 电气工程与系统科学 2025-06-04 Shibbir Ahmed , Shahnewaz Karim Sakib , Anindya Bijoy Das

The integration of artificial intelligence in medical imaging has shown tremendous potential, yet the relationship between pre-trained knowledge and performance in cross-modality learning remains unclear. This study investigates how…

计算机视觉与模式识别 · 计算机科学 2025-02-20 Yang Yan , Bingqing Yue , Qiaxuan Li , Man Huang , Jingyu Chen , Zhenzhong Lan

The integration of multimodal Electronic Health Records (EHR) data has significantly improved clinical predictive capabilities. Leveraging clinical notes and multivariate time-series EHR, existing models often lack the medical context…

人工智能 · 计算机科学 2024-02-13 Yinghao Zhu , Changyu Ren , Shiyun Xie , Shukai Liu , Hangyuan Ji , Zixiang Wang , Tao Sun , Long He , Zhoujun Li , Xi Zhu , Chengwei Pan

The significant advancements in computational power cre- ate a vast opportunity for using Artificial Intelligence in different ap- plications of healthcare and medical science. A Hybrid FL-Enabled Ensemble Approach For Lung Disease…

Medical imaging is an essential tool in many areas of medical applications, used for both diagnosis and treatment. However, reading medical images and making diagnosis or treatment recommendations require specially trained medical…

计算机视觉与模式识别 · 计算机科学 2019-03-13 Wentao Zhu

In the medical field, accurate diagnosis of lung cancer is crucial for treatment. Traditional manual analysis methods have significant limitations in terms of accuracy and efficiency. To address this issue, this paper proposes a deep…

图像与视频处理 · 电气工程与系统科学 2025-01-10 Ziyang Gao , Yong Tian , Shih-Chi Lin , Junghua Lin

Diagnosis prediction is a critical task in healthcare, where timely and accurate identification of medical conditions can significantly impact patient outcomes. Traditional machine learning and deep learning models have achieved notable…

机器学习 · 计算机科学 2025-01-09 Qiuhao Lu , Rui Li , Elham Sagheb , Andrew Wen , Jinlian Wang , Liwei Wang , Jungwei W. Fan , Hongfang Liu

Federated learning is increasingly being explored in the field of medical imaging to train deep learning models on large scale datasets distributed across different data centers while preserving privacy by avoiding the need to transfer…

图像与视频处理 · 电气工程与系统科学 2021-12-21 Vishwa S Parekh , Shuhao Lai , Vladimir Braverman , Jeff Leal , Steven Rowe , Jay J Pillai , Michael A Jacobs