中文
相关论文

相关论文: MMLN: Leveraging Domain Knowledge for Multimodal D…

200 篇论文

Recently, lung nodule detection methods based on deep learning have shown excellent performance in the medical image processing field. Considering that only a few public lung datasets are available and lung nodules are more difficult to…

图像与视频处理 · 电气工程与系统科学 2024-03-08 Yujiang Chen , Mei Xie

Deep Learning has implemented a wide range of applications and has become increasingly popular in recent years. The goal of multimodal deep learning (MMDL) is to create models that can process and link information using various modalities.…

机器学习 · 计算机科学 2022-02-21 Jabeen Summaira , Xi Li , Amin Muhammad Shoib , Jabbar Abdul

Numerous Deep Learning (DL) classification models have been developed for a large spectrum of medical image analysis applications, which promises to reshape various facets of medical practice. Despite early advances in DL model validation…

图像与视频处理 · 电气工程与系统科学 2024-10-22 Sarah Matta , Mathieu Lamard , Philippe Zhang , Alexandre Le Guilcher , Laurent Borderie , Béatrice Cochener , Gwenolé Quellec

The accurate diagnosis of pathological subtypes of lung cancer is of paramount importance for follow-up treatments and prognosis managements. Assessment methods utilizing deep learning technologies have introduced novel approaches for…

图像与视频处理 · 电气工程与系统科学 2024-07-19 Yuan Jin , Gege Ma , Geng Chen , Tianling Lyu , Jan Egger , Junhui Lyu , Shaoting Zhang , Wentao Zhu

Machine learning enables the extraction of useful information from large, diverse datasets. However, despite many successful applications, machine learning continues to suffer from performance and transparency issues. These challenges can…

机器学习 · 计算机科学 2025-07-08 V. C. Storey , J. Parsons , A. Castellanos , M. Tremblay , R. Lukyanenko , W. Maass , A. Castillo

Flexible laryngoscopy is commonly performed by otolaryngologists to detect laryngeal diseases and to recognize potentially malignant lesions. Recently, researchers have introduced machine learning techniques to facilitate automated…

计算机视觉与模式识别 · 计算机科学 2023-05-29 Tianxiao Zhang , Andrés M. Bur , Shannon Kraft , Hannah Kavookjian , Bryan Renslo , Xiangyu Chen , Bo Luo , Guanghui Wang

We introduce LLMD, a large language model designed to analyze a patient's medical history based on their medical records. Along with domain knowledge, LLMD is trained on a large corpus of records collected over time and across facilities,…

Medical imaging is a cornerstone of therapy and diagnosis in modern medicine. However, the choice of imaging modality for a particular theranostic task typically involves trade-offs between the feasibility of using a particular modality…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Mayur Mallya , Ghassan Hamarneh

Multi-modal large language models (MLLMs) have shown promise in advancing healthcare. However, most existing models remain confined to single-image understanding, which greatly limits their applicability in clinical workflows. In practice,…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhen Chen , Yihang Fu , Gabriel Madera , Mauro Giuffre , Serina Applebaum , Hyunjae Kim , Hua Xu , Qingyu Chen

The imperative for early detection of type 2 diabetes mellitus (T2DM) is challenged by its asymptomatic onset and dependence on suboptimal clinical diagnostic tests, contributing to its widespread global prevalence. While research into…

机器学习 · 计算机科学 2024-12-17 Sanjana Gundapaneni , Zhuo Zhi , Miguel Rodrigues

Lung cancer is the leading cause of cancer death worldwide. The critical reason for the deaths is delayed diagnosis and poor prognosis. With the accelerated development of deep learning techniques, it has been successfully applied…

图像与视频处理 · 电气工程与系统科学 2021-06-15 Yujiao Wu , Jie Ma , Xiaoshui Huang , Sai Ho Ling , Steven Weidong Su

Representation learning offers a conduit to elucidate distinctive features within the latent space and interpret the deep models. However, the randomness of lesion distribution and the complexity of low-quality factors in medical images…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Qingshan Hou , Shuai Cheng , Peng Cao , Jinzhu Yang , Xiaoli Liu , Osmar R. Zaiane , Yih Chung Tham

Machine learning techniques used in computer-aided medical image analysis usually suffer from the domain shift problem caused by different distributions between source/reference data and target data. As a promising solution, domain…

计算机视觉与模式识别 · 计算机科学 2021-10-26 Hao Guan , Mingxia Liu

Lung cancer remains one of the leading causes of morbidity and mortality worldwide, making early diagnosis critical for improving therapeutic outcomes and patient prognosis. Computer-aided diagnosis systems, which analyze computed…

图像与视频处理 · 电气工程与系统科学 2025-06-23 Guohui Cai , Ying Cai , Zeyu Zhang , Yuanzhouhan Cao , Lin Wu , Daji Ergu , Zhinbin Liao , Yang Zhao

Deep learning-based computer-aided diagnosis is gradually deployed to review and analyze medical images. However, this paradigm is restricted in real-world clinical applications due to the poor robustness and generalization. The issue is…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Yurong Chen

We consider a model-agnostic solution to the problem of Multi-Domain Learning (MDL) for multi-modal applications. Many existing MDL techniques are model-dependent solutions which explicitly require nontrivial architectural changes to…

计算机视觉与模式识别 · 计算机科学 2021-03-01 Anthony Sicilia , Xingchen Zhao , Davneet Minhas , Erin O'Connor , Howard Aizenstein , William Klunk , Dana Tudorascu , Seong Jae Hwang

Multimodal deep learning utilizing imaging and diagnostic reports has made impressive progress in the field of medical imaging diagnostics, demonstrating a particularly strong capability for auxiliary diagnosis in cases where sufficient…

计算机视觉与模式识别 · 计算机科学 2024-08-21 Hao Yang , Hong-Yu Zhou , Cheng Li , Weijian Huang , Jiarun Liu , Yong Liang , Guangming Shi , Hairong Zheng , Qiegen Liu , Shanshan Wang

Lung disease is common throughout the world. These include chronic obstructive pulmonary disease, pneumonia, asthma, tuberculosis, fibrosis, etc. Timely diagnosis of lung disease is essential. Many image processing and machine learning…

图像与视频处理 · 电气工程与系统科学 2021-01-13 Subrato Bharati , Prajoy Podder , M. Rubaiyat Hossain Mondal

Deep learning-based models in medical imaging often struggle to generalize effectively to new scans due to data heterogeneity arising from differences in hardware, acquisition parameters, population, and artifacts. This limitation presents…

图像与视频处理 · 电气工程与系统科学 2023-08-09 Sebastian Nørgaard Llambias , Mads Nielsen , Mostafa Mehdipour Ghazi

MLLMs have recently become a focal point in the field of artificial intelligence research. Building on the strong capabilities of LLMs, MLLMs are adept at addressing complex multi-modal tasks. With the release of GPT-4, MLLMs have gained…

机器学习 · 计算机科学 2025-05-01 Jiarui Ye , Hao Tang