中文
相关论文

相关论文: MMLN: Leveraging Domain Knowledge for Multimodal D…

200 篇论文

Effective recognition of acute and difficult-to-heal wounds is a necessary step in wound diagnosis. An efficient classification model can help wound specialists classify wound types with less financial and time costs and also help in…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Ramin Mousa , Hadis Taherinia , Khabiba Abdiyeva , Amir Ali Bengari , Mohammadmahdi Vahediahmar

Machine learning and computer vision methods are showing good performance in medical imagery analysis. Yetonly a few applications are now in clinical use and one of the reasons for that is poor transferability of themodels to data from…

图像与视频处理 · 电气工程与系统科学 2020-10-15 Ekaterina Kondrateva , Marina Pominova , Elena Popova , Maxim Sharaev , Alexander Bernstein , Evgeny Burnaev

While deep learning methods have shown great success in medical image analysis, they require a number of medical images to train. Due to data privacy concerns and unavailability of medical annotators, it is oftentimes very difficult to…

图像与视频处理 · 电气工程与系统科学 2020-10-08 Yue Yang , Pengtao Xie

Large vision-language models (LVLMs) have shown great promise in medical applications, particularly in visual question answering (MedVQA) and diagnosis from medical images. However, existing datasets and models often fail to consider…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Linjie Mu , Zhongzhen Huang , Shengqian Qin , Yakun Zhu , Shaoting Zhang , Xiaofan Zhang

The large-scale pre-trained vision language models (VLM) have shown remarkable domain transfer capability on natural images. However, it remains unknown whether this capability can also apply to the medical image domain. This paper…

计算机视觉与模式识别 · 计算机科学 2023-02-08 Ziyuan Qin , Huahui Yi , Qicheng Lao , Kang Li

The success of deep learning models deployed in the real world depends critically on their ability to generalize well across diverse data domains. Here, we address a fundamental challenge with selective classification during automated…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Anuj Srivastava , Karm Patel , Pradeep Shenoy , Devarajan Sridharan

Reliable interpretation of multimodal data in dentistry is essential for automated oral healthcare, yet current multimodal large language models (MLLMs) struggle to capture fine-grained dental visual details and lack sufficient reasoning…

The conventional pretraining-and-finetuning paradigm, while effective for common diseases with ample data, faces challenges in diagnosing data-scarce occupational diseases like pneumoconiosis. Recently, large language models (LLMs) have…

Pneumonia has been one of the major causes of morbidities and mortality in the world and the prevalence of this disease is disproportionately high among the pediatric and elderly populations especially in resources trained areas Fast and…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Sathish Krishna Anumula , Vetrivelan Tamilmani , Aniruddha Arjun Singh , Dinesh Rajendran , Venkata Deepak Namburi

Deep learning has shown remarkable results for image analysis and is expected to aid individual treatment decisions in health care. To achieve this, deep learning methods need to be promoted from the level of mere associations to being able…

机器学习 · 计算机科学 2022-05-02 Wouter A. C. van Amsterdam , Marinus J. C. Eijkemans

In this paper, we examine the strength of deep learning technique for diagnosing lung cancer on medical image analysis problem. Convolutional neural networks (CNNs) models become popular among the pattern recognition and computer vision…

计算机视觉与模式识别 · 计算机科学 2018-04-24 Mehdi Fatan Serj , Bahram Lavi , Gabriela Hoff , Domenec Puig Valls

Recently, biomedical version of embeddings obtained from language models such as BioELMo have shown state-of-the-art results for the textual inference task in the medical domain. In this paper, we explore how to incorporate structured…

计算与语言 · 计算机科学 2021-09-07 Soumya Sharma , Bishal Santra , Abhik Jana , T. Y. S. S. Santosh , Niloy Ganguly , Pawan Goyal

Lung cancer is the leading cause of cancer death and morbidity worldwide. Many studies have shown machine learning models to be effective at detecting lung nodules from chest X-ray images. However, these techniques have yet to be embraced…

图像与视频处理 · 电气工程与系统科学 2021-08-31 Michael J. Horry , Subrata Chakraborty , Biswajeet Pradhan , Manoranjan Paul , Douglas P. S. Gomes , Anwaar Ul-Haq

State of the art models using deep neural networks have become very good in learning an accurate mapping from inputs to outputs. However, they still lack generalization capabilities in conditions that differ from the ones encountered during…

计算与语言 · 计算机科学 2018-08-28 Alexey Romanov , Chaitanya Shivade

Automatic radiology report generation can alleviate the workload for physicians and minimize regional disparities in medical resources, therefore becoming an important topic in the medical image analysis field. It is a challenging task, as…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Xinyi Wang , Grazziela Figueredo , Ruizhe Li , Wei Emma Zhang , Weitong Chen , Xin Chen

Diagnostic prediction and clinical reasoning are critical tasks in healthcare applications. While Large Language Models (LLMs) have shown strong capabilities in commonsense reasoning, they still struggle with diagnostic reasoning due to…

Knowledge sharing is crucial in healthcare, especially when leveraging data from multiple clinical sites to address data scarcity, reduce costs, and enable timely interventions. Transfer learning can facilitate cross-site knowledge…

计算与语言 · 计算机科学 2024-09-24 Yuhe Gao , Runxue Bao , Yuelyu Ji , Yiming Sun , Chenxi Song , Jeffrey P. Ferraro , Ye Ye

Multimodal learning, a rapidly evolving field in artificial intelligence, seeks to construct more versatile and robust systems by integrating and analyzing diverse types of data, including text, images, audio, and video. Inspired by the…

Graph neural networks (GNNs) are powerful machine learning models designed to handle irregularly structured data. However, their generic design often proves inadequate for analyzing brain connectomes in Alzheimer's Disease (AD),…

机器学习 · 计算机科学 2024-12-10 Zhepeng Wang , Runxue Bao , Yawen Wu , Guodong Liu , Lei Yang , Liang Zhan , Feng Zheng , Weiwen Jiang , Yanfu Zhang

The differential diagnosis of neurodegenerative dementias is a challenging clinical task, mainly because of the overlap in symptom presentation and the similarity of patterns observed in structural neuroimaging. To improve diagnostic…

机器学习 · 计算机科学 2025-05-27 Andrew Zamai , Nathanael Fijalkow , Boris Mansencal , Laurent Simon , Eloi Navet , Pierrick Coupe