English
Related papers

Related papers: MMLN: Leveraging Domain Knowledge for Multimodal D…

200 papers

Effective recognition of acute and difficult-to-heal wounds is a necessary step in wound diagnosis. An efficient classification model can help wound specialists classify wound types with less financial and time costs and also help in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Ramin Mousa , Hadis Taherinia , Khabiba Abdiyeva , Amir Ali Bengari , Mohammadmahdi Vahediahmar

Machine learning and computer vision methods are showing good performance in medical imagery analysis. Yetonly a few applications are now in clinical use and one of the reasons for that is poor transferability of themodels to data from…

Image and Video Processing · Electrical Eng. & Systems 2020-10-15 Ekaterina Kondrateva , Marina Pominova , Elena Popova , Maxim Sharaev , Alexander Bernstein , Evgeny Burnaev

While deep learning methods have shown great success in medical image analysis, they require a number of medical images to train. Due to data privacy concerns and unavailability of medical annotators, it is oftentimes very difficult to…

Image and Video Processing · Electrical Eng. & Systems 2020-10-08 Yue Yang , Pengtao Xie

Large vision-language models (LVLMs) have shown great promise in medical applications, particularly in visual question answering (MedVQA) and diagnosis from medical images. However, existing datasets and models often fail to consider…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Linjie Mu , Zhongzhen Huang , Shengqian Qin , Yakun Zhu , Shaoting Zhang , Xiaofan Zhang

The large-scale pre-trained vision language models (VLM) have shown remarkable domain transfer capability on natural images. However, it remains unknown whether this capability can also apply to the medical image domain. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Ziyuan Qin , Huahui Yi , Qicheng Lao , Kang Li

The success of deep learning models deployed in the real world depends critically on their ability to generalize well across diverse data domains. Here, we address a fundamental challenge with selective classification during automated…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Anuj Srivastava , Karm Patel , Pradeep Shenoy , Devarajan Sridharan

Reliable interpretation of multimodal data in dentistry is essential for automated oral healthcare, yet current multimodal large language models (MLLMs) struggle to capture fine-grained dental visual details and lack sufficient reasoning…

The conventional pretraining-and-finetuning paradigm, while effective for common diseases with ample data, faces challenges in diagnosing data-scarce occupational diseases like pneumoconiosis. Recently, large language models (LLMs) have…

Image and Video Processing · Electrical Eng. & Systems 2024-07-02 Meiyue Song , Zhihua Yu , Jiaxin Wang , Jiarui Wang , Yuting Lu , Baicun Li , Xiaoxu Wang , Qinghua Huang , Zhijun Li , Nikolaos I. Kanellakis , Jiangfeng Liu , Jing Wang , Binglu Wang , Juntao Yang

Pneumonia has been one of the major causes of morbidities and mortality in the world and the prevalence of this disease is disproportionately high among the pediatric and elderly populations especially in resources trained areas Fast and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Sathish Krishna Anumula , Vetrivelan Tamilmani , Aniruddha Arjun Singh , Dinesh Rajendran , Venkata Deepak Namburi

Deep learning has shown remarkable results for image analysis and is expected to aid individual treatment decisions in health care. To achieve this, deep learning methods need to be promoted from the level of mere associations to being able…

Machine Learning · Computer Science 2022-05-02 Wouter A. C. van Amsterdam , Marinus J. C. Eijkemans

In this paper, we examine the strength of deep learning technique for diagnosing lung cancer on medical image analysis problem. Convolutional neural networks (CNNs) models become popular among the pattern recognition and computer vision…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Mehdi Fatan Serj , Bahram Lavi , Gabriela Hoff , Domenec Puig Valls

Recently, biomedical version of embeddings obtained from language models such as BioELMo have shown state-of-the-art results for the textual inference task in the medical domain. In this paper, we explore how to incorporate structured…

Computation and Language · Computer Science 2021-09-07 Soumya Sharma , Bishal Santra , Abhik Jana , T. Y. S. S. Santosh , Niloy Ganguly , Pawan Goyal

Lung cancer is the leading cause of cancer death and morbidity worldwide. Many studies have shown machine learning models to be effective at detecting lung nodules from chest X-ray images. However, these techniques have yet to be embraced…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Michael J. Horry , Subrata Chakraborty , Biswajeet Pradhan , Manoranjan Paul , Douglas P. S. Gomes , Anwaar Ul-Haq

State of the art models using deep neural networks have become very good in learning an accurate mapping from inputs to outputs. However, they still lack generalization capabilities in conditions that differ from the ones encountered during…

Computation and Language · Computer Science 2018-08-28 Alexey Romanov , Chaitanya Shivade

Automatic radiology report generation can alleviate the workload for physicians and minimize regional disparities in medical resources, therefore becoming an important topic in the medical image analysis field. It is a challenging task, as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xinyi Wang , Grazziela Figueredo , Ruizhe Li , Wei Emma Zhang , Weitong Chen , Xin Chen

Diagnostic prediction and clinical reasoning are critical tasks in healthcare applications. While Large Language Models (LLMs) have shown strong capabilities in commonsense reasoning, they still struggle with diagnostic reasoning due to…

Computation and Language · Computer Science 2026-04-28 Yimin Deng , Zhenxi Lin , Yejing Wang , Guoshuai Zhao , Pengyue Jia , Zichuan Fu , Derong Xu , Yefeng Zheng , Xiangyu Zhao , Li Zhu , Xian Wu , Xueming Qian

Knowledge sharing is crucial in healthcare, especially when leveraging data from multiple clinical sites to address data scarcity, reduce costs, and enable timely interventions. Transfer learning can facilitate cross-site knowledge…

Computation and Language · Computer Science 2024-09-24 Yuhe Gao , Runxue Bao , Yuelyu Ji , Yiming Sun , Chenxi Song , Jeffrey P. Ferraro , Ye Ye

Multimodal learning, a rapidly evolving field in artificial intelligence, seeks to construct more versatile and robust systems by integrating and analyzing diverse types of data, including text, images, audio, and video. Inspired by the…

Artificial Intelligence · Computer Science 2024-12-24 Priyaranjan Pattnayak , Hitesh Laxmichand Patel , Bhargava Kumar , Amit Agarwal , Ishan Banerjee , Srikant Panda , Tejaswini Kumar

Graph neural networks (GNNs) are powerful machine learning models designed to handle irregularly structured data. However, their generic design often proves inadequate for analyzing brain connectomes in Alzheimer's Disease (AD),…

Machine Learning · Computer Science 2024-12-10 Zhepeng Wang , Runxue Bao , Yawen Wu , Guodong Liu , Lei Yang , Liang Zhan , Feng Zheng , Weiwen Jiang , Yanfu Zhang

The differential diagnosis of neurodegenerative dementias is a challenging clinical task, mainly because of the overlap in symptom presentation and the similarity of patterns observed in structural neuroimaging. To improve diagnostic…

Machine Learning · Computer Science 2025-05-27 Andrew Zamai , Nathanael Fijalkow , Boris Mansencal , Laurent Simon , Eloi Navet , Pierrick Coupe