English
Related papers

Related papers: MMLN: Leveraging Domain Knowledge for Multimodal D…

200 papers

Understanding brain disorders is crucial for accurate clinical diagnosis and treatment. Recent advances in Multimodal Large Language Models (MLLMs) offer a promising approach to interpreting medical images with the support of text…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Jing Zhang , Xiaowei Yu , Yanjun Lyu , Lu Zhang , Tong Chen , Chao Cao , Yan Zhuang , Minheng Chen , Tianming Liu , Dajiang Zhu

Automated depression diagnosis aims to analyze multimodal information from interview videos to predict participants' depression scores. Previous studies often lack clear explanations of how these scores were determined, limiting their…

Artificial Intelligence · Computer Science 2026-03-19 Wei Zhang , Juan Chen , En Zhu , Wenhong Cheng , YunPeng Li , Yanbo J. Wang

In recent years, advancements in deep learning techniques have considerably enhanced the efficiency and accuracy of medical diagnostics. In this work, a novel approach using multi-task learning (MTL) for the simultaneous classification of…

Machine Learning · Computer Science 2024-04-08 Suma K , Deepali Koppad , Preethi Kumar , Neha A Kantikar , Surabhi Ramesh

The use of deep learning (DL) in medical image analysis has significantly improved the ability to predict lung cancer. In this study, we introduce a novel deep convolutional neural network (CNN) model, named ResNet+, which is based on the…

Image and Video Processing · Electrical Eng. & Systems 2025-07-03 Ahmad Chaddad , Jihao Peng , Yihang Wu

Model-based approaches for image reconstruction, analysis and interpretation have made significant progress over the last decades. Many of these approaches are based on either mathematical, physical or biological models. A challenge for…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Daniel Rueckert , Julia A. Schnabel

Multimodal large models have shown great potential in automating pathology image analysis. However, current multimodal models for gastrointestinal pathology are constrained by both data quality and reasoning transparency: pervasive noise…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Minxi Ouyang , Lianghui Zhu , Yaqing Bao , Qiang Huang , Jingli Ouyang , Tian Guan , Xitong Ling , Jiawen Li , Song Duan , Wenbin Dai , Li Zheng , Xuemei Zhang , Yonghong He

The large-scale development of large language models (LLMs) in medical contexts, such as diagnostic assistance and treatment recommendations, necessitates that these models possess accurate medical knowledge and deliver traceable…

Artificial Intelligence · Computer Science 2025-08-12 Qiyuan Li , Haijiang Liu , Caicai Guo , Chao Gao , Deyu Chen , Meng Wang , Feng Gao , Frank van Harmelen , Jinguang Gu

Recent evolution in deep learning has proven its value for CT-based lung nodule classification. Most current techniques are intrinsically black-box systems, suffering from two generalizability issues in clinical practice. First,…

Image and Video Processing · Electrical Eng. & Systems 2022-02-28 Hanxiao Zhang , Liang Chen , Xiao Gu , Minghui Zhang , Yulei Qin , Feng Yao , Zhexin Wang , Yun Gu , Guang-Zhong Yang

We introduce a new computer aided detection and diagnosis system for lung cancer screening with low-dose CT scans that produces meaningful probability assessments. Our system is based entirely on 3D convolutional neural networks and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Onur Ozdemir , Rebecca L. Russell , Andrew A. Berlin

Deep learning, as a promising new area of machine learning, has attracted a rapidly increasing attention in the field of medical imaging. Compared to the conventional machine learning methods, deep learning requires no hand-tuned feature…

Quantitative Methods · Quantitative Biology 2016-11-29 He Yang , Hengyong Yu , Ge Wang

The task of multimodal cancer detection is to determine the locations and categories of lesions by using different imaging techniques, which is one of the key research methods for cancer diagnosis. Recently, deep learning-based object…

Image and Video Processing · Electrical Eng. & Systems 2023-12-06 Yan Tian , Zhaocheng Xu , Yujun Ma , Weiping Ding , Ruili Wang , Zhihong Gao , Guohua Cheng , Linyang He , Xuran Zhao

Recently deep learning has been witnessing widespread adoption in various medical image applications. However, training complex deep neural nets requires large-scale datasets labeled with ground truth, which are often unavailable in many…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Wentao Zhu , Yeeleng S. Vang , Yufang Huang , Xiaohui Xie

Breast cancer remains the most commonly diagnosed malignancy among women in the developed world. Early detection through mammography screening plays a pivotal role in reducing mortality rates. While computer-aided diagnosis (CAD) systems…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Shunjie-Fabian Zheng , Hyeonjun Lee , Thijs Kooi , Ali Diba

This work provides a strong baseline for the problem of multi-source multi-target domain adaptation and generalization in medical imaging. Using a diverse collection of ten chest X-ray datasets, we empirically demonstrate the benefits of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Li Yao , Jordan Prosky , Ben Covington , Kevin Lyman

In this study, we focus on automated approaches to detect depression from clinical interviews using multi-modal machine learning (ML). Our approach differentiates from other successful ML methods such as context-aware analysis through…

Machine Learning · Computer Science 2024-12-30 Genevieve Lam , Huang Dongyan , Weisi Lin

Recent advancements in medical Large Language Models (LLMs) have showcased their powerful reasoning and diagnostic capabilities. Despite their success, current unified multimodal medical LLMs face limitations in knowledge update costs,…

Computation and Language · Computer Science 2025-06-25 Yucheng Zhou , Lingran Song , Jianbing Shen

This paper presents a review of deep learning (DL) based medical image registration methods. We summarized the latest developments and applications of DL-based registration methods in the medical field. These methods were classified into…

Image and Video Processing · Electrical Eng. & Systems 2020-12-02 Yabo Fu , Yang Lei , Tonghe Wang , Walter J. Curran , Tian Liu , Xiaofeng Yang

The widely used ChestX-ray14 dataset addresses an important medical image classification problem and has the following caveats: 1) many lung pathologies are visually similar, 2) a variant of diseases including lung cancer, tuberculosis, and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Zongyuan Ge , Dwarikanath Mahapatra , Suman Sedai , Rahil Garnavi , Rajib Chakravorty

The advent of deep learning has significantly propelled the capabilities of automated medical image diagnosis, providing valuable tools and resources in the realm of healthcare and medical diagnostics. This research delves into the…

Image and Video Processing · Electrical Eng. & Systems 2023-11-20 Ryan Donghan Kwon , Dohyun Lim , Yoonha Lee , Seung Won Lee

Recent advances in deep learning methods have come to define the state-of-the-art for many medical imaging applications, surpassing even human judgment in several tasks. Those models, however, when trained to reduce the empirical risk on a…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Christian S. Perone , Pedro Ballester , Rodrigo C. Barros , Julien Cohen-Adad