English
Related papers

Related papers: MiniGPT-Med: Large Language Model as a General Int…

200 papers

While recent advancements in Large Language Models have significantly advanced dermatological diagnosis, monolithic LLMs frequently struggle with fine-grained, large-scale multi-class diagnostic tasks and rare skin disease diagnosis owing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Zhangtianyi Chen , Yuhao Shen , Florensia Widjaja , Yan Xu , Liyuan Sun , Zijian Wang , Hongyi Chen , Wufei Dai , Juexiao Zhou

Medical image analysis is essential to clinical diagnosis and treatment, which is increasingly supported by multi-modal large language models (MLLMs). However, previous research has primarily focused on 2D medical images, leaving 3D images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Fan Bai , Yuxin Du , Tiejun Huang , Max Q. -H. Meng , Bo Zhao

Artificial intelligence (AI) has transformed medical imaging, with computer vision (CV) systems achieving state-of-the-art performance in classification and detection tasks. However, these systems typically output structured predictions,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Trishna Niraula , Jonathan Stubblefield

Medical image diagnosis is challenging because many diseases resemble normal anatomy and exhibit substantial interpatient variability. Clinicians routinely rely on comparative diagnosis, such as referencing cross-patient healthy control…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Ruinan Jin , Gexin Huang , Xinwei Shen , Qiong Zhang , Yan Shuo Tan , Xiaoxiao Li

Large Language Models (LLMs) have introduced a new era of proficiency in comprehending complex healthcare and biomedical topics. However, there is a noticeable lack of models in languages other than English and models that can interpret…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Junling Liu , Ziming Wang , Qichen Ye , Dading Chong , Peilin Zhou , Yining Hua

Multimodal Large Language Models (MLLMs) have tremendous potential to improve the accuracy, availability, and cost-effectiveness of healthcare by providing automated solutions or serving as aids to medical professionals. Despite promising…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Mohammad Shahab Sepehri , Zalan Fabian , Maryam Soltanolkotabi , Mahdi Soltanolkotabi

Multimodal Large Language Models (MLLMs) have exhibited immense potential across numerous medical specialties; yet, dentistry remains underexplored, in part due to limited domain-specific data, scarce dental expert annotations, insufficient…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jing Hao , Yuci Liang , Lizhuo Lin , Yuxuan Fan , Wenkai Zhou , Kaixin Guo , Zanting Ye , Yanpeng Sun , Xinyu Zhang , Yanqi Yang , Qiankun Li , Hao Tang , James Kit-Hon Tsoi , Linlin Shen , Kuo Feng Hung

Large language models (LLMs) have emerged as powerful tools for medical information retrieval, yet their accuracy and depth remain limited in specialized domains such as Alzheimer's disease (AD), a growing global health challenge. To…

Free-text radiology reports present a rich data source for various medical tasks, but effectively labeling these texts remains challenging. Traditional rule-based labeling methods fall short of capturing the nuances of diverse free-text…

Computation and Language · Computer Science 2024-11-07 Jawook Gu , Kihyun You , Han-Cheol Cho , Jiho Kim , Eun Kyoung Hong , Byungseok Roh

The integration of Artificial Intelligence (AI), especially Large Language Models (LLMs), into the clinical diagnosis process offers significant potential to improve the efficiency and accessibility of medical care. While LLMs have shown…

Computation and Language · Computer Science 2024-10-15 Mingyu Derek Ma , Chenchen Ye , Yu Yan , Xiaoxuan Wang , Peipei Ping , Timothy S Chang , Wei Wang

In recent years, large language models (LLMs) have demonstrated remarkable potential across various medical applications. Building on this foundation, multimodal large language models (MLLMs) integrate LLMs with visual models to process…

Computation and Language · Computer Science 2025-03-11 Xiaoyi Liang , Mouxiao Bian , Moxin Chen , Lihao Liu , Junjun He , Jie Xu , Lin Li

Computer-aided diagnosis systems hold great promise to aid radiologists and clinicians in radiological clinical practice and enhance diagnostic accuracy and efficiency. However, the conventional systems primarily focus on delivering…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Sheng Wang , Tianming Du , Katherine Fischer , Gregory E Tasian , Justin Ziemba , Joanie M Garratt , Hersh Sagreiya , Yong Fan

The emergence of Multimodal Large Language Models (MLLMs) has revolutionized image understanding by bridging textual and visual modalities. However, these models often struggle with capturing fine-grained semantic information, such as the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Jie Yang , Wang Zeng , Sheng Jin , Lumin Xu , Wentao Liu , Chen Qian , Zhen Li , Ruimao Zhang

This paper explores the advancements and applications of large-scale models in the medical field, with a particular focus on Medical Large Models (MedLMs). These models, encompassing Large Language Models (LLMs), Vision Models, 3D Large…

Artificial Intelligence · Computer Science 2025-10-08 YunHe Su , Zhengyang Lu , Junhui Liu , Ke Pang , Haoran Dai , Sa Liu , Yuxin Jia , Lujia Ge , Jing-min Yang

With the advent of large language models (LLMs), in both the open source and proprietary domains, attention is turning to how to exploit such artificial intelligence (AI) systems in assisting complex scientific tasks, such as material…

Human-Computer Interaction · Computer Science 2024-01-26 Yongtao Liu , Marti Checa , Rama K. Vasudevan

Multimodal Large Language Models (LLMs) introduce an emerging paradigm for medical imaging by interpreting scans through the lens of extensive clinical knowledge, offering a transformative approach to disease classification. This study…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Md. Sazzadul Islam Prottasha , Nabil Walid Rafi

The application of artificial intelligence (AI) in IVF has shown promise in improving consistency and standardization of decisions, but often relies on annotated data and does not make use of the multimodal nature of IVF data. We…

Artificial Intelligence · Computer Science 2026-04-24 Nicklas Neu , Thomas Ebner , Jasmin Primus , Raphael Zefferer , Bernhard Schenkenfelder , Mathias Brunbauer , Florian Kromp

Radiology reporting generative AI holds significant potential to alleviate clinical workloads and streamline medical care. However, achieving high clinical accuracy is challenging, as radiological images often feature subtle lesions and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yijian Gao , Dominic Marshall , Xiaodan Xing , Junzhi Ning , Giorgos Papanastasiou , Guang Yang , Matthieu Komorowski

Recent advancements in Vision Language Models (VLMs) have demonstrated remarkable promise in generating visually grounded responses. However, their application in the medical domain is hindered by unique challenges. For instance, most VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Lingxiao Luo , Bingda Tang , Xuanzhong Chen , Rong Han , Ting Chen

Healthcare systems around the world are grappling with issues like inefficient diagnostics, rising costs, and limited access to specialists. These problems often lead to delays in treatment and poor health outcomes. Most current AI and deep…

Artificial Intelligence · Computer Science 2025-12-22 Maliha Tabassum , M Shamim Kaiser