English
Related papers

Related papers: Diagnosing Shoulder Disorders Using Multimodal Lar…

200 papers

Leveraging vast training data, multimodal large language models (MLLMs) have demonstrated formidable general visual comprehension capabilities and achieved remarkable performance across various tasks. However, their performance in visual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Chaohu Liu , Kun Yin , Haoyu Cao , Xinghua Jiang , Xin Li , Yinsong Liu , Deqiang Jiang , Xing Sun , Linli Xu

Multimodal large language models (MLLMs) have advanced clinical tasks for common conditions, but their performance on rare diseases remains largely untested. In rare-disease scenarios, clinicians often lack prior clinical knowledge, forcing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Junzhi Ning , Jiashi Lin , Yingying Fang , Wei Li , Jiyao Liu , Cheng Tang , Chenglong Ma , Wenhao Tang , Tianbin Li , Ziyan Huang , Guang Yang , Junjun He

Multimodal Large Language Models (MLLMs) have recently demonstrated strong performance on a wide range of vision-language tasks, raising interest in their potential use for biometric applications. In this paper, we conduct a systematic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Hatef Otroshi Shahreza , Anjith George , Sébastien Marcel

Vision-language models (VLMs) have demonstrated remarkable performance across a wide range of computer-vision tasks, sparking interest in their potential for digital health applications. Here, we apply VLMs to two fundamental challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Victor Li , Naveenraj Kamalakannan , Avinash Parnandi , Heidi Schambra , Carlos Fernandez-Granda

Accurate diagnosis of skin diseases remains a significant challenge due to the complex and diverse visual features present in dermatoscopic images, often compounded by a lack of interpretability in existing purely visual diagnostic models.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Kexin Yu , Zihan Xu , Jialei Xie , Carter Adams

Multimodal language models (MLMs) show promise for clinical decision support and diagnostic reasoning, raising the prospect of end-to-end automated medical image interpretation. However, clinicians are highly selective in adopting AI tools;…

Artificial Intelligence · Computer Science 2025-08-06 Mahtab Bigverdi , Wisdom Ikezogwo , Kevin Zhang , Hyewon Jeong , Mingyu Lu , Sungjae Cho , Linda Shapiro , Ranjay Krishna

Multimodal large language models (MLLMs) have achieved significant success in the general field of image processing. Their emerging task generalization and freeform conversational capabilities can greatly facilitate medical diagnostic…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Youzhu Jin , Yichen Zhang

Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in understanding common visual elements, largely due to their large-scale datasets and advanced training strategies. However, their effectiveness in medical…

Large Language Models (LLMs) are advancing into Multimodal LLMs (MLLMs), capable of processing image, audio, and video as well as text. Combining first-person video, MLLMs show promising potential for understanding human activities through…

Human-Computer Interaction · Computer Science 2025-04-09 Jun Rekimoto

Recent advancements in Large Multimodal Models (LMMs) have attracted interest in their generalization capability with only a few samples in the prompt. This progress is particularly relevant to the medical domain, where the quality and…

Computation and Language · Computer Science 2024-05-06 Seonhee Cho , Choonghan Kim , Jiho Lee , Chetan Chilkunda , Sujin Choi , Joo Heung Yoon

Multimodal Large Language Models (MLLMs) inherit the superior text understanding capabilities of LLMs and extend these capabilities to multimodal scenarios. These models achieve excellent results in the general domain of multimodal tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jinlong He , Pengfei Li , Gang Liu , Shenjun Zhong

Multimodal Large Language Models (MLLMs) have experienced significant advancements recently. Nevertheless, challenges persist in the accurate recognition and comprehension of intricate details within high-resolution images. Despite being…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Haogeng Liu , Quanzeng You , Xiaotian Han , Yiqi Wang , Bohan Zhai , Yongfei Liu , Yunzhe Tao , Huaibo Huang , Ran He , Hongxia Yang

Large Video Models (LVMs) build on the semantic capabilities of Large Language Models (LLMs) and vision modules by integrating temporal information to better understand dynamic video content. Despite their progress, LVMs are prone to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Garry Yang , Zizhe Chen , Man Hon Wong , Haoyu Lei , Yongqiang Chen , Zhenguo Li , Kaiwen Zhou , James Cheng

This survey presents a comprehensive analysis of the phenomenon of hallucination in multimodal large language models (MLLMs), also known as Large Vision-Language Models (LVLMs), which have demonstrated significant advancements and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Zechen Bai , Pichao Wang , Tianjun Xiao , Tong He , Zongbo Han , Zheng Zhang , Mike Zheng Shou

Multimodal large language models (MLLMs) have shown great potential in medical applications, yet existing benchmarks inadequately capture real-world clinical complexity. We introduce MEDSYN, a multilingual, multimodal benchmark of highly…

Computation and Language · Computer Science 2026-04-20 Boqi Chen , Xudong Liu , Jiachuan Peng , Marianne Frey-Marti , Bang Zheng , Kyle Lam , Lin Li , Jianing Qiu

The rise of short-form videos, characterized by diverse content, editing styles, and artifacts, poses substantial challenges for learning-based blind video quality assessment (BVQA) models. Multimodal large language models (MLLMs), renowned…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Wen Wen , Yilin Wang , Neil Birkbeck , Balu Adsumilli

Hyperkinetic movement disorders (HMDs) such as dystonia, tremor, chorea, myoclonus, and tics are disabling motor manifestations across childhood and adulthood. Their fluctuating, intermittent, and frequently co-occurring expressions hinder…

Medical Decision-Making (MDM) is a multi-faceted process that requires clinicians to assess complex multi-modal patient data patient, often collaboratively. Large Language Models (LLMs) promise to streamline this process by synthesizing…

Multimodal Large Language Models (MLLMs) have tremendous potential to improve the accuracy, availability, and cost-effectiveness of healthcare by providing automated solutions or serving as aids to medical professionals. Despite promising…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Mohammad Shahab Sepehri , Zalan Fabian , Maryam Soltanolkotabi , Mahdi Soltanolkotabi

Artificial Intelligence models have demonstrated significant success in diagnosing skin diseases, including cancer, showing the potential to assist clinicians in their analysis. However, the interpretability of model predictions must be…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Max Torop , Masih Eskandar , Nicholas Kurtansky , Jinyang Liu , Jochen Weber , Octavia Camps , Veronica Rotemberg , Jennifer Dy , Kivanc Kose