中文
相关论文

相关论文: Evaluating Multimodal Large Language Models for He…

200 篇论文

As generative AI continues to evolve, Vision Language Models (VLMs) have emerged as promising tools in various healthcare applications. One area that remains relatively underexplored is their use in human activity recognition (HAR) for…

计算与语言 · 计算机科学 2025-11-18 Abderrazek Abid , Thanh-Cong Ho , Fakhri Karray

Remote sensing has evolved from simple image acquisition to complex systems capable of integrating and processing visual and textual data. This review examines the development and application of multi-modal language models (MLLMs) in remote…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Xintian Sun , Benji Peng , Charles Zhang , Fei Jin , Qian Niu , Junyu Liu , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Ming Liu , Xinyuan Song , Yichao Zhang

With the increasing application of large language models (LLMs) in the medical domain, evaluating these models' performance using benchmark datasets has become crucial. This paper presents a comprehensive survey of various benchmark…

Face recognition systems are increasingly vulnerable to morphing attacks, where a composite image is crafted to match multiple identities, enabling unauthorized access and identity fraud. Existing detection methods identify morphed images…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Nitish Shukla , Arun Ross

The revolutionary capabilities of large language models (LLMs) have paved the way for multimodal large language models (MLLMs) and fostered diverse applications across various specialized domains. In the remote sensing (RS) field, however,…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Dilxat Muhtar , Zhenshi Li , Feng Gu , Xueliang Zhang , Pengfeng Xiao

Large language models (LLMs) have substantially advanced machine learning research, including natural language processing, computer vision, data mining, etc., yet they still exhibit critical limitations in explainability, reliability,…

机器学习 · 计算机科学 2025-09-19 Xin Wang , Haoyang Li , Haibo Chen , Zeyang Zhang , Wenwu Zhu

Although face recognition systems have achieved impressive performance in recent years, the low-resolution face recognition (LRFR) task remains challenging, especially when the LR faces are captured under non-ideal conditions, as is common…

计算机视觉与模式识别 · 计算机科学 2019-04-01 Pei Li , Loreto Prieto , Domingo Mery , Patrick Flynn

Vision-threatening eye diseases pose a major global health burden, with timely diagnosis limited by workforce shortages and restricted access to specialized care. While multimodal large language models (MLLMs) show promise for medical image…

Multimodal Large Language Models (MLLMs) have remarkably progressed in analyzing and understanding images. Despite these advancements, accurately regressing values in charts remains an underexplored area for MLLMs. For visualization, how do…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Rami Huu Nguyen , Kenichi Maeda , Mahsa Geshvadi , Daniel Haehn

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

多媒体 · 计算机科学 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

Multimodal large language models (MLLMs) combine visual and textual data for tasks such as image captioning and visual question answering. Proper uncertainty calibration is crucial, yet challenging, for reliable use in areas like healthcare…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Zijun Chen , Wenbo Hu , Guande He , Zhijie Deng , Zheng Zhang , Richang Hong

The prevalence of vision-threatening eye diseases is a significant global burden, with many cases remaining undiagnosed or diagnosed too late for effective treatment. Large vision-language models (LVLMs) have the potential to assist in…

计算机视觉与模式识别 · 计算机科学 2025-02-06 Zhenyue Qin , Yu Yin , Dylan Campbell , Xuansheng Wu , Ke Zou , Yih-Chung Tham , Ninghao Liu , Xiuzhen Zhang , Qingyu Chen

Multimodal Large Language Model (MLLMs) leverages Large Language Models as a cognitive framework for diverse visual-language tasks. Recent efforts have been made to equip MLLMs with visual perceiving and grounding capabilities. However,…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Junwen He , Yifan Wang , Lijun Wang , Huchuan Lu , Jun-Yan He , Jin-Peng Lan , Bin Luo , Xuansong Xie

Instruction-tuned large language models (LLMs) have demonstrated promising zero-shot generalization capabilities across various downstream tasks. Recent research has introduced multimodal capabilities to LLMs by integrating independently…

计算与语言 · 计算机科学 2023-11-29 Utsav Garg , Erhan Bas

The significant advancements in visual understanding and instruction following from Multimodal Large Language Models (MLLMs) have opened up more possibilities for broader applications in diverse and universal human-centric scenarios.…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Keliang Li , Zaifei Yang , Jiahe Zhao , Hongze Shen , Ruibing Hou , Hong Chang , Shiguang Shan , Xilin Chen

Multimodal large language models (MLLMs) have demonstrated promising results in a variety of tasks that combine vision and language. As these models become more integral to research and applications, conducting comprehensive evaluations of…

计算机视觉与模式识别 · 计算机科学 2024-06-06 Fuwen Luo , Chi Chen , Zihao Wan , Zhaolu Kang , Qidong Yan , Yingjie Li , Xiaolong Wang , Siyu Wang , Ziyue Wang , Xiaoyue Mi , Peng Li , Ning Ma , Maosong Sun , Yang Liu

The massive availability of cameras results in a wide variability of imaging conditions, producing large intra-class variations and a significant performance drop if heterogeneous images are compared for person recognition. However, as…

计算机视觉与模式识别 · 计算机科学 2022-03-31 Fernando Alonso-Fernandez , Kiran B. Raja , R. Raghavendra , Cristoph Busch , Josef Bigun , Ruben Vera-Rodriguez , Julian Fierrez

Large Language Models (LLMs) have achieved remarkable success and have been applied across various scientific fields, including chemistry. However, many chemical tasks require the processing of visual information, which cannot be…

Multimodal Large Language Models (MLLM) classification performance depends critically on evaluation protocol and ground truth quality. Studies comparing MLLMs with supervised and vision-language models report conflicting conclusions, and we…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Nikita Kisel , Illia Volkov , Klara Janouskova , Jiri Matas

In recent years, large language models have had a very impressive performance, which largely contributed to the development and application of artificial intelligence, and the parameters and performance of the models are still growing…

机器学习 · 计算机科学 2025-01-10 Xuran Zheng , Chang D. Yoo