English
Related papers

Related papers: VLAgeBench: Benchmarking Large Vision-Language Mod…

200 papers

Large vision-language models (LVLMs) have demonstrated remarkable achievements, yet the generation of non-factual responses remains prevalent in fact-seeking question answering (QA). Current multimodal fact-seeking benchmarks primarily…

Computation and Language · Computer Science 2025-03-11 Yanling Wang , Yihan Zhao , Xiaodong Chen , Shasha Guo , Lixin Liu , Haoyang Li , Yong Xiao , Jing Zhang , Qi Li , Ke Xu

Context-aware emotion recognition (CAER) is a complex and significant task that requires perceiving emotions from various contextual cues. Previous approaches primarily focus on designing sophisticated architectures to extract emotional…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Yuxuan Lei , Dingkang Yang , Zhaoyu Chen , Jiawei Chen , Peng Zhai , Lihua Zhang

Recent advances in multimodal large language models (MLLMs) have demonstrated strong capabilities in understanding general visual content. However, these general-domain MLLMs perform poorly in face perception tasks, often producing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Jingzhi Li , Changjiang Luo , Ruoyu Chen , Hua Zhang , Wenqi Ren , Jianhou Gan , Xiaochun Cao

Recent breakthroughs in large language models (LLMs) offer unprecedented natural language understanding and generation capabilities. However, existing surveys on LLMs in biomedicine often focus on specific applications or model…

Multimodal large language models (MLLMs) have shown remarkable performance in vision-language tasks. However, existing MLLMs are primarily trained on generic datasets, limiting their ability to reason on domain-specific visual cues such as…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Hatef Otroshi Shahreza , Sébastien Marcel

One of the main objectives in developing large vision-language models (LVLMs) is to engineer systems that can assist humans with multimodal tasks, including interpreting descriptions of perceptual experiences. A central phenomenon in this…

Computation and Language · Computer Science 2025-07-09 Amane Watahiki , Tomoki Doi , Taiga Shinozaki , Satoshi Nishida , Takuya Niikawa , Katsunori Miyahara , Hitomi Yanaka

A building's age of construction is crucial for supporting many geospatial applications. Much current research focuses on estimating building age from facade images using deep learning. However, building an accurate deep learning model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zichao Zeng , June Moh Goo , Xinglei Wang , Bin Chi , Meihui Wang , Jan Boehm

Large Vision-Language Models (LVLMs) have achieved remarkable progress on visual perception and linguistic interpretation. Despite their impressive capabilities across various tasks, LVLMs still suffer from the issue of hallucination, which…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Xingwei He , Qianru Zhang , A-Long Jin , Yuan Yuan , Siu-Ming Yiu

This paper explores the application of large language models (LLMs), like ChatGPT, for biometric tasks. We specifically examine the capabilities of ChatGPT in performing biometric-related tasks, with an emphasis on face recognition, gender…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Ahmad Hassanpour , Yasamin Kowsari , Hatef Otroshi Shahreza , Bian Yang , Sebastien Marcel

The automatic extraction of key-value information from handwritten documents is a key challenge in document analysis. A reliable extraction is a prerequisite for the mass digitization efforts of many archives. Large Vision Language Models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Fabian Wolf , Oliver Tüselmann , Arthur Matei , Lukas Hennies , Christoph Rass , Gernot A. Fink

Large Vision-Language Models (LVLMs) have achieved remarkable success, yet their significant computational demands hinder practical deployment. While efforts to improve LVLM efficiency are growing, existing methods lack comprehensive…

Computation and Language · Computer Science 2025-06-03 Zekun Wang , Minghua Ma , Zexin Wang , Rongchuan Mu , Liping Shan , Ming Liu , Bing Qin

Large Vision-Language Models (LVLMs) have become essential for advancing the integration of visual and linguistic information. However, the evaluation of LVLMs presents significant challenges as the evaluation benchmark always demands lots…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Han Bao , Yue Huang , Yanbo Wang , Jiayi Ye , Xiangqi Wang , Xiuying Chen , Yue Zhao , Tianyi Zhou , Mohamed Elhoseiny , Xiangliang Zhang

Vision Large Language Models (VLLMs) have demonstrated impressive capabilities in general visual tasks such as image captioning and visual question answering. However, their effectiveness in specialized, safety-critical domains like…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Tong Zeng , Longfeng Wu , Liang Shi , Dawei Zhou , Feng Guo

Systematic reviews are crucial for evidence-based medicine as they comprehensively analyse published research findings on specific questions. Conducting such reviews is often resource- and time-intensive, especially in the screening phase,…

Information Retrieval · Computer Science 2024-02-02 Shuai Wang , Harrisen Scells , Shengyao Zhuang , Martin Potthast , Bevan Koopman , Guido Zuccon

Humans develop perception through a bottom-up hierarchy: from basic primitives and Gestalt principles to high-level semantics. In contrast, current Multimodal Large Language Models (MLLMs) are trained directly on complex downstream tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jen-Tse Huang , Dasen Dai , Jen-Yuan Huang , Youliang Yuan , Xiaoyuan Liu , Wenxuan Wang , Wenxiang Jiao , Pinjia He , Zhaopeng Tu , Haodong Duan

Recently, Multimodal Large Language Models (MLLMs) have demonstrated exceptional capabilities in visual understanding and reasoning across various vision-language tasks. However, we found that MLLMs cannot process effectively from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Bangyan Li , Wenxuan Huang , Zhenkun Gao , Yeqiang Wang , Yunhang Shen , Jingzhong Lin , Ling You , Yuxiang Shen , Shaohui Lin , Wanli Ouyang , Yuling Sun

In the evolving landscape of multimodal language models, understanding the nuanced meanings conveyed through visual cues - such as satire, insult, or critique - remains a significant challenge. Existing evaluation benchmarks primarily focus…

Machine Learning · Computer Science 2025-02-25 Xiaofei Yin , Yijie Hong , Ya Guo , Yi Tu , Weiqiang Wang , Gongshen Liu , Huijia zhu

Large Vision-Language Models (LVLMs) have shown significant potential in assisting medical diagnosis by leveraging extensive biomedical datasets. However, the advancement of medical image understanding and reasoning critically depends on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Guohao Sun , Can Qin , Huazhu Fu , Linwei Wang , Zhiqiang Tao

Advancements in Multimodal Large Language Models (MLLMs) have significantly improved medical task performance, such as Visual Question Answering (VQA) and Report Generation (RG). However, the fairness of these models across diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Peiran Wu , Che Liu , Canyu Chen , Jun Li , Cosmin I. Bercea , Rossella Arcucci

In zero-shot image recognition tasks, humans demonstrate remarkable flexibility in classifying unseen categories by composing known simpler concepts. However, existing vision-language models (VLMs), despite achieving significant progress…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Hui Liu , Wenya Wang , Kecheng Chen , Jie Liu , Yibing Liu , Tiexin Qin , Peisong He , Xinghao Jiang , Haoliang Li