中文
相关论文

相关论文: Can Large Vision-Language Models Understand Multim…

200 篇论文

Large-scale Vision-Language Models (LVLMs) have significantly advanced with text-aligned vision inputs. They have made remarkable progress in computer vision tasks by aligning text modality with vision inputs. There are also endeavors to…

计算机视觉与模式识别 · 计算机科学 2024-10-14 Youngjoon Yu , Sangyun Chung , Byung-Kwan Lee , Yong Man Ro

Large vision-language models (LVLMs) have demonstrated remarkable achievements, yet the generation of non-factual responses remains prevalent in fact-seeking question answering (QA). Current multimodal fact-seeking benchmarks primarily…

计算与语言 · 计算机科学 2025-03-11 Yanling Wang , Yihan Zhao , Xiaodong Chen , Shasha Guo , Lixin Liu , Haoyang Li , Yong Xiao , Jing Zhang , Qi Li , Ke Xu

Recent Large Vision-Language Models (LVLMs) have shown promising reasoning capabilities on text-rich images from charts, tables, and documents. However, the abundant text within such images may increase the model's sensitivity to language.…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Xinmiao Yu , Xiaocheng Feng , Yun Li , Minghui Liao , Ya-Qi Yu , Xiachong Feng , Weihong Zhong , Ruihan Chen , Mengkang Hu , Jihao Wu , Dandan Tu , Duyu Tang , Bing Qin

Usability evaluation is an essential method to support the design of effective and intuitive user interfaces (UIs). However, it commonly relies on resource-intensive, expert-driven methods, which limit its accessibility, especially for…

The introduction of the MUStARD dataset, and its emotion recognition extension MUStARD++, have identified sarcasm to be a multi-modal phenomenon -- expressed not only in natural language text, but also through manners of speech (like…

Large Vision-Language Models (LVLMs) have shown promising performance in vision-language understanding and reasoning tasks. However, their visual understanding behaviors remain underexplored. A fundamental question arises: to what extent do…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Xiaoying Xing , Chia-Wen Kuo , Li Fuxin , Yulei Niu , Fan Chen , Ming Li , Ying Wu , Longyin Wen , Sijie Zhu

Multimodal sentiment analysis aims to recognize people's attitudes from multiple communication channels such as verbal content (i.e., text), voice, and facial expressions. It has become a vibrant and important research topic in natural…

机器学习 · 计算机科学 2022-02-23 Xingbo Wang , Jianben He , Zhihua Jin , Muqiao Yang , Yong Wang , Huamin Qu

Sarcasm detection remains a significant challenge due to its reliance on nuanced contextual understanding, world knowledge, and multi-faceted linguistic cues that vary substantially across different sarcastic expressions. Existing…

计算与语言 · 计算机科学 2026-01-27 Ziyang Zhou , Ziqi Liu , Yan Wang , Yiming Lin , Yangbin Chen

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

The rapid integration of Large Vision-Language Models (LVLMs) into critical domains necessitates comprehensive moral evaluation to ensure their alignment with human values. While extensive research has addressed moral evaluation in LLMs,…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Bei Yan , Jie Zhang , Zhiyuan Chen , Shiguang Shan , Xilin Chen

Sarcasm is a form of speech in which speakers say the opposite of what they truly mean in order to convey a strong sentiment. In other words, "Sarcasm is the giant chasm between what I say, and the person who doesn't get it.". In this paper…

计算与语言 · 计算机科学 2017-04-25 Lotem Peled , Roi Reichart

Large language models (LLMs) have demonstrated significant capabilities in mathematical reasoning, particularly with text-based mathematical problems. However, current multi-modal large language models (MLLMs), especially those specialized…

计算与语言 · 计算机科学 2024-12-03 Zhen Yang , Jinhao Chen , Zhengxiao Du , Wenmeng Yu , Weihan Wang , Wenyi Hong , Zhihuan Jiang , Bin Xu , Jie Tang

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

机器学习 · 计算机科学 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

The enormous use of sarcastic text in all forms of communication in social media will have a physiological effect on target users. Each user has a different approach to misusing and recognising sarcasm. Sarcasm detection is difficult even…

计算与语言 · 计算机科学 2023-04-19 Swapnil Mane , Vaibhav Khatavkar

The rapid adoption of large vision-language models (LVLMs) in recent years has been accompanied by growing fairness concerns due to their propensity to reinforce harmful societal stereotypes. While significant attention has been paid to…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Phillip Howard , Xin Su , Kathleen C. Fraser

Multimodal Large Language Models (MLLMs) have demonstrated strong performance across a wide range of vision-language tasks, yet their internal processing dynamics remain underexplored. In this work, we introduce a probing framework to…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Zhuoran Yu , Yong Jae Lee

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities across diverse tasks, garnering significant attention in AI communities. However, their performance and reliability in specialized domains…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Yang Nan , Huichi Zhou , Xiaodan Xing , Guang Yang

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored. To address this gap, we introduce a novel benchmark that…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Mingwei Zhu , Leigang Sha , Yu Shu , Kangjia Zhao , Tiancheng Zhao , Jianwei Yin

We introduce a deep neural network for automated sarcasm detection. Recent work has emphasized the need for models to capitalize on contextual features, beyond lexical and syntactic cues present in utterances. For example, different…

计算与语言 · 计算机科学 2016-07-06 Silvio Amir , Byron C. Wallace , Hao Lyu , Paula Carvalho Mário J. Silva

Remote Sensing Visual Question Answering (RSVQA) is a challenging task that involves interpreting complex satellite imagery to answer natural language questions. Traditional approaches often rely on separate visual feature extractors and…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Surasakdi Siripong , Apirak Chaiyapan , Thanakorn Phonchai