中文
相关论文

相关论文: Evaluating Open-Source Vision-Language Models for …

200 篇论文

Detecting bias in multimodal news requires models that reason over text--image pairs, not just classify text. In response, we present ViLBias, a VQA-style benchmark and framework for detecting and reasoning about bias in multimodal news.…

Multimodal large language models (MLLMs) have emerged as powerful tools for visual question answering (VQA), enabling reasoning and contextual understanding across visual and textual modalities. Despite their advancements, the evaluation of…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Nikitha SR

Vision-language models (VLMs) extend the conventional large language models by integrating visual data, enabling richer multimodal reasoning and significantly broadens the practical applications of AI. However, including visual inputs also…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Daulet Toibazar , Kesen Wang , Sherif Mohamed , Abdulaziz Al-Badawi , Abdulrahman Alfulayt , Pedro J. Moreno

Predicting context-dependent and non-literal utterances like sarcastic and ironic expressions still remains a challenging task in NLP, as it goes beyond linguistic patterns, encompassing common sense and shared knowledge as crucial…

计算与语言 · 计算机科学 2018-09-27 Suzana Ilić , Edison Marrese-Taylor , Jorge A. Balazs , Yutaka Matsuo

Vision-language models (VLMs) are typically composed of a vision encoder, e.g. CLIP, and a language model (LM) that interprets the encoded features to solve downstream tasks. Despite remarkable progress, VLMs are subject to several…

计算机视觉与模式识别 · 计算机科学 2024-04-11 Oğuzhan Fatih Kar , Alessio Tonioni , Petra Poklukar , Achin Kulshrestha , Amir Zamir , Federico Tombari

Effectively understanding urban scenes requires fine-grained spatial reasoning about objects, layouts, and depth cues. However, how well current vision-language models (VLMs), pretrained on general scenes, transfer these abilities to urban…

计算机视觉与模式识别 · 计算机科学 2025-09-01 Juneyoung Ro , Namwoo Kim , Yoonjin Yoon

This paper makes a simple increment to state-of-the-art in sarcasm detection research. Existing approaches are unable to capture subtle forms of context incongruity which lies at the heart of sarcasm. We explore if prior work can be…

计算与语言 · 计算机科学 2016-10-05 Aditya Joshi , Vaibhav Tripathi , Kevin Patel , Pushpak Bhattacharyya , Mark Carman

As a powerful all-weather Earth observation tool, synthetic aperture radar (SAR) remote sensing enables critical military reconnaissance, maritime surveillance, and infrastructure monitoring. Although Vision language models (VLMs) have made…

计算与语言 · 计算机科学 2025-03-05 Zhiming Ma , Xiayang Xiao , Sihao Dong , Peidong Wang , HaiPeng Wang , Qingyun Pan

The advent of large vision-language models (LVLMs) represents a remarkable advance in the quest for artificial general intelligence. However, the model's effectiveness in both specialized and general tasks warrants further investigation.…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Yao Jiang , Xinyu Yan , Ge-Peng Ji , Keren Fu , Meijun Sun , Huan Xiong , Deng-Ping Fan , Fahad Shahbaz Khan

Deep multimodal semantic understanding that goes beyond the mere superficial content relation mining has received increasing attention in the realm of artificial intelligence. The challenges of collecting and annotating high-quality…

计算与语言 · 计算机科学 2024-03-26 Zichen Wu , Hsiu-Yuan Huang , Fanyi Qu , Yunfang Wu

Vision-language Models (VLMs) have emerged as general-purpose tools for addressing a variety of complex computer vision problems. Such models have been shown to be highly capable, but, at the same time, lacking some basic visual…

机器学习 · 计算机科学 2025-07-15 Shivam Chandhok , Wan-Cyuan Fan , Vered Shwartz , Vineeth N Balasubramanian , Leonid Sigal

Multimodal large language models (MLLMs) have enabled a wide range of advanced vision-language applications, including fine-grained object recognition and contextual understanding. When querying specific regions or objects in an image,…

Deepfake detection remains a critical challenge in the era of advanced generative models, particularly as synthetic media becomes more sophisticated. In this study, we explore the potential of state of the art multi-modal (reasoning) large…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Simiao Ren , Yao Yao , Kidus Zewde , Zisheng Liang , Tsang , Ng , Ning-Yau Cheng , Xiaoou Zhan , Qinzhe Liu , Yifei Chen , Hengwei Xu

The ability to understand and reason about spatial relationships between objects in images is an important component of visual reasoning. This skill rests on the ability to recognize and localize objects of interest and determine their…

计算与语言 · 计算机科学 2024-10-14 Navid Rajabi , Jana Kosecka

Sarcasm detection is a significant challenge in sentiment analysis due to the nuanced and context-dependent nature of verbiage. We introduce Pragmatic Metacognitive Prompting (PMP) to improve the performance of Large Language Models (LLMs)…

计算与语言 · 计算机科学 2024-12-09 Joshua Lee , Wyatt Fong , Alexander Le , Sur Shah , Kevin Han , Kevin Zhu

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

Vision-language models (VLMs) are powerful but remain opaque black boxes. We introduce the first framework for transparent circuit tracing in VLMs to systematically analyze multimodal reasoning. By utilizing transcoders, attribution graphs,…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Jingcheng Yang , Tianhu Xiong , Shengyi Qian , Klara Nahrstedt , Mingyuan Wu

With enhanced capabilities and widespread applications, Multimodal Large Language Models (MLLMs) are increasingly required to process and reason over multiple images simultaneously. However, existing MLLM benchmarks focus either on…

Vision-Language multimodal Models (VLMs) offer the possibility for zero-shot classification in astronomy: i.e. classification via natural language prompts, with no training. We investigate two models, GPT-4o and LLaVA-NeXT, for zero-shot…

天体物理仪器与方法 · 物理学 2024-06-26 Dimitrios Tanoglidis , Bhuvnesh Jain

Detecting sarcasm remains a challenging task in the areas of Natural Language Processing (NLP) despite recent advances in neural network approaches. Currently, Pre-trained Language Models (PLMs) and Large Language Models (LLMs) are the…

计算与语言 · 计算机科学 2025-11-27 Michael Iskandardinata , William Christian , Derwin Suhartono