中文
相关论文

相关论文: Conflict Adaptation in Vision-Language Models

200 篇论文

Large Vision-Language Models (LVLMs) have exhibited strong reasoning capabilities through chain-of-thought mechanisms that generate step-by-step rationales. However, such slow-thinking approaches often lead to overthinking, where models…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Xingjian Diao , Zheyuan Liu , Chunhui Zhang , Weiyi Wu , Keyi Kong , Lin Shi , Kaize Ding , Soroush Vosoughi , Jiang Gui

Multimodal large language models (MLLMs) have shown impressive capabilities in document understanding, a rapidly growing research area with significant industrial demand. As a multimodal task, document understanding requires models to…

人工智能 · 计算机科学 2025-11-13 Zirui Shao , Feiyu Gao , Zhaoqing Zhu , Chuwei Luo , Hangdi Xing , Zhi Yu , Qi Zheng , Ming Yan , Jiajun Bu

Large Vision-Language Models (VLMs) excel at general visual reasoning tasks but exhibit sharp performance degradation when applied to novel domains with substantial distribution shifts from pretraining data. Existing domain adaptation…

计算机视觉与模式识别 · 计算机科学 2025-10-16 Dominick Reilly , Manish Kumar Govind , Le Xue , Srijan Das

Recent research on Vision Language Models (VLMs) suggests that they rely on inherent biases learned during training to respond to questions about visual properties of an image. These biases are exacerbated when VLMs are asked highly…

计算机视觉与模式识别 · 计算机科学 2025-09-11 Saurav Sengupta , Nazanin Moradinasab , Jiebei Liu , Donald E. Brown

Using psychological constructs such as the Big Five, large language models (LLMs) can imitate specific personality profiles and predict a user's personality. While LLMs can exhibit behaviors consistent with these constructs, it remains…

计算与语言 · 计算机科学 2026-04-14 Yuto Harada , Hiro Taiyo Hamada

Large Language Models (LLMs) encode vast world knowledge across multiple languages, yet their internal beliefs are often unevenly distributed across linguistic spaces. When external evidence contradicts these language-dependent memories,…

计算与语言 · 计算机科学 2026-01-13 Jiaqi Zhao , Qiang Huang , Haodong Chen , Xiaoxing You , Jun Yu

Large language models (LLMs) solve complex problems yet fail on simpler variants, suggesting they achieve correct outputs through mechanisms fundamentally different from human reasoning. To understand this gap, we synthesize cognitive…

The proliferation of large language models (LLMs) has significantly advanced intelligent systems. Unfortunately, LLMs often face knowledge conflicts between internal memory and retrieved external information, arising from misinformation,…

计算与语言 · 计算机科学 2025-11-18 Jiatai Wang , Zhiwei Xu , Di Jin , Xuewen Yang , Tao Li

Vision-Language-Action Models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs), VLAs exhibit higher complexity due to their multi-modal…

机器人学 · 计算机科学 2026-03-06 Hugo Buurmeijer , Carmen Amo Alonso , Aiden Swann , Marco Pavone

As large language models (LLMs) evolve into autonomous agents capable of acting in open-ended environments, ensuring behavioral alignment with human values becomes a critical safety concern. Existing benchmarks, focused on static,…

计算与语言 · 计算机科学 2026-03-10 Weixiang Zhao , Haozhen Li , Yanyan Zhao , xuda zhi , Yongbo Huang , Hao He , Bing Qin , Ting Liu

Large Reasoning Models (LRMs) have achieved remarkable performance across diverse domains, yet their decision-making under conflicting objectives remains insufficiently understood. This work investigates how LRMs respond to harmful queries…

密码学与安全 · 计算机科学 2026-04-14 Honghao Liu , Chengjin Xu , Xuhui Jiang , Cehao Yang , Shengming Yin , Zhengwu Ma , Lionel Ni , Jian Guo

There is increasing interest in employing large language models (LLMs) as cognitive models. For such purposes, it is central to understand which properties of human cognition are well-modeled by LLMs, and which are not. In this work, we…

Vision-language models (VLMs) have advanced rapidly in processing multimodal information, but their ability to reconcile conflicting signals across modalities remains underexplored. This work investigates how VLMs process ASCII art, a…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Zhaochen Wang , Bryan Hooi , Yiwei Wang , Ming-Hsuan Yang , Zi Huang , Yujun Cai

The emergence of Large Language Models (LLMs) has advanced the multilingual machine translation (MMT), yet the Curse of Multilinguality (CoM) remains a major challenge. Existing work in LLM-based MMT typically mitigates this issue via…

计算与语言 · 计算机科学 2025-02-18 Tong Zheng , Yan Wen , Huiwen Bao , Junfeng Guo , Heng Huang

Recent work has documented striking heterogeneity in the performance of state-of-the-art vision language models (VLMs), including both multimodal language models and text-to-image models. These models are able to describe and generate a…

Safety alignment in Large Language Models (LLMs) inherently presents a multi-objective optimization conflict, often accompanied by an unintended degradation of general capabilities. Existing mitigation strategies typically rely on global…

机器学习 · 计算机科学 2026-01-09 Wang Cai , Yilin Wen , Jinchang Hou , Du Su , Guoqiu Wang , Zhonghou Lv , Chenfu Bao , Yunfang Wu

As NLP models become increasingly integrated into real-world applications, it becomes clear that there is a need to address the fact that models often rely on and generate conflicting information. Conflicts could reflect the complexity of…

计算与语言 · 计算机科学 2026-02-03 Siyi Liu , Dan Roth

Vision-language models (VLMs) achieve strong benchmark results, yet can exhibit systematic perceptual weaknesses: structured, large changes to pixel values can cause confident yet nonsensical predictions, even when the underlying scene…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Nicoleta-Nina Basoc , Adrian Cosma , Emilian Radoi

Multimodal Sentiment Analysis (MSA) fuses text, acoustic, and visual streams to infer sentiment. Because pre-trained text encoders are far more expressive than their acoustic and visual counterparts, the text modality tends to dominate…

人工智能 · 计算机科学 2026-05-28 Jianheng Dai , Jiazhang Liang , Sijie Mai

Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities for capturing and reasoning over multimodal inputs. However, these models are prone to parametric knowledge conflicts, which arise from inconsistencies of…

计算机视觉与模式识别 · 计算机科学 2024-10-14 Tinghui Zhu , Qin Liu , Fei Wang , Zhengzhong Tu , Muhao Chen