English
Related papers

Related papers: Scaling Test-Time Robustness of Vision-Language Mo…

200 papers

Large Vision-Language Models (LVLMs) have shown significant capability in vision-language understanding. However, one critical issue that persists in these models is sycophancy, where models are unduly influenced by leading or deceptive…

Artificial Intelligence · Computer Science 2025-10-24 Yunpu Zhao , Rui Zhang , Junbin Xiao , Changxin Ke , Ruibo Hou , Yifan Hao , Ling Li

Vision-language models (VLMs) have achieved strong multimodal reasoning capabilities, but further improving them still relies heavily on large-scale human-constructed supervision for post-training. Such supervision is costly to obtain,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Chaoran Xu , Yingmao Miao , Pengfei Zhang , Hao Dou , Lei Sun , Xiangxiang Chu

Large Language Models (LLMs) have emerged as a promising cornerstone for the development of natural language processing (NLP) and artificial intelligence (AI). However, ensuring the robustness of LLMs remains a critical challenge. To…

Computation and Language · Computer Science 2025-11-07 Pankaj Kumar , Subhankar Mishra

Safety-aligned Large Language Models (LLMs) still show two dominant failure modes: they are easily jailbroken, or they over-refuse harmless inputs that contain sensitive surface signals. We trace both to a common cause: current models…

Computation and Language · Computer Science 2025-10-07 Rui Wu , Yihao Quan , Zeru Shi , Zhenting Wang , Yanshu Li , Ruixiang Tang

Multimodal large language models (MLLMs) achieve strong performance on single-view spatial reasoning tasks, yet it remains unclear whether they maintain stable spatial state representations under counterfactual viewpoint changes. We…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shanmukha Vellamcheti , Uday Kiran Kothapalli , Disharee Bhowmick , Sathyanarayanan N. Aakur

The widespread adoption of large language models (LLMs) necessitates reliable methods to detect LLM-generated text. We introduce SimMark, a robust sentence-level watermarking algorithm that makes LLMs' outputs traceable without requiring…

Computation and Language · Computer Science 2025-09-12 Amirhossein Dabiriaghdam , Lele Wang

Scaling test-time computation with reinforcement learning (RL) has emerged as a reliable path to improve large language models (LLM) reasoning ability. Yet, outcome-based reward often incentivizes models to be overconfident, leading to…

Machine Learning · Computer Science 2026-04-28 Liaoyaqi Wang , Chunsheng Zuo , William Jurayj , Benjamin Van Durme , Anqi Liu

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored. To address this gap, we introduce a novel benchmark that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Mingwei Zhu , Leigang Sha , Yu Shu , Kangjia Zhao , Tiancheng Zhao , Jianwei Yin

Pre-trained vision-language models (VLMs) such as CLIP have demonstrated strong zero-shot capabilities across diverse domains, yet remain highly vulnerable to adversarial perturbations that disrupt image-text alignment and compromise…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiaxiang Liu , Jiawei Du , Xiao Liu , Prayag Tiwari , Mingkun Xu

Large Vision-Language Models (LVLMs) have demonstrated outstanding performance across various multimodal tasks. However, they suffer from a problem known as language prior, where responses are generated based solely on textual patterns…

Artificial Intelligence · Computer Science 2025-02-11 Kang-il Lee , Minbeom Kim , Seunghyun Yoon , Minsung Kim , Dongryeol Lee , Hyukhun Koh , Kyomin Jung

Recently, large language models (LLMs) have demonstrated impressive capabilities in dealing with new tasks with the help of in-context learning (ICL). In the study of Large Vision-Language Models (LVLMs), when implementing ICL, researchers…

Computation and Language · Computer Science 2024-12-11 Ellen Yi-Ge , Jiechao Gao , Wei Han , Wei Zhu

Reinforcement learning (RL) has demonstrated potential in enhancing the reasoning capabilities of large language models (LLMs), but such training typically demands substantial efforts in creating and annotating data. In this work, we…

Computation and Language · Computer Science 2025-10-06 Hangfan Zhang , Siyuan Xu , Zhimeng Guo , Huaisheng Zhu , Shicheng Liu , Xinrun Wang , Qiaosheng Zhang , Yang Chen , Peng Ye , Lei Bai , Shuyue Hu

Recent advancements in Large Vision-Language Models (LVLMs) have significantly enhanced their ability to integrate visual and linguistic information, achieving near-human proficiency in tasks like object recognition, captioning, and visual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Zhikai Wang , Jiashuo Sun , Wenqi Zhang , Zhiqiang Hu , Xin Li , Fan Wang , Deli Zhao

Large language models (LLMs) achieve strong performance by generating long chains of thought, but longer traces always introduce redundant or ineffective reasoning steps. One typical behavior is that they often perform unnecessary…

Computation and Language · Computer Science 2026-01-13 Jinyi Han , Zixiang Di , Zishang Jiang , Ying Liao , Jiaqing Liang , Yongqi Wang , Yanghua Xiao

Reinforcement learning (RL) has recently shown strong potential in improving the reasoning capabilities of large language models and is now being actively extended to vision-language models (VLMs). However, existing RL applications in VLMs…

Machine Learning · Computer Science 2025-04-07 Yan Ma , Steffi Chern , Xuyang Shen , Yiran Zhong , Pengfei Liu

Recently, Multi-modal Large Language Models (MLLMs) have demonstrated significant performance across various video understanding tasks. However, their robustness, particularly when faced with manipulated video content, remains largely…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Zixi Yang , Jiapeng Li , Muxi Diao , Yinuo Jing , Kongming Liang

Recent advancements in large language models (LLMs) have demonstrated their potential in automating the scientific research ideation. Existing approaches primarily focus on prompting techniques, often producing ideas misaligned with expert…

Computation and Language · Computer Science 2025-11-17 Ruochen Li , Liqiang Jing , Chi Han , Jiawei Zhou , Xinya Du

We introduce OpenVLThinker, one of the first open-source large vision-language models (LVLMs) to exhibit sophisticated chain-of-thought reasoning, achieving notable performance gains on challenging visual reasoning tasks. While text-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yihe Deng , Hritik Bansal , Fan Yin , Nanyun Peng , Wei Wang , Kai-Wei Chang

Large Language Models (LLMs) are increasingly deployed in agentic and retrieval-augmented generation (RAG) systems, where they must execute user-specified tasks over externally provided reference text. In practice, such context is often…

Artificial Intelligence · Computer Science 2026-05-29 Zeli Su , Zhankai Xu , Tianlei Chen , Longfei Zheng , Xiaolu Zhang , Jun Zhou , Wentao Zhang

This study focuses on improving the performance of lightweight Large Language Models (LLMs) in mathematical reasoning tasks. We introduce a novel method for measuring mathematical logic similarity and design an automatic screening mechanism…

Computation and Language · Computer Science 2024-09-04 Ding Kai , Ma Zhenguo , Yan Xiaoran