English
Related papers

Related papers: CollabVR: Collaborative Video Reasoning with Visio…

200 papers

There has been a growing interest in the task of generating sound for silent videos, primarily because of its practicality in streamlining video post-production. However, existing methods for video-sound generation attempt to directly…

Multimedia · Computer Science 2024-04-04 Zhifeng Xie , Shengye Yu , Qile He , Mengtian Li

It is critical for vision-language models (VLMs) to comprehensively understand visual, temporal, and textual cues. However, despite rapid progress in multimodal modeling, video understanding performance still lags behind text-based…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yuxuan Zhang , EunJeong Hwang , Huaisong Zhang , Penghui Du , Yiming Jia , Dongfu Jiang , Xuan He , Shenhui Zhang , Ping Nie , Peter West , Kelsey R. Allen

Ultra long video understanding remains an open challenge, as existing vision language models (VLMs) falter on such content due to limited context length and inefficient long term memory retention. To address this, recent works have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Hongbo Jin , Qingyuan Wang , Wenhao Zhang , Yang Liu , Sijie Cheng

We present GLM-4.1V-Thinking, GLM-4.5V, and GLM-4.6V, a family of vision-language models (VLMs) designed to advance general-purpose multimodal understanding and reasoning. In this report, we share our key findings in the development of the…

Medical vision--language models (VLMs) have shown strong potential for medical visual question answering (VQA), yet their reasoning remains largely text-centric: images are encoded once as static context, and subsequent inference is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Suyang Xi , Songtao Hu , Yuxiang Lai , Wangyun Dan , Yaqi Liu , Shansong Wang , Xiaofeng Yang

Vision-Language-Action (VLA) models aim to unify perception, language understanding, and action generation, offering strong cross-task and cross-scene generalization with broad impact on embodied AI. However, current VLA models often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Angen Ye , Zeyu Zhang , Boyuan Wang , Xiaofeng Wang , Dapeng Zhang , Zheng Zhu

Large language models (LLMs) have shown remarkable ability in various language tasks, especially with their emergent in-context learning capability. Extending LLMs to incorporate visual inputs, large vision-language models (LVLMs) have…

Machine Learning · Computer Science 2025-10-13 Aneesh Komanduri , Karuna Bhaila , Xintao Wu

Vision-Language Models (VLMs) have recently emerged as powerful tools, excelling in tasks that integrate visual and textual comprehension, such as image captioning, visual question answering, and image-text retrieval. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ilias Stogiannidis , Steven McDonagh , Sotirios A. Tsaftaris

Recent advances in Multimodal Large Language Models (MLLMs) have significantly improved performance on tasks such as visual grounding and visual question answering. However, the reasoning processes of these models remain largely opaque;…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Haobo Yuan , Yueyi Sun , Yanwei Li , Tao Zhang , Xueqing Deng , Henghui Ding , Lu Qi , Anran Wang , Xiangtai Li , Ming-Hsuan Yang

Despite the rapid progress of multimodal large language models (MLLMs), they have largely overlooked the importance of visual processing. In a simple yet revealing experiment, we interestingly find that language-only models, when provided…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yuting Li , Lai Wei , Kaipeng Zheng , Jingyuan Huang , Guilin Li , Bo Wang , Linghe Kong , Lichao Sun , Weiran Huang

The ability to reason about temporal and causal events from videos lies at the core of human intelligence. Most video reasoning benchmarks, however, focus on pattern recognition from complex visual and language input, instead of on causal…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Kexin Yi , Chuang Gan , Yunzhu Li , Pushmeet Kohli , Jiajun Wu , Antonio Torralba , Joshua B. Tenenbaum

Chain-of-thought reasoning has significantly improved the performance of Large Language Models (LLMs) across various domains. However, this reasoning process has been confined exclusively to textual space, limiting its effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Haozhe Wang , Alex Su , Weiming Ren , Fangzhen Lin , Wenhu Chen

Despite strong performance in visual understanding and language-based reasoning, Vision-Language Models (VLMs) struggle with tasks requiring integrated perception and symbolic computation. We study this limitation through visual equation…

Computation and Language · Computer Science 2025-09-12 Monjoy Narayan Choudhury , Junling Wang , Yifan Hou , Mrinmaya Sachan

The sequential structure of videos poses a challenge to the ability of multimodal large language models (MLLMs) to locate multi-frame evidence and conduct multimodal reasoning. However, existing video benchmarks mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Kejian Zhu , Zhuoran Jin , Hongbang Yuan , Jiachun Li , Shangqing Tu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

The rapid advancement of Large Vision Language Models (LVLMs) has demonstrated excellent abilities in various visual tasks. Building upon these developments, the thinking with images paradigm has emerged, enabling models to dynamically edit…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yujin Zhou , Pengcheng Wen , Jiale Chen , Boqin Yin , Han Zhu , Jiaming Ji , Juntao Dai , Chi-Min Chan , Sirui Han

Vision-language models (VLMs) have emerged as a promising direction for end-to-end autonomous driving (AD) by jointly modeling visual observations, driving context, and language-based reasoning. However, existing VLM-based systems face a…

Robotics · Computer Science 2026-03-10 Ximeng Tao , Pardis Taghavi , Dimitar Filev , Reza Langari , Gaurav Pandey

Recent advances in Large Language Models (LLMs) and Vision Language Models (VLMs) have shown significant progress in mathematical reasoning, yet they still face a critical bottleneck with problems requiring visual assistance, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Chengqi Duan , Kaiyue Sun , Rongyao Fang , Manyuan Zhang , Yan Feng , Ying Luo , Yufang Liu , Ke Wang , Peng Pei , Xunliang Cai , Hongsheng Li , Yi Ma , Xihui Liu

Visual reasoning, the capability to interpret visual input in response to implicit text query through multi-step reasoning, remains a challenge for deep learning models due to the lack of relevant benchmarks. Previous work in visual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yiqing Shen , Chenjia Li , Chenxiao Fan , Mathias Unberath

Graphics design is important for various applications, including movie production and game design. To create a high-quality scene, designers usually need to spend hours in software like Blender, in which they might need to interleave and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Ian Huang , Guandao Yang , Leonidas Guibas

Online Video Large Language Models (VideoLLMs) play a critical role in supporting responsive, real-time interaction. Existing methods focus on streaming perception, lacking a synchronized logical reasoning stream. However, directly applying…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yiran Guan , Liang Yin , Dingkang Liang , Jianzhong Ju , Zhenbo Luo , Jian Luan , Yuliang Liu , Xiang Bai
‹ Prev 1 8 9 10 Next ›