中文
相关论文

相关论文: Leveraging Latent Visual Reasoning in Silence

200 篇论文

The remarkable progress in text-to-video diffusion models enables the generation of photorealistic videos, although the content of these generated videos often includes unnatural movement or deformation, reverse playback, and motionless…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Yuta Oshima , Masahiro Suzuki , Yutaka Matsuo , Hiroki Furuta

Language models generate responses by producing a series of tokens in immediate succession: the $(K+1)^{th}$ token is an outcome of manipulating $K$ hidden vectors per layer, one vector per preceding token. What if instead we were to let…

计算与语言 · 计算机科学 2024-04-23 Sachin Goyal , Ziwei Ji , Ankit Singh Rawat , Aditya Krishna Menon , Sanjiv Kumar , Vaishnavh Nagarajan

While vision-language models (VLMs) have exhibited multi-turn visual reasoning capabilities, their reasoning trajectories remain relatively shallow and are dominated by a text-centric paradigm, limiting their applicability to complex visual…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Zhiwei Ning , Wenwen Tong , Xiangli Kong , Shengnan Ma , Ziyi Shang , Jingcheng Ni , Tao Hu , Yong Xien Chng , Jixuan Ying , Zehuan Wu , Hanming Deng , Jie Yang , Yuanjie Zheng , Wei Liu , Lewei Lu

Discrete diffusion models have recently become competitive with autoregressive models for language modeling, even outperforming them on reasoning tasks requiring planning and global coherence, but they require more computation at inference…

机器学习 · 计算机科学 2026-02-04 Andre He , Sean Welleck , Daniel Fried

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising paradigm for advancing complex reasoning in large language models, and recent work extends RLVR to multimodal large language models (MLLMs). This transfer,…

计算与语言 · 计算机科学 2026-05-22 Changyuan Tian , Zhicong Lu , Huaxing Liu , Xiang Wang , Shuai Li , Yu Chen , Wenqian Lv , Zichuan Lin , Juncheng Diao , Deheng Ye

Recent advancements in vision-language models (VLMs) have improved performance by increasing the number of visual tokens, which are often significantly longer than text tokens. However, we observe that most real-world scenarios do not…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Senqiao Yang , Junyi Li , Xin Lai , Bei Yu , Hengshuang Zhao , Jiaya Jia

Reinforcement learning (RL) has shown strong potential for enhancing reasoning in multimodal large language models, yet existing video reasoning methods often rely on coarse sequence-level rewards or single-factor token selection,…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Ziyue Wang , Sheng Jin , Zhongrong Zuo , Jiawei Wu , Han Qiu , Qi She , Hao Zhang , Xudong Jiang

Vision Language Models (VLMs) have achieved remarkable success by integrating visual encoders with large language models (LLMs). While VLMs process dense image tokens across deep transformer stacks (incurring substantial computational…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Sambit Ghosh , R. Venkatesh Babu , Chirag Agarwal

Vision-language models (VLMs) aim to reason by jointly leveraging visual and textual modalities. While allocating additional inference-time computation has proven effective for large language models (LLMs), achieving similar scaling in VLMs…

计算机视觉与模式识别 · 计算机科学 2026-02-19 Mingjia Shi , Yinhan He , Yaochen Zhu , Jundong Li

Recent advances in vision-language models (VLMs) emphasize long chain-of-thought reasoning; yet, we find that their performance on visual tasks is primarily limited by a lack of visual perception as opposed to reasoning itself. In this…

计算与语言 · 计算机科学 2026-05-20 Juncheng Wu , Hardy Chen , Haoqin Tu , Xianfeng Tang , Freda Shi , Hui Liu , Hanqing Lu , Cihang Xie , Yuyin Zhou

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existing methods typically…

人工智能 · 计算机科学 2025-10-27 Yang Zhang , Wenxin Xu , Xiaoyan Zhao , Wenjie Wang , Fuli Feng , Xiangnan He , Tat-Seng Chua

While reinforcement learning (RL) over chains of thought has significantly advanced language models in tasks such as mathematics and coding, visual reasoning introduces added complexity by requiring models to direct visual attention,…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Gabriel Sarch , Snigdha Saha , Naitik Khandelwal , Ayush Jain , Michael J. Tarr , Aviral Kumar , Katerina Fragkiadaki

Understanding text-rich videos requires reading small, transient textual cues that often demand repeated inspection. Yet most video QA models rely on single-pass perception over fixed frames, leading to hallucinations and failures on…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Yolo Y. Tang , Daiki Shimada , Hang Hua , Chao Huang , Jing Bi , Rogerio Feris , Chenliang Xu

Extending Reinforcement Learning with Verifiable Rewards (RLVR) to multimodal large language models (MLLMs) faces a fundamental challenge: their responses inherently interleave perception-related tokens, which ground visual content, with…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Jinda Lu , Junkang Wu , Jinghan Li , Kexin Huang , Shuo Yang , Guoyin Wang , Jiancan Wu , Xiang Wang , Xiangnan He

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao

Recently DeepSeek R1 has shown that reinforcement learning (RL) can substantially improve the reasoning capabilities of Large Language Models (LLMs) through a simple yet effective design. The core of R1 lies in its rule-based reward…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Haozhan Shen , Peng Liu , Jingcheng Li , Chunxin Fang , Yibo Ma , Jiajia Liao , Qiaoli Shen , Zilun Zhang , Kangjia Zhao , Qianqian Zhang , Ruochen Xu , Tiancheng Zhao

Vision-language generative reward models (VL-GenRMs) play a crucial role in aligning and evaluating multimodal AI systems, yet their own evaluation remains under-explored. Current assessment methods primarily rely on AI-annotated preference…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Lei Li , Yuancheng Wei , Zhihui Xie , Xuqing Yang , Yifan Song , Peiyi Wang , Chenxin An , Tianyu Liu , Sujian Li , Bill Yuchen Lin , Lingpeng Kong , Qi Liu

Reasoning goes beyond language; the real world requires reasoning about space, time, affordances, and much more that words alone cannot convey. Existing multimodal models exploring the potential of reasoning with images are brittle and do…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Arijit Ray , Ahmed Abdelkader , Chengzhi Mao , Bryan A. Plummer , Kate Saenko , Ranjay Krishna , Leonidas Guibas , Wen-Sheng Chu

Answering questions about images often requires combining visual understanding with external knowledge. Multimodal Large Language Models (MLLMs) provide a natural framework for this setting, but they often struggle to identify the most…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Marco Morini , Sara Sarto , Marcella Cornia , Lorenzo Baraldi

Video diffusion models have made rapid progress in perceptual realism and temporal coherence, but they remain primarily optimized for plausible generation rather than verifiable reasoning. This limitation is especially pronounced in tasks…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Tinghui Zhu , Sheng Zhang , James Y. Huang , Selena Song , Xiaofei Wen , Yuankai Li , Hoifung Poon , Muhao Chen