English
Related papers

Related papers: VideoSSR: Video Self-Supervised Reinforcement Lear…

200 papers

Reinforcement learning (RL) with verifiable rewards (RLVR) has demonstrated the great potential of enhancing the reasoning abilities in multimodal large language models (MLLMs). However, the reliance on language-centric priors and expensive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Jiahao Xie , Alessio Tonioni , Nathalie Rauschmayr , Federico Tombari , Bernt Schiele

Spatial understanding remains a weakness of Large Vision-Language Models (LVLMs). Existing supervised fine-tuning (SFT) and recent reinforcement learning with verifiable rewards (RLVR) pipelines depend on costly supervision, specialized…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yuhong Liu , Beichen Zhang , Yuhang Zang , Yuhang Cao , Long Xing , Xiaoyi Dong , Haodong Duan , Dahua Lin , Jiaqi Wang

Video spatial reasoning, which involves inferring the underlying spatial structure from observed video frames, poses a significant challenge for existing Multimodal Large Language Models (MLLMs). This limitation stems primarily from 1) the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Kun Ouyang , Yuanxin Liu , Haoning Wu , Yi Liu , Hao Zhou , Jie Zhou , Fandong Meng , Xu Sun

Reinforcement learning from verifiable rewards (RLVR) has demonstrated remarkable effectiveness in improving the reasoning capabilities of large language models. As models evolve into natively multimodal architectures, extending RLVR to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chuanyu Qin , Chenxu Yang , Qingyi Si , Naibin Gu , Dingyu Yao , Zheng Lin , Peng Fu , Nan Duan , Jiaqi Wang

Complex video reasoning remains a significant challenge for Multimodal Large Language Models (MLLMs), as current R1-based methodologies often prioritize text-centric reasoning derived from text-based and image-based developments. In video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Bo Fang , Yuxin Song , Qiangqiang Wu , Haoyuan Sun , Wenhao Wu , Antoni B. Chan

Recent studies have demonstrated the effectiveness of Large Language Models (LLMs) as reasoning modules that can deconstruct complex tasks into more manageable sub-tasks, particularly when applied to visual reasoning tasks for images. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ahmad Mahmood , Ashmal Vayani , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

Spatial reasoning has emerged as a critical capability for Multimodal Large Language Models (MLLMs), drawing increasing attention and rapid advancement. However, existing benchmarks primarily focus on single-step perception-to-judgment…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Rui Zhu , Xin Shen , Shuchen Wu , Chenxi Miao , Xin Yu , Yang Li , Weikang Li , Deguo Xia , Jizhou Huang

Vision-language models (VLMs) have shown remarkable abilities by integrating large language models with visual inputs. However, they often fail to utilize visual evidence adequately, either depending on linguistic priors in vision-centric…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xiaojun Guo , Runyu Zhou , Yifei Wang , Qi Zhang , Chenheng Zhang , Stefanie Jegelka , Xiaohan Wang , Jiajun Chai , Guojun Yin , Wei Lin , Yisen Wang

Recent advancements in Large Language Models (LLMs) have led to the development of Video Large Multi-modal Models (Video-LMMs) that can handle a wide range of video understanding tasks. These models have the potential to be deployed in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Muhammad Uzair Khattak , Muhammad Ferjad Naeem , Jameel Hassan , Muzammal Naseer , Federico Tombari , Fahad Shahbaz Khan , Salman Khan

Reinforcement Learning with Verifiable Rewards ( RLVR ) has emerged as a transformative paradigm for enhancing the reasoning capabilities of Large Language Models ( LLMs), yet its potential in 3D scene understanding remains under-explored.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Xiongkun Linghu , Jiangyong Huang , Baoxiong Jia , Siyuan Huang

Self-supervised learning has emerged as a powerful paradigm for label-free model pretraining, particularly in the video domain, where manual annotation is costly and time-intensive. However, existing self-supervised approaches employ…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Akash Kumar , Ashlesha Kumar , Vibhav Vineet , Yogesh S Rawat

Recent advances in test-time optimization have led to remarkable reasoning capabilities in Large Language Models (LLMs), enabling them to solve highly complex problems in math and coding. However, the reasoning capabilities of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Ce Zhang , Yan-Bo Lin , Ziyang Wang , Mohit Bansal , Gedas Bertasius

Post-training Large Vision-and-Language Models (LVLMs) typically involves Supervised Fine-Tuning (SFT) for knowledge injection or Reinforcement Learning with Verifiable Rewards (RLVR) for performance enhancement. However, SFT often leads to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yuqi Liu , Liangyu Chen , Jiazhen Liu , Mingkang Zhu , Zhisheng Zhong , Bei Yu , Jiaya Jia

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for post-training large language models (LLMs), achieving state-of-the-art performance on tasks with structured, verifiable answers. Applying…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yiqing Liang , Jielin Qiu , Wenhao Ding , Zuxin Liu , James Tompkin , Mengdi Xu , Mengzhou Xia , Zhengzhong Tu , Laixi Shi , Jiacheng Zhu

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced the reasoning capabilities of Large Language Models (LLMs) by optimizing them against factual outcomes. However, this paradigm falters in long-context…

Computation and Language · Computer Science 2026-03-03 Guanzheng Chen , Michael Qizhe Shieh , Lidong Bing

Multi-modal Large language models (MLLMs) show remarkable ability in video understanding. Nevertheless, understanding long videos remains challenging as the models can only process a finite number of frames in a single inference,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yucheng Suo , Fan Ma , Linchao Zhu , Tianyi Wang , Fengyun Rao , Yi Yang

The performance of Large Vision Language Models (LVLMs) is dependent on the size and quality of their training datasets. Existing video instruction tuning datasets lack diversity as they are derived by prompting large language models with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Orr Zohar , Xiaohan Wang , Yonatan Bitton , Idan Szpektor , Serena Yeung-Levy

Rapid progress in video models has largely focused on visual quality, leaving their reasoning capabilities underexplored. Video reasoning grounds intelligence in spatiotemporally consistent visual environments that go beyond what text can…

Reinforcement Learning with Verifiable Rewards~(RLVR) has become a prominent paradigm to enhance the capabilities (i.e.\ long-context) of Large Language Models~(LLMs). However, it often relies on gold-standard answers or explicit evaluation…

Computation and Language · Computer Science 2026-03-03 Yao Xiao , Lei Wang , Yue Deng , Guanzheng Chen , Ziqi Jin , Jung-jae Kim , Xiaoli Li , Roy Ka-wei Lee , Lidong Bing

Recent single-image super-resolution (SISR) networks, which can adapt their network parameters to specific input images, have shown promising results by exploiting the information available within the input data as well as large external…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Jinsu Yoo , Tae Hyun Kim
‹ Prev 1 2 3 10 Next ›