English
Related papers

Related papers: ReVSeg: Incentivizing the Reasoning Chain for Vide…

200 papers

Reinforcement learning with verifiable rewards (RLVR) has become central to post-training reasoning models, yet a key limitation of existing studies is their narrow view of the reasoning space: difficulty is treated as reasoning depth…

Computation and Language · Computer Science 2026-05-27 Yihua Zhu , Qianying Liu , Fei Cheng , Jiaxin Wang , Akiko Aizawa , Sadao Kurohashi , Hidetoshi Shimodaira

Although reinforcement learning (RL) has significantly advanced reasoning capabilities in large multimodal language models (MLLMs), its efficacy remains limited for lightweight models essential for edge deployments. To address this issue,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Jingze Wu , Quan Zhang , Hongfei Suo , Zeqiang Cai , Hongbo Chen

Video understanding requires identifying and reasoning over semantically discriminative visual objects across frames, yet existing object-agnostic solutions struggle to effectively handle substantial object variations over time. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Zhixuan Wu , Quanxing Zha , Teng Wang , Genbao Xu , Wenyuan Gu , Wei Rao , Nan Ma , Bo Cheng , Soujanya Poria

Existing vision-language models (VLMs) have demonstrated impressive performance in reasoning-based segmentation. However, current benchmarks are primarily constructed from high-quality images captured under idealized conditions. This raises…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Wanjun Du , Zifeng Yuan , Tingting Chen , Fucai Ke , Beibei Lin , Shunli Zhang

With recent video object segmentation (VOS) benchmarks evolving to challenging scenarios, we revisit a simple but overlooked strategy: restricting the size of memory banks. This diverges from the prevalent practice of expanding memory banks…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Junbao Zhou , Ziqi Pang , Yu-Xiong Wang

Boosted by Multi-modal Large Language Models (MLLMs), text-guided universal segmentation models for the image and video domains have made rapid progress recently. However, these methods are often developed separately for specific domains,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Cong Wei , Yujie Zhong , Haoxian Tan , Yingsen Zeng , Yong Liu , Zheng Zhao , Yujiu Yang

Large Vision-Language Models excel at multimodal understanding but struggle to deeply integrate visual information into their predominantly text-based reasoning processes, a key challenge in mirroring human cognition. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ziwei Zheng , Michael Yang , Jack Hong , Chenxiao Zhao , Guohai Xu , Le Yang , Chao Shen , Xing Yu

Current high-performance semantic segmentation models are purely data-driven sub-symbolic approaches and blind to the structured nature of the visual world. This is in stark contrast to human cognition which abstracts visual perceptions at…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Liulei Li , Wenguan Wang , Yi Yang

Joint video-language learning has received increasing attention in recent years. However, existing works mainly focus on single or multiple trimmed video clips (events), which makes human-annotated event boundaries necessary during…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Teng Wang , Jinrui Zhang , Feng Zheng , Wenhao Jiang , Ran Cheng , Ping Luo

Vision-Language Models (VLMs) excel at visual reasoning but still struggle with integrating external knowledge. Retrieval-Augmented Generation (RAG) is a promising solution, but current methods remain inefficient and often fail to maintain…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Gen Li , Peiyu Liu

Image segmentation needs both local boundary position information and global object context information. The performance of the recent state-of-the-art method, fully convolutional networks, reaches a bottleneck due to the neural network…

Computer Vision and Pattern Recognition · Computer Science 2018-04-23 Zhenxin Wang , Sayan Sarcar , Jingxin Liu , Yilin Zheng , Xiangshi Ren

In vision-language models (VLMs), misalignment between textual descriptions and visual coordinates often induces hallucinations. This issue becomes particularly severe in dense prediction tasks such as spatial-temporal video grounding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Xiaowen Zhang , Zhi Gao , Licheng Jiao , Lingling Li , Qing Li

Continuous latent-space reasoning offers a compact alternative to textual chain-of-thought for multimodal models, enabling high-dimensional visual evidence to be integrated without explicit reasoning tokens. However, we identify a…

Machine Learning · Computer Science 2026-05-05 Xin Zhang , Qiqi Tao , Jiawei Du , Moyun Liu , Joey Tianyi Zhou

Referring Video Object Segmentation (R-VOS) is a challenging task that aims to segment an object in a video based on a linguistic expression. Most existing R-VOS methods have a critical assumption: the object referred to must appear in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xiang Li , Jinglu Wang , Xiaohao Xu , Xiao Li , Bhiksha Raj , Yan Lu

For real-time semantic video segmentation, most recent works utilised a dynamic framework with a key scheduler to make online key/non-key decisions. Some works used a fixed key scheduling policy, while others proposed adaptive key…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Yujiang Wang , Mingzhi Dong , Jie Shen , Yang Wu , Shiyang Cheng , Maja Pantic

In the realm of food computing, segmenting ingredients from images poses substantial challenges due to the large intra-class variance among the same ingredients, the emergence of new ingredients, and the high annotation costs associated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xiongwei Wu , Sicheng Yu , Ee-Peng Lim , Chong-Wah Ngo

Video Referring Expression Comprehension (REC) aims to localize a target object in video frames referred by the natural language expression. Recently, the Transformerbased methods have greatly boosted the performance limit. However, we…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Ji Jiang , Meng Cao , Tengtao Song , Yuexian Zou

When thinking with images, humans rarely rely on a single glance: they revisit visual evidence while reasoning. In contrast, most Multimodal Language Models encode an image once to key-value cache and then reason purely in text, making it…

Computation and Language · Computer Science 2026-05-08 Jiwan Chung , Junhyeok Kim , Siyeol Kim , Jaeyoung Lee , Min Soo Kim , Youngjae Yu

Multimodal Large Language Models (MLLMs) have achieved notable gains in various tasks by incorporating Chain-of-Thought (CoT) reasoning in language spaces. Recent work extends this direction by leveraging external tools for visual editing,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Bangzheng Li , Ximeng Sun , Jiang Liu , Ze Wang , Jialian Wu , Xiaodong Yu , Hao Chen , Emad Barsoum , Muhao Chen , Zicheng Liu

Referential Video Object Segmentation (RVOS) aims to segment all objects in a video that match a given natural language description, bridging the gap between vision and language understanding. Recent work, such as Sa2VA, combines Large…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Ran Hong , Feng Lu , Leilei Cao , An Yan , Youhai Jiang , Fengjie Zhu