中文
相关论文

相关论文: STRIVE: Structured Spatiotemporal Exploration for …

200 篇论文

Referring Video Object Segmentation (RVOS) aims to segment target objects in videos based on natural language descriptions. However, fixed keyframe-based approaches that couple a vision language model with a separate propagation module…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Jihwan Hong , Jaeyoung Do

Long video understanding is essential for human-like intelligence, enabling coherent perception and reasoning over extended temporal contexts. While the emerging thinking-with-frames paradigm, which alternates between global temporal…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Pengfei Hu , Meng Cao , Yingyao Wang , Yi Wang , Jiahua Dong , Jun Song , Yu Cheng , Bo Zheng , Xiaodan Liang

Many video reasoning tasks require tracking motion, temporal order, and evolving visual states across frames. Existing methods built on large vision-language models (LVLMs) often address this challenge by externalizing reasoning through…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Yiming Liang , Yixiao Chen , Yiyang Zhou , Yixuan Wang , Shoubin Yu , Andong Deng , Fuxiao Liu , Qin Zhang , Chen Chen , Mohit Bansal , Huaxiu Yao

Recent advances in large language models (LLMs) have demonstrated that reinforcement learning with verifiable rewards (RLVR) can significantly enhance reasoning abilities by directly optimizing correctness, rather than relying solely on…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Minbin Huang , Runhui Huang , Chuanyang Zheng , Jingyao Li , Guoxuan Chen , Han Shi , Hong Cheng

Structured, procedural reasoning is essential for Large Language Models (LLMs), especially in mathematics. While post-training methods have improved LLM performance, they still fall short in capturing deep procedural logic on complex tasks.…

人工智能 · 计算机科学 2025-08-27 Zhichao Yang , Zhaoxin Fan , Gen Li , Yuanze Hu , Xinyu Wang , Ye Qiu , Xin Wang , Yifan Sun , Wenjun Wu

Effective modeling of complex spatiotemporal dependencies in long-form videos remains an open problem. The recently proposed Structured State-Space Sequence (S4) model with its linear complexity offers a promising direction in this space.…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Jue Wang , Wentao Zhu , Pichao Wang , Xiang Yu , Linda Liu , Mohamed Omar , Raffay Hamid

Reinforcement learning (RL) has emerged as an effective paradigm for enhancing model reasoning. However, existing RL methods like GRPO typically rely on unstructured self-sampling to fit scalar rewards, often producing inefficient rollouts…

计算与语言 · 计算机科学 2026-05-18 Jinyang Wu , Chonghua Liao , Mingkuan Feng , Shuai Zhang , Zhengqi Wen , Haoran Luo , Ling Yang , Huazhe Xu , Jianhua Tao

Vision-Language Models (VLMs) have been applied to autonomous driving to support decision-making in complex real-world scenarios. However, their training on static, web-sourced image-text pairs fundamentally limits the precise…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Keishi Ishihara , Kento Sasaki , Tsubasa Takahashi , Daiki Shiono , Yu Yamaguchi

Despite the prosperity of the video language model, the current pursuit of comprehensive video reasoning is thwarted by the inherent spatio-temporal incompleteness within individual videos, resulting in hallucinations and inaccuracies. A…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Zhihao He , Tianyao He , Yun Xu , Tieyuan Chen , Huabin Liu , Chaofan Gan , Zuxuan Wu , Weiyao Lin

Value-decomposition methods, which reduce the difficulty of a multi-agent system by decomposing the joint state-action space into local observation-action spaces, have become popular in cooperative multi-agent reinforcement learning (MARL).…

人工智能 · 计算机科学 2023-03-17 Shuhan Qi , Shuhao Zhang , Qiang Wang , Jiajia Zhang , Jing Xiao , Xuan Wang

Large Vision-Language Models (LVLMs) have shown exceptional performance in multimodal tasks, but their effectiveness in complex visual reasoning is still constrained, especially when employing Chain-of-Thought prompting techniques. In this…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Congzhi Zhang , Jiawei Peng , Zhenglin Wang , Yilong Lai , Haowen Sun , Heng Chang , Fei Ma , Weijiang Yu

Most successful self-supervised learning methods are trained to align the representations of two independent views from the data. State-of-the-art methods in video are inspired by image techniques, where these two views are similarly…

Unified video models exhibit strong capabilities in understanding and generation, yet they struggle with reason-informed visual editing even when equipped with powerful internal vision-language models (VLMs). We attribute this gap to two…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Xinyu Liu , Hangjie Yuan , Yujie Wei , Jiazheng Xing , Yujin Han , Jiahao Pan , Yanbiao Ma , Chi-Min Chan , Kang Zhao , Shiwei Zhang , Wenhan Luo , Yike Guo

To build Video Question Answering (VideoQA) systems capable of assisting humans in daily activities, seeking answers from long-form videos with diverse and complex events is a must. Existing multi-modal VQA models achieve promising…

计算机视觉与模式识别 · 计算机科学 2022-12-20 Difei Gao , Luowei Zhou , Lei Ji , Linchao Zhu , Yi Yang , Mike Zheng Shou

Multi-video event understanding demands models that can locate and attribute query-relevant evidence scattered across long, heterogeneous video corpora. Existing large vision-language models (LVLMs) often underperform in this regime because…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Pengyu Yan , Akhil Gorugantu , Mahesh Bhosale , Abdul Wasi , Vishvesh Trivedi , David Doermann

Recent advancements in reinforcement learning, particularly through Group Relative Policy Optimization (GRPO), have significantly improved multimodal large language models for complex reasoning tasks. However, two critical limitations…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Jisheng Dang , Jingze Wu , Teng Wang , Xuanhui Lin , Nannan Zhu , Hongbo Chen , Wei-Shi Zheng , Meng Wang , Tat-Seng Chua

Previous text-guided video editing methods often suffer from temporal inconsistency, motion distortion, and-most notably-limited domain transformation. We attribute these limitations to insufficient modeling of spatiotemporal pixel…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Junsung Lee , Junoh Kang , Bohyung Han

Despite advances in reinforcement learning (RL)-based video reasoning with large language models (LLMs), data collection and fine-tuning remain significant challenges. These methods often rely on large-scale supervised fine-tuning (SFT)…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Ziyang Wang , Jaehong Yoon , Shoubin Yu , Md Mohaiminul Islam , Gedas Bertasius , Mohit Bansal

Large language models can exhibit emergent reasoning behaviors, often manifested as recurring lexical patterns (e.g., "wait," indicating verification). However, complex reasoning trajectories remain sparse in unconstrained sampling, and…

人工智能 · 计算机科学 2026-03-03 Po-Nien Kung , Zhen Yang , Jeffrey Luo , Cheng-Fu Yang , Haikang Deng , Zi-Yi Dou , Yinfei Yang , Nanyun Peng , Zhe Gan , Kai-Wei Chang

LLM-based equation discovery offers a promising route to recovering symbolic laws from data, but many systems still rely on generation-centered loops that propose candidates, fit parameters, score results, and reuse selected examples. Such…

人工智能 · 计算机科学 2026-05-19 Jiarui Su , Songjun Tu , Bei Sun , Xiaojun Liang