English
Related papers

Related papers: Think, Then Verify: A Hypothesis-Verification Mult…

200 papers

Recent advancements in large video models (LVMs) have significantly enhance video understanding. However, these models continue to suffer from hallucinations, producing content that conflicts with input videos. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Meng Luo , Shengqiong Wu , Liqiang Jing , Tianjie Ju , Li Zheng , Jinxiang Lai , Tianlong Wu , Xinya Du , Jian Li , Siyuan Yan , Jiebo Luo , William Yang Wang , Hao Fei , Mong-Li Lee , Wynne Hsu

The ideal form of Visual Question Answering requires understanding, grounding and reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most existing VQA benchmarks are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Kang Chen , Xiangqian Wu

Vision Language Models (VLMs) have recently shown significant advancements in video understanding, especially in feature alignment, event reasoning, and instruction-following tasks. However, their capability for counterfactual reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yuefei Chen , Jiang Liu , Xiaodong Lin , Ruixiang Tang

The inherent complexity of video understanding makes it difficult to attribute whether performance gains stem from visual perception, linguistic reasoning, or knowledge priors. While many benchmarks have emerged to assess high-level…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Geuntaek Lim , Minho Shim , Sungjune Park , Jaeyun Lee , Inwoong Lee , Taeoh Kim , Dongyoon Wee , Yukyung Choi

We present MiroThinker-1.7, a new research agent designed for complex long-horizon reasoning tasks. Building on this foundation, we further introduce MiroThinker-H1, which extends the agent with heavy-duty reasoning capabilities for more…

The rapid development of multimodal large-language models (MLLMs) has significantly expanded the scope of visual language reasoning, enabling unified systems to interpret and describe complex visual content. However, applying these models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Xinkui Zhao , Zuxin Wang , Yifan Zhang , Guanjie Cheng , Yueshen Xu , Shuiguang Deng , Chang Liu , Naibo Wang , Jianwei Yin

This paper presents question-answering on dense video events, a novel task that answers and grounds dense-event questions in long videos, thus challenging MLLMs to faithfully comprehend and reason about multiple events over extended periods…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Hangyu Qin , Junbin Xiao , Angela Yao

Real-time voice agents face a dilemma: end-to-end models often lack deep reasoning, while cascaded pipelines incur high latency by executing ASR, LLM reasoning, and TTS strictly in sequence, unlike human conversation where listeners often…

Sound · Computer Science 2026-01-29 Wenhao Zou , Yuwei Miao , Zhanyu Ma , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He , Jingwen Xu

Large Vision-Language Models (LVLMs) have shown significant progress in video understanding, yet they face substantial challenges in tasks requiring precise spatiotemporal localization at the instance level. Existing methods primarily rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yiming Zhao , Yu Zeng , Wenxuan Huang , Zhen Fang , Qing Miao , Qisheng Su , Jiawei Zhao , Jiayin Cai , Lin Chen , Zehui Chen , Yukun Qi , Yao Hu , Xiaolong Jiang , Feng Zhao

We present \revise (\underline{Re}asoning with \underline{Vi}deo \underline{S}parsity), a multi-round agent for video question answering (VQA). Instead of uniformly sampling frames, \revise selects a small set of informative frames,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Chenwei Xu , Zhen Ye , Shang Wu , Weijian Li , Zihan Wang , Zhuofan Xia , Lie Lu , Pranav Maneriker , Fan Du , Manling Li , Han Liu

Web-based 'deep research' agents aim to solve complex question - answering tasks through long-horizon interactions with online tools. These tasks remain challenging, as the underlying language models are often not optimized for long-horizon…

Computation and Language · Computer Science 2025-10-17 Shrey Pandit , Xuan-Phi Nguyen , Yifei Ming , Austin Xu , Jiayu Wang , Caiming Xiong , Shafiq Joty

Referring Video Object Segmentation (RVOS) aims to segment objects in videos based on textual queries. Current methods mainly rely on large-scale supervised fine-tuning (SFT) of Multi-modal Large Language Models (MLLMs). However, this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Haichao Jiang , Tianming Liang , Wei-Shi Zheng , Jian-Fang Hu

Multimodal LLMs are turning their focus to video benchmarks, however most video benchmarks only provide outcome supervision, with no intermediate or interpretable reasoning steps. This makes it challenging to assess if models are truly able…

Long-horizon action-conditioned video generation aims to synthesize temporally coherent videos that follow complex action instructions over extended horizons, requiring procedural ordering, persistent action execution, and scene consistency…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Yu Yang , Yue Liao , Jianbiao Mei , Baisen Wang , Xuemeng Yang , Licheng Wen , Jiangning Zhang , Xiangtai Li , Liang Lv , Hanlin Chen , Botian Shi , Yong Liu , Shuicheng Yan , Gim Hee Lee

Applying Reinforcement Learning (RL) to Video Large Language Models (Video-LLMs) shows significant promise for complex video reasoning. However, popular Reinforcement Fine-Tuning (RFT) methods, such as outcome-based Group Relative Policy…

Computation and Language · Computer Science 2025-05-27 Yunxin Li , Xinyu Chen , Zitao Li , Zhenyu Liu , Longyue Wang , Wenhan Luo , Baotian Hu , Min Zhang

Long video understanding remains a formidable challenge for Multimodal Large Language Models (MLLMs) due to the prohibitive computational cost of processing dense frame sequences. Prevailing solutions, which select a keyframe subset,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Shaoguang Wang , Weiyu Guo , Ziyang Chen , Xuming Hu , Hui Xiong

Long video understanding is a significant and ongoing challenge in the intersection of multimedia and artificial intelligence. Employing large language models (LLMs) for comprehending video becomes an emerging and promising method. However,…

Computation and Language · Computer Science 2024-08-27 Yunxin Li , Xinyu Chen , Baotain Hu , Min Zhang

Video Question Answering (Video QA) is a challenging video understanding task that requires models to comprehend entire videos, identify the most relevant information based on contextual cues from a given question, and reason accurately to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Roberto Amoroso , Gengyuan Zhang , Rajat Koner , Lorenzo Baraldi , Rita Cucchiara , Volker Tresp

With the proliferation of Large Language Models (LLMs), the detection of misinformation has become increasingly important and complex. This research proposes an innovative verifiable misinformation detection LLM agent that goes beyond…

Artificial Intelligence · Computer Science 2025-08-06 Zikun Cui , Tianyi Huang , Chia-En Chiang , Cuiqianhe Du

Large Language Models (LLMs) have achieved impressive results in knowledge-based Visual Question Answering (VQA). However existing methods still have challenges: the inability to use external tools autonomously, and the inability to work in…

Computation and Language · Computer Science 2025-08-08 Zhongjian Hu , Peng Yang , Bing Li , Zhenqi Wang