中文
相关论文

相关论文: VideoSEAL: Mitigating Evidence Misalignment in Age…

200 篇论文

Large Language Models (LLMs) have allowed recent LLM-based approaches to achieve excellent performance on long-video understanding benchmarks. We investigate how extensive world knowledge and strong reasoning skills of underlying LLMs…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Kanchana Ranasinghe , Xiang Li , Kumara Kahatapitiya , Michael S. Ryoo

Multimodal Large Language Models (MLLMs) have demonstrated impressive performance in short video understanding. However, understanding long-form videos still remains challenging for MLLMs. This paper proposes TimeSuite, a collection of new…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Xiangyu Zeng , Kunchang Li , Chenting Wang , Xinhao Li , Tianxiang Jiang , Ziang Yan , Songze Li , Yansong Shi , Zhengrong Yue , Yi Wang , Yali Wang , Yu Qiao , Limin Wang

Verifiers--functions assigning rewards to agent behavior--have been key to AI progress in math, code, and games. However, extending gains to domains without clear-cut success criteria remains a challenge: while humans can recognize desired…

人工智能 · 计算机科学 2026-03-10 Moises Andrade , Joonhyuk Cha , Brandon Ho , Vriksha Srihari , Karmesh Yadav , Zsolt Kira

Video Question Answering (VideoQA) is a challenging task that requires understanding complex visual and temporal relationships within videos to answer questions accurately. In this work, we introduce \textbf{ReasVQA} (Reasoning-enhanced…

计算机视觉与模式识别 · 计算机科学 2025-01-24 Jianxin Liang , Xiaojun Meng , Huishuai Zhang , Yueqian Wang , Jiansheng Wei , Dongyan Zhao

Current large vision-language models (LVLMs) typically employ a connector module to link visual features with text embeddings of large language models (LLMs) and use end-to-end training to achieve multi-modal understanding in a unified…

人工智能 · 计算机科学 2025-08-14 Zixian Guo , Ming Liu , Qilong Wang , Zhilong Ji , Jinfeng Bai , Lei Zhang , Wangmeng Zuo

Large Vision-Language Models (LVLMs) have shown significant progress in video understanding, yet they face substantial challenges in tasks requiring precise spatiotemporal localization at the instance level. Existing methods primarily rely…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Yiming Zhao , Yu Zeng , Wenxuan Huang , Zhen Fang , Qing Miao , Qisheng Su , Jiawei Zhao , Jiayin Cai , Lin Chen , Zehui Chen , Yukun Qi , Yao Hu , Xiaolong Jiang , Feng Zhao

Despite recent advances in video understanding, the capabilities of Large Video Language Models (LVLMs) to perform video-based causal reasoning remains underexplored, largely due to the absence of relevant and dedicated benchmarks for…

计算机视觉与模式识别 · 计算机科学 2025-05-14 Pritam Sarkar , Ali Etemad

Recent progress in multimodal large language models has markedly enhanced the understanding of short videos (typically under one minute), and several evaluation datasets have emerged accordingly. However, these advancements fall short of…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Weihan Wang , Zehai He , Wenyi Hong , Yean Cheng , Xiaohan Zhang , Ji Qi , Xiaotao Gu , Shiyu Huang , Bin Xu , Yuxiao Dong , Ming Ding , Jie Tang

Long-term activity forecasting is an especially challenging research problem because it requires understanding the temporal relationships between observed actions, as well as the variability and complexity of human activities. Despite…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Reuben Tan , Matthias De Lange , Michael Iuzzolino , Bryan A. Plummer , Kate Saenko , Karl Ridgeway , Lorenzo Torresani

This paper presents question-answering on dense video events, a novel task that answers and grounds dense-event questions in long videos, thus challenging MLLMs to faithfully comprehend and reason about multiple events over extended periods…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Hangyu Qin , Junbin Xiao , Angela Yao

Multimodal large language models (MLLMs) have achieved remarkable progress in video understanding. However, seemingly plausible outputs often suffer from poor visual and temporal grounding: a model may fabricate object existence, assign…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Yihao Quan , Zeru Shi , Jinman Zhao , Ruixiang Tang

While Reinforcement Learning with Verifiable Reward (RLVR) significantly advances image reasoning in Large Vision-Language Models (LVLMs), its application to complex video reasoning remains underdeveloped. This gap stems primarily from a…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Congzhi Zhang , Zhibin Wang , Yinchao Ma , Jiawei Peng , Yihan Wang , Qiang Zhou , Jun Song , Bo Zheng

Multimodal large language models have recently achieved remarkable progress in video question answering (VideoQA) by jointly processing visual, textual, and audio information. However, it remains unclear which video representations are most…

信息检索 · 计算机科学 2025-10-15 Zhi Li , Yanan Wang , Hao Niu , Julio Vizcarra , Masato Taya

Large Multimodal Models (LMMs) have demonstrated impressive performance in short video understanding tasks but face great challenges when applied to long video understanding. In contrast, Large Language Models (LLMs) exhibit outstanding…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Hongchen Wei , Zhenzhong Chen

Large Vision-Language Models (LVLMs) face a fundamental dilemma in video reasoning: they are caught between the prohibitive computational costs of verbose reasoning and the hallucination risks of efficient, ungrounded approaches. To resolve…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Yanxiang Huang , Guohua Gao , Zhaoyang Wei , Jianyuan Ni

Multimodal Large Language Models (MLLMs) have made rapid progress in perception, understanding, and reasoning, yet existing benchmarks fall short in evaluating these abilities under continuous and dynamic real-world video streams. Such…

计算机视觉与模式识别 · 计算机科学 2026-01-16 Shuhang Xun , Sicheng Tao , Jungang Li , Yibo Shi , Zhixin Lin , Zhanhui Zhu , Yibo Yan , Hanqian Li , Linghao Zhang , Shikang Wang , Yixin Liu , Hanbo Zhang , Ying Ma , Xuming Hu

Multimodal Large Language Models (MLLMs) have shown strong performance on video question answering, but their application to long-form videos is constrained by limited context length and computational cost, making keyframe sampling…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Yiheng Wang , Lichen Zhu , Yueqian Lin , Yudong Liu , Jingyang Zhang , Hai "Helen" Li , Yiran Chen

Long-form video understanding remains fundamentally challenged by pervasive spatiotemporal redundancy and intricate narrative dependencies that span extended temporal horizons. While recent structured representations compress visual…

人工智能 · 计算机科学 2026-04-24 Yuehan Zhu , Jingqi Zhao , Jiawen Zhao , Xudong Mao , Baoquan Zhao

Cross-Video Reasoning (CVR) has emerged as a critical frontier in multimodal intelligence, requiring models to retrieve, align, and aggregate evidence distributed across multiple videos. Current Multimodal Large Language Models (MLLMs)…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Yilun Qiu , Jiahe Wang , Cilin Yan , Jiayin Cai , Xiaolong Jiang , Yao Hu , Chun Yuan

Medical vision--language models (VLMs) have shown strong potential for medical visual question answering (VQA), yet their reasoning remains largely text-centric: images are encoded once as static context, and subsequent inference is…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Suyang Xi , Songtao Hu , Yuxiang Lai , Wangyun Dan , Yaqi Liu , Shansong Wang , Xiaofeng Yang