中文
相关论文

相关论文: End-to-End Video Question Answering with Frame Sco…

200 篇论文

Matching-based networks have achieved state-of-the-art performance for video object segmentation (VOS) tasks by storing every-k frames in an external memory bank for future inference. Storing the intermediate frames' predictions provides…

计算机视觉与模式识别 · 计算机科学 2022-04-15 Ali Pourganjalikhan , Charalambos Poullis

Long-form video question answering (VQA) overwhelms current vision-language models (VLMs) because attention and key-value (KV) caches grow with runtime, forcing either expensive inference or near-sighted sliding windows. We introduce…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Shrenik Patel , Daivik Patel

The end-to-end learning ability of self-driving vehicles has achieved significant milestones over the last decade owing to rapid advances in deep learning and computer vision algorithms. However, as autonomous driving technology is a…

计算机视觉与模式识别 · 计算机科学 2023-07-21 Shahin Atakishiyev , Mohammad Salameh , Housam Babiker , Randy Goebel

Robust scene segmentation and keyframe extraction are essential preprocessing steps in video understanding pipelines, supporting tasks such as indexing, summarization, and semantic retrieval. However, existing methods often lack…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Vasilii Korolkov

The real world is dynamic, yet most image fusion methods process static frames independently, ignoring temporal correlations in videos and leading to flickering and temporal inconsistency. To address this, we propose Unified Video Fusion…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Zixiang Zhao , Haowen Bai , Bingxin Ke , Yukun Cui , Lilun Deng , Yulun Zhang , Kai Zhang , Konrad Schindler

One of the core components of conventional (i.e., non-learned) video codecs consists of predicting a frame from a previously-decoded frame, by leveraging temporal correlations. In this paper, we propose an end-to-end learned system for…

图像与视频处理 · 电气工程与系统科学 2020-04-22 Nannan Zou , Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Jani Lainema , Emre Aksu , Miska Hannuksela , Esa Rahtu

The predominant approach to Visual Question Answering (VQA) demands that the model represents within its weights all of the information required to answer any question about any image. Learning this information from any real training set…

计算机视觉与模式识别 · 计算机科学 2017-11-23 Damien Teney , Anton van den Hengel

In this technical report, we introduce a framework to address Grounded Video Question Answering (GVQA) task for the ICCV 2025 Perception Test Challenge. The GVQA task demands robust multimodal models capable of complex reasoning over video…

计算机视觉与模式识别 · 计算机科学 2025-11-05 Jinhwan Seo , Yoonki Cho , Junhyug Noh , Sung-eui Yoon

Knowledge-based visual question answering (KB-VQA) requires vision-language models to understand images and use external knowledge, especially for rare entities and long-tail facts. Most existing retrieval-augmented generation (RAG) methods…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Zhuohong Chen , Zhenxian Wu , Yunyao Yu , Hangrui Xu , Zirui Liao , Zhifang Liu , Xiangwen Deng , Pen Jiao , Haoqian Wang

We propose ReKV, a novel training-free approach that enables efficient streaming video question-answering (StreamingVQA), by seamlessly integrating with existing Video Large Language Models (Video-LLMs). Traditional VideoQA systems struggle…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Shangzhe Di , Zhelun Yu , Guanghao Zhang , Haoyuan Li , Tao Zhong , Hao Cheng , Bolin Li , Wanggui He , Fangxun Shu , Hao Jiang

Previous blind or No Reference (NR) video quality assessment (VQA) models largely rely on features drawn from natural scene statistics (NSS), but under the assumption that the image statistics are stationary in the spatial domain. Several…

图像与视频处理 · 电气工程与系统科学 2022-07-27 Yize Jin , Anjul Patney , Richard Webb , Alan Bovik

Efficiently reconstructing 3D scenes from monocular video remains a core challenge in computer vision, vital for applications in virtual reality, robotics, and scene understanding. Recently, frame-by-frame progressive reconstruction without…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Wenyan Cong , Hanqing Zhu , Kevin Wang , Jiahui Lei , Colton Stearns , Yuanhao Cai , Leonidas Guibas , Zhangyang Wang , Zhiwen Fan

Despite the number of currently available datasets on video question answering, there still remains a need for a dataset involving multi-step and non-factoid answers. Moreover, relying on video transcripts remains an under-explored topic.…

计算与语言 · 计算机科学 2020-06-02 Anthony Colas , Seokhwan Kim , Franck Dernoncourt , Siddhesh Gupte , Daisy Zhe Wang , Doo Soon Kim

Video matting is crucial for applications such as film production and virtual reality, yet deploying its computationally intensive models on resource-constrained devices presents challenges. Quantization is a key technique for model…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Tianrui Zhu , Houyuan Chen , Ruihao Gong , Michele Magno , Haotong Qin , Kai Zhang

Video Large Language Models (Video-LLMs) are flourishing and has advanced many video-language tasks. As a golden testbed, Video Question Answering (VideoQA) plays pivotal role in Video-LLM developing. This work conducts a timely and…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Junbin Xiao , Nanxin Huang , Hangyu Qin , Dongyang Li , Yicong Li , Fengbin Zhu , Zhulin Tao , Jianxing Yu , Liang Lin , Tat-Seng Chua , Angela Yao

Medical Visual Question Answering (Med-VQA) is a very important task in healthcare industry, which answers a natural language question with a medical image. Existing VQA techniques in information systems can be directly applied to solving…

人工智能 · 计算机科学 2023-12-14 Xiaojie Hong , Zixin Song , Liangzhi Li , Xiaoli Wang , Feiyan Liu

Video question answering (VQA) with vision-language models (VLMs) depends critically on which frames are selected from the input video, yet most systems rely on uniform or heuristic sampling that cannot be optimized for downstream answering…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Xiangyu Bai , Bishoy Galoaa , Sarah Ostadabbas

The advancement of Large Vision Language Models (LVLMs) has significantly improved multimodal understanding, yet challenges remain in video reasoning tasks due to the scarcity of high-quality, large-scale datasets. Existing video…

计算机视觉与模式识别 · 计算机科学 2024-11-25 Songhao Han , Wei Huang , Hairong Shi , Le Zhuo , Xiu Su , Shifeng Zhang , Xu Zhou , Xiaojuan Qi , Yue Liao , Si Liu

Video stabilization refers to the problem of transforming a shaky video into a visually pleasing one. The question of how to strike a good trade-off between visual quality and computational speed has remained one of the open challenges in…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Weiyue Zhao , Xin Li , Zhan Peng , Xianrui Luo , Xinyi Ye , Hao Lu , Zhiguo Cao

In this paper, we propose a conditional early exiting framework for efficient video recognition. While existing works focus on selecting a subset of salient frames to reduce the computation costs, we propose to use a simple sampling…

计算机视觉与模式识别 · 计算机科学 2021-04-29 Amir Ghodrati , Babak Ehteshami Bejnordi , Amirhossein Habibian