English
Related papers

Related papers: Reconstruction as a Bridge for Event-Based Visual …

200 papers

We propose a novel framework for open-ended video question answering that enhances reasoning depth and robustness in complex real-world scenarios, as benchmarked on the CVRR-ES dataset. Existing Video-Large Multimodal Models (Video-LMMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Jun Xie , Zhaoran Zhao , Xiongjun Guan , Yingjian Zhu , Hongzhu Yi , Xinming Wang , Feng Chen , Zhepeng Wang

Reconstructing dynamic videos from fMRI is important for understanding visual cognition and enabling vivid brain-computer interfaces. However, current methods are critically limited to single-shot clips, failing to address the multi-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Wenwen Zeng , Yonghuang Wu , Yifan Chen , Xuan Xie , Chengqian Zhao , Feiyu Yin , Guoqing Wu , Jinhua Yu

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, single-model responses often exhibit inconsistencies, hallucinations, and varying quality across different…

Computation and Language · Computer Science 2025-12-25 Omer Jauhar Khan

Integrating image generation and understanding into a single framework has become a pivotal goal in the multimodal domain. However, how understanding can effectively assist generation has not been fully explored. Unlike previous works that…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Yanbing Zeng , Jia Wang , Hanghang Ma , Junqiang Wu , Jie Zhu , Xiaoming Wei , Jie Hu

Robotic Vision-Language-Action (VLA) models generalize well for open-ended manipulation, but their perception is fragile under sensing-stage degradations such as extreme low light, motion blur, and black clipping. We present E-VLA, an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jiajun Zhai , Hao Shi , Shangwei Guo , Kailun Yang , Kaiwei Wang

Multimodal large language models (MLLMs) that integrate visual and textual reasoning leverage chain-of-thought (CoT) prompting to tackle complex visual tasks, yet continue to exhibit visual hallucinations and an over-reliance on textual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Jing Bi , Guangyu Sun , Ali Vosoughi , Chen Chen , Chenliang Xu

Event reasoning is a fundamental ability that underlies many applications. It requires event schema knowledge to perform global reasoning and needs to deal with the diversity of the inter-event relations and the reasoning paradigms. How…

Computation and Language · Computer Science 2024-08-05 Zhengwei Tao , Zhi Jin , Yifan Zhang , Xiancai Chen , Haiyan Zhao , Jia Li , Bing Liang , Chongyang Tao , Qun Liu , Kam-Fai Wong

While large language models (LLMs) have shown remarkable capabilities in natural language processing, they struggle with complex, multi-step reasoning tasks involving knowledge graphs (KGs). Existing approaches that integrate LLMs and KGs…

Computation and Language · Computer Science 2024-09-25 Zixuan Dong , Baoyun Peng , Yufei Wang , Jia Fu , Xiaodong Wang , Yongxue Shan , Xin Zhou

The evolution of Large Language Model (LLM) agents towards System~2 reasoning, characterized by deliberative, high-precision problem-solving, requires maintaining rigorous logical integrity over extended horizons. However, prevalent memory…

Artificial Intelligence · Computer Science 2026-05-15 Kaixiang Wang , Yidan Lin , Jiong Lou , Zhaojiacheng Zhou , Bunyod Suvonov , Jie Li

The rapid development of Multi-modality Large Language Models (MLLMs) has navigated a paradigm shift in computer vision, moving towards versatile foundational models. However, evaluating MLLMs in low-level visual perception and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zicheng Zhang , Haoning Wu , Erli Zhang , Guangtao Zhai , Weisi Lin

Event cameras are novel vision sensors that report per-pixel brightness changes as a stream of asynchronous "events". They offer significant advantages compared to standard cameras due to their high temporal resolution, high dynamic range…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Daniel Gehrig , Michelle Rüegg , Mathias Gehrig , Javier Hidalgo Carrio , Davide Scaramuzza

Bridge infrastructure inspection is a critical but labor-intensive task requiring expert assessment of structural damage such as rebar exposure, cracking, and corrosion. This paper presents a comprehensive study of quantized Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Takato Yasuno

Charts are widely used to present complex information. Deriving meaningful insights in real-world contexts often requires interpreting multiple related charts together. Research on understanding multi-chart images has not been extensively…

Computation and Language · Computer Science 2026-04-24 Azher Ahmed Efat , Seok Hwan Song , Wallapak Tavanapong

Large Vision-Language Models (LVLMs) have shown remarkable progress in various multimodal tasks, yet they often struggle with complex visual reasoning that requires multi-step inference. To address this limitation, we propose MF-SQ-LLaVA, a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Liu Jing , Amirul Rahman

With the rapid development of video Multimodal Large Language Models (MLLMs), numerous benchmarks have been proposed to assess their video understanding capability. However, due to the lack of rich events in the videos, these datasets may…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Yifan Du , Kun Zhou , Yuqi Huo , Yifan Li , Wayne Xin Zhao , Haoyu Lu , Zijia Zhao , Bingning Wang , Weipeng Chen , Ji-Rong Wen

Despite rapid advancements in video generation models, aligning their outputs with complex user intent remains challenging. Existing test-time optimization methods are typically either computationally expensive or require white-box access…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yiwen Song , Tomas Pfister , Yale Song

Effectively applying Vision-Language Models (VLMs) to Video Question Answering (VideoQA) hinges on selecting a concise yet comprehensive set of frames, as processing entire videos is computationally infeasible. However, current frame…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Yuanhao Zou , Shengji Jin , Andong Deng , Youpeng Zhao , Jun Wang , Chen Chen

Tabular data is frequently captured in image form across a wide range of real-world scenarios such as financial reports, handwritten records, and document scans. These visual representations pose unique challenges for machine understanding,…

Artificial Intelligence · Computer Science 2026-02-10 Zhuoyan Xu , Haoyang Fang , Boran Han , Bonan Min , Bernie Wang , Cuixiong Hu , Shuai Zhang

The neuromorphic event cameras, which capture the optical changes of a scene, have drawn increasing attention due to their high speed and low power consumption. However, the event data are noisy, sparse, and nonuniform in the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Chang Liu , Xiaojuan Qi , Edmund Lam , Ngai Wong

Vision-Language Models (VLMs) have achieved remarkable success in various tasks, yet their robustness to real-world illumination variations remains largely unexplored. To bridge this gap, we propose \textbf{I}llumination…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Hanqing Liu , Shouwei Ruan , Yao Huang , Shiji Zhao , Xingxing Wei