中文
相关论文

相关论文: MambaVF: State Space Model for Efficient Video Fus…

200 篇论文

Transformers have proven effective in language modeling but are limited by high computational and memory demands that grow quadratically with input sequence length. State space models (SSMs) offer a promising alternative by reducing…

硬件体系结构 · 计算机科学 2025-08-06 Dongho Yoon , Gungyu Lee , Jaewon Chang , Yunjae Lee , Dongjae Lee , Minsoo Rhu

Multi-modal MRI offers valuable complementary information for diagnosis and treatment; however, its utility is limited by prolonged scanning times. To accelerate the acquisition process, a practical approach is to reconstruct images of the…

图像与视频处理 · 电气工程与系统科学 2024-07-09 Jing Zou , Lanqing Liu , Qi Chen , Shujun Wang , Zhanli Hu , Xiaohan Xing , Jing Qin

Sonar imaging is the primary modality for underwater target detection, yet small targets remain difficult to detect due to insufficient pixel coverage, low acoustic contrast, and scale ambiguity across imaging ranges. CNN-based detectors…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Hui Lin , Jiayi Li , Jing Wang , Shenghui Rong

The advent of Transformer and Mamba-based architectures has significantly advanced 3D medical image segmentation by enabling global contextual modeling, a capability traditionally limited in Convolutional Neural Networks (CNNs). However,…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Duy D. Nguyen , Phat T. Tran-Truong

Modeling high-resolution spatiotemporal representations, including both global dynamic contexts (e.g., holistic human motion tendencies) and local motion details (e.g., high-frequency changes of keypoints), is essential for video-based…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Runyang Feng , Hyung Jin Chang , Tze Ho Elden Tse , Boeun Kim , Yi Chang , Yixing Gao

Deep learning techniques have revolutionized the infrared and visible image fusion (IVIF), showing remarkable efficacy on complex scenarios. However, current methods do not fully combine frequency domain features with global semantic…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Tianpei Zhang , Yiming Zhu , Jufeng Zhao , Guangmang Cui , Yuchen Zheng

Visual tracking aims to automatically estimate the state of a target object in a video sequence, which is challenging especially in dynamic scenarios. Thus, numerous methods are proposed to introduce temporal cues to enhance tracking…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Yinchao Ma , Dengqing Yang , Zhangyu He , Wenfei Yang , Tianzhu Zhang

The rapid proliferation of online video content necessitates effective video summarization techniques. Traditional methods, often relying on a single modality (typically visual), struggle to capture the full semantic richness of videos.…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Shuo wang , Jihao Zhang

Endoscopic video-based tasks, such as visual navigation and surgical phase recognition, play a crucial role in minimally invasive surgeries by providing real-time assistance. While recent video foundation models have shown promise, their…

计算机视觉与模式识别 · 计算机科学 2025-05-16 Qingyao Tian , Huai Liao , Xinyan Huang , Bingyu Yang , Dongdong Lei , Sebastien Ourselin , Hongbin Liu

Recent advancements in state space models, notably Mamba, have demonstrated significant progress in modeling long sequences for tasks like language understanding. Yet, their application in vision tasks has not markedly surpassed the…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Tao Huang , Xiaohuan Pei , Shan You , Fei Wang , Chen Qian , Chang Xu

State-space models (SSMs), exemplified by S4, have introduced a novel context modeling method by integrating state-space techniques into deep learning. However, they struggle with global context modeling due to their data-independent…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Hamid Suleman , Syed Talal Wasim , Muzammal Naseer , Juergen Gall

Recently, the state space model Mamba has demonstrated efficient long-sequence modeling capabilities, particularly for addressing long-sequence visual tasks in 3D medical imaging. However, existing generative self-supervised learning…

计算机视觉与模式识别 · 计算机科学 2025-05-15 Fenghe Tang , Bingkun Nian , Yingtai Li , Zihang Jiang , Jie Yang , Wei Liu , S. Kevin Zhou

Recent event-based image reconstruction methods predominantly rely on Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) to process complementary event information. However, these architectures face fundamental limitations:…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Wei Yu , Yunhang Qian

Video-language models (VLMs) face rapid inference costs as visual token counts scale with video length. For example, 32 frames at $448{\times}448$ resolution already yield >8,000 visual tokens in Qwen3-VL, making LLM prefill the dominant…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Simin Huo , Ning LI

Long-context video understanding in multimodal large language models (MLLMs) faces a critical challenge: balancing computational efficiency with the retention of fine-grained spatio-temporal patterns. Existing approaches (e.g., sparse…

We propose SlowFast-LLaVA (or SF-LLaVA for short), a training-free video large language model (LLM) that can jointly capture detailed spatial semantics and long-range temporal context without exceeding the token budget of commonly used…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Mingze Xu , Mingfei Gao , Zhe Gan , Hong-You Chen , Zhengfeng Lai , Haiming Gang , Kai Kang , Afshin Dehghan

Image restoration is a critical task in low-level computer vision, aiming to restore high-quality images from degraded inputs. Various models, such as convolutional neural networks (CNNs), generative adversarial networks (GANs),…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Yuan Shi , Bin Xia , Xiaoyu Jin , Xing Wang , Tianyu Zhao , Xin Xia , Xuefeng Xiao , Wenming Yang

Semantic segmentation is a fundamental task in computer vision with wide-ranging applications, including autonomous driving and robotics. While RGB-based methods have achieved strong performance with CNNs and Transformers, their…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Fuqiang Gu , Yuanke Li , Xianlei Long , Kangping Ji , Chao Chen , Qingyi Gu , Zhenliang Ni

This study introduces an efficient and effective method, MeDM, that utilizes pre-trained image Diffusion Models for video-to-video translation with consistent temporal flow. The proposed framework can render videos from scene position…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Ernie Chu , Tzuhsuan Huang , Shuo-Yen Lin , Jun-Cheng Chen

In recent years, visually-rich document understanding has attracted increasing attention. Transformer-based pre-trained models have become the mainstream approach, yielding significant performance gains in this field. However, the…

计算与语言 · 计算机科学 2025-02-11 Pengfei Hu , Zhenrong Zhang , Jiefeng Ma , Shuhang Liu , Jun Du , Jianshu Zhang