English
Related papers

Related papers: Sparse-Dense Side-Tuner for efficient Video Tempor…

200 papers

Diffusion Transformers (DiTs) have become a leading backbone for video generation, yet their quadratic attention cost remains a major bottleneck. Sparse attention reduces this cost by computing only a subset of attention blocks. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xuanyi Zhou , Qiuyang Mang , Shuo Yang , Haocheng Xi , Jintao Zhang , Huanzhi Mao , Joseph E. Gonzalez , Kurt Keutzer , Ion Stoica , Alvin Cheung

Visual Autoregressive modeling (VAR) has emerged as a highly efficient alternative to diffusion-based frameworks, achieving comparable synthesis quality. However, as this paradigm extends to Spacetime Autoregressive modeling (STAR) for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Sungwoong Yune , Suheon Jeong , Joo-Young Kim

Vision Transformers (ViTs) have achieved remarkable success in computer vision tasks. However, their potential in rotation-sensitive scenarios has not been fully explored, and this limitation may be inherently attributed to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Hongtian Yu , Yunjie Tian , Qixiang Ye , Yunfan Liu

Achieving a universally high accuracy in object detection is quite challenging, and the mainstream focus in the industry currently lies on detecting specific classes of objects. However, deploying one or multiple object detection networks…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Feng Chen

Temporal Sentence Grounding in Videos (TSGV), which aims to ground a natural language sentence in an untrimmed video, has drawn widespread attention over the past few years. However, recent studies have found that current benchmark datasets…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Xiaohan Lan , Yitian Yuan , Xin Wang , Long Chen , Zhi Wang , Lin Ma , Wenwu Zhu

One key challenge of exemplar-guided image generation lies in establishing fine-grained correspondences between input and guided images. Prior approaches, despite the promising results, have relied on either estimating dense attention to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Songhua Liu , Jingwen Ye , Sucheng Ren , Xinchao Wang

Reconstructing dynamic 4D scenes from monocular videos is a fundamental yet challenging task. While recent 3D foundation models provide strong geometric priors, their performance significantly degrades in dynamic environments. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Ying Zang , Xuanyi Liu , Yidong Han , Deyi Ji , Chaotao Ding , Yuanqi Hu , Qi Zhu , Xuanfu Li , Jin Ma , Lingyun Sun , Tianrun Chen , Lanyun Zhu

Detecting visual content on language expression has become an emerging topic in the community. However, in the video domain, the existing setting, i.e., spatial-temporal video grounding (STVG), is formulated to only detect one pre-existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Wei Ji , Xiangyan Liu , Yingfei Sun , Jiajun Deng , You Qin , Ammar Nuwanna , Mengyao Qiu , Lina Wei , Roger Zimmermann

Diffusion Transformers (DiTs) have shown remarkable performance in generating high-quality videos. However, the quadratic complexity of 3D full attention remains a bottleneck in scaling DiT training, especially with high-definition, lengthy…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-02 Xin Tan , Yuetao Chen , Yimin Jiang , Xing Chen , Kun Yan , Nan Duan , Yibo Zhu , Daxin Jiang , Hong Xu

Existing approaches to increasing the effective depth of Transformers predominantly rely on parameter reuse, extending computation through recursive execution. Under this paradigm, the network structure remains static along the training…

Computation and Language · Computer Science 2026-04-17 Yao Chen , Yilong Chen , Yinqi Yang , Junyuan Shang , Zhenyu Zhang , Zefeng Zhang , Shuaiyi Nie , Shuohuan Wang , Yu Sun , Hua Wu , HaiFeng Wang , Tingwen Liu

Diffusion-based video generation has advanced substantially in visual fidelity and temporal coherence, but practical deployment remains limited by the quadratic complexity of full attention. Training-free sparse attention is attractive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Xuzhe Zheng , Yuexiao Ma , Jing Xu , Xiawu Zheng , Rongrong Ji , Fei Chao

Video Super-Resolution (VSR) aims to restore high-resolution (HR) videos from low-resolution (LR) videos. Existing VSR techniques usually recover HR frames by extracting pertinent textures from nearby frames with known degradation…

Image and Video Processing · Electrical Eng. & Systems 2023-01-02 Zhongwei Qiu , Huan Yang , Jianlong Fu , Daochang Liu , Chang Xu , Dongmei Fu

Many algorithms have been developed to solve the inverse problem of coded aperture snapshot spectral imaging (CASSI), i.e., recovering the 3D hyperspectral images (HSIs) from a 2D compressive measurement. In recent years, learning-based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Yuanhao Cai , Jing Lin , Xiaowan Hu , Haoqian Wang , Xin Yuan , Yulun Zhang , Radu Timofte , Luc Van Gool

High temporal resolution is essential for capturing fine-grained details in video understanding. However, current video large language models (VLLMs) and benchmarks mostly rely on low-frame-rate sampling, such as uniform sampling or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Haichao Zhang , Wenhao Chai , Shwai He , Ang Li , Yun Fu

Text-video retrieval is a critical multi-modal task to find the most relevant video for a text query. Although pretrained models like CLIP have demonstrated impressive potential in this area, the rising cost of fully finetuning these models…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Xiangpeng Yang , Linchao Zhu , Xiaohan Wang , Yi Yang

Transformers have been successfully applied to the visual tracking task and significantly promote tracking performance. The self-attention mechanism designed to model long-range dependencies is the key to the success of Transformers.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Zhihong Fu , Zehua Fu , Qingjie Liu , Wenrui Cai , Yunhong Wang

Video transformers have recently emerged as an effective alternative to convolutional networks for action classification. However, most prior video transformers adopt either global space-time attention or hand-defined strategies to compare…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jue Wang , Lorenzo Torresani

Learned video compression (LVC) has witnessed remarkable advancements in recent years. Similar as the traditional video coding, LVC inherits motion estimation/compensation, residual coding and other modules, all of which are implemented…

Image and Video Processing · Electrical Eng. & Systems 2023-09-22 Yanbo Gao , Wenjia Huang , Shuai Li , Hui Yuan , Mao Ye , Siwei Ma

Text-guided Video Temporal Grounding (VTG) aims to localize relevant segments in untrimmed videos based on textual descriptions, encompassing two subtasks: Moment Retrieval (MR) and Highlight Detection (HD). Although previous typical…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Zhuo Cao , Bingqing Zhang , Heming Du , Xin Yu , Xue Li , Sen Wang

Spatio-temporal video grounding (STVG) requires localizing a target object in untrimmed videos both temporally and spatially from natural language descriptions. Despite their strong language understanding, multimodal large language models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Xin Gu , Haoji Zhang , Qihang Fan , Jingxuan Niu , Zhipeng Zhang , Libo Zhang , Guang Chen , Fan Chen , Longyin Wen , Sijie Zhu