English
Related papers

Related papers: Spatial-Temporal Transformer for Video Snapshot Co…

200 papers

Video-to-Video synthesis (Vid2Vid) has achieved remarkable results in generating a photo-realistic video from a sequence of semantic maps. However, this pipeline suffers from high computational cost and long inference latency, which largely…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Long Zhuo , Guangcong Wang , Shikai Li , Wayne Wu , Ziwei Liu

Compressive sensing (CS) is a new approach for the acquisition and recovery of sparse signals and images that enables sampling rates significantly below the classical Nyquist rate. Despite significant progress in the theory and methods of…

Computer Vision and Pattern Recognition · Computer Science 2013-06-27 Aswin C Sankaranarayanan , Pavan K Turaga , Rama Chellappa , Richard G Baraniuk

Despite great progress achieved by transformer in various vision tasks, it is still underexplored for skeleton-based action recognition with only a few attempts. Besides, these methods directly calculate the pair-wise global self-attention…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Zhimin Gao , Peitao Wang , Pei Lv , Xiaoheng Jiang , Qidong Liu , Pichao Wang , Mingliang Xu , Wanqing Li

Convolutional neural network (CNN) based methods have achieved great successes in medical image segmentation, but their capability to learn global representations is still limited due to using small effective receptive fields of convolution…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Pengfei Gu , Yejia Zhang , Chaoli Wang , Danny Z. Chen

Convolutional neural networks have achieved excellent results in compressed video quality enhancement task in recent years. State-of-the-art methods explore the spatiotemporal information of adjacent frames mainly by deformable convolution.…

Multimedia · Computer Science 2022-10-26 Li Yu , Wenshuai Chang , Shiyu Wu , Moncef Gabbouj

The partially separable functions (PSF) model is commonly adopted in dynamic MRI reconstruction, as is the underlying signal model in many reconstruction methods including the ones relying on low-rank assumptions. Even though the PSF model…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Rodrigo A. Lobos , Xiaokai Wang , Rex T. L. Fung , Yongli He , David Frey , Dinank Gupta , Zhongming Liu , Jeffrey A. Fessler , Douglas C. Noll

Multivariate long-term time series forecasting is of great application across many domains, such as energy consumption and weather forecasting. With the development of transformer-based methods, the performance of multivariate long-term…

Machine Learning · Computer Science 2023-05-29 Zheng Sun , Yi Wei , Wenxiao Jia , Long Yu

Video restoration (e.g., video super-resolution) aims to restore high-quality frames from low-quality frames. Different from single image restoration, video restoration generally requires to utilize temporal information from multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Jingyun Liang , Jiezhang Cao , Yuchen Fan , Kai Zhang , Rakesh Ranjan , Yawei Li , Radu Timofte , Luc Van Gool

Real-time surgical phase recognition is a fundamental task in modern operating rooms. Previous works tackle this task relying on architectures arranged in spatio-temporal order, however, the supportive benefits of intermediate spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Xiaojie Gao , Yueming Jin , Yonghao Long , Qi Dou , Pheng-Ann Heng

Recompositing channel state information (CSI) from the beamforming feedback matrix (BFM), which is a compressed version of CSI and can be captured because of its lack of encryption, is an alternative way of implementing firmware-agnostic…

Signal Processing · Electrical Eng. & Systems 2022-06-06 Hiroki Shimomura , Yusuke Koda , Takamochi Kanda , Koji Yamamoto , Takayuki Nishio , Akihito Taya

Due to storage and bandwidth limitations, videos transmitted over the Internet often exhibit low quality, characterized by low-resolution and compression artifacts. Although video super-resolution (VSR) is an efficient video enhancing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Hongyu An , Xinfeng Zhang , Shijie Zhao , Li Zhang , Ruiqin Xiong

We use mechanical translation of a coded aperture for code division multiple access compression of video. We present experimental results for reconstruction at 148 frames per coded snapshot.

Computer Vision and Pattern Recognition · Computer Science 2015-06-15 Patrick Llull , Xuejun Liao , Xin Yuan , Jianbo Yang , David Kittle , Lawrence Carin , Guillermo Sapiro , David J. Brady

Compressed video super-resolution (VSR) aims to restore high-resolution frames from compressed low-resolution counterparts. Most recent VSR approaches often enhance an input frame by borrowing relevant textures from neighboring video…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Zhongwei Qiu , Huan Yang , Jianlong Fu , Dongmei Fu

A Transformer-based Image Compression (TIC) approach is developed which reuses the canonical variational autoencoder (VAE) architecture with paired main and hyper encoder-decoders. Both main and hyper encoders are comprised of a sequence of…

Image and Video Processing · Electrical Eng. & Systems 2021-11-15 Ming Lu , Peiyao Guo , Huiqing Shi , Chuntong Cao , Zhan Ma

Video compression has always been a popular research area, where many traditional and deep video compression methods have been proposed. These methods typically rely on signal prediction theory to enhance compression performance by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Lv Tang , Xinfeng Zhang , Gai Zhang , Xiaoqi Ma

This paper presents a novel framework for processing volumetric medical information using Visual Transformers (ViTs). First, We extend the state-of-the-art Swin Transformer model to the 3D medical domain. Second, we propose a new approach…

Image and Video Processing · Electrical Eng. & Systems 2024-06-06 Cristhian Forigua , Maria Escobar , Pablo Arbelaez

Transformer-based approaches have been successfully proposed for 3D human pose estimation (HPE) from 2D pose sequence and achieved state-of-the-art (SOTA) performance. However, current SOTAs have difficulties in modeling spatial-temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Xiaoye Qian , Youbao Tang , Ning Zhang , Mei Han , Jing Xiao , Ming-Chun Huang , Ruei-Sung Lin

Video denoising aims to recover high-quality frames from the noisy video. While most existing approaches adopt convolutional neural networks~(CNNs) to separate the noise from the original visual content, however, CNNs focus on local…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Wulian Yun , Mengshi Qi , Chuanming Wang , Huiyuan Fu , Huadong Ma

Magnetic Resonance Imaging (MRI) is a crucial medical imaging technology for the screening and diagnosis of frequently occurring cancers. However image quality may suffer by long acquisition times for MRIs due to patient motion, as well as…

Computer Vision and Pattern Recognition · Computer Science 2015-12-29 Edward Li , Farzad Khalvati , Mohammad Javad Shafiee , Masoom A. Haider , Alexander Wong

High-quality video inpainting that completes missing regions in video frames is a promising yet challenging task. State-of-the-art approaches adopt attention models to complete a frame by searching missing contents from reference frames,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Yanhong Zeng , Jianlong Fu , Hongyang Chao