English
Related papers

Related papers: Spatial-Temporal Transformer for Video Snapshot Co…

200 papers

Snapshot Compressed Imaging (SCI) offers high-speed, low-bandwidth, and energy-efficient image acquisition, but remains challenged by low-light and low signal-to-noise ratio (SNR) conditions. Moreover, practical hardware constraints in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Fengpu Pan , Heting Gao , Jiangtao Wen , Yuxing Han

Spatio-temporal traffic forecasting is challenging due to complex temporal patterns, dynamic spatial structures, and diverse input formats. Although Transformer-based models offer strong global modeling, they often struggle with rigid…

Artificial Intelligence · Computer Science 2025-08-20 Jiayu Fang , Zhiqi Shao , S T Boris Choy , Junbin Gao

Recent advancements in multimodal large models have significantly bridged the representation gap between diverse modalities, catalyzing the evolution of video multimodal interpretation, which enhances users' understanding of video content…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xu Zhang , Jin Yuan , BinHong Yang , Xuan Liu , Qianjun Zhang , Yuyi Wang , Zhiyong Li , Hanwang Zhang

The current methods of video-based 3D human pose estimation have achieved significant progress.However, they still face pressing challenges, such as the underutilization of spatiotemporal bodystructure features in transformers and the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Yang Liu , Zhiyong Zhang

Conventional image sensors have limited dynamic range, causing saturation in high-dynamic-range (HDR) scenes. Modulo cameras address this by folding incident irradiance into a bounded range, yet require specialized unwrapping algorithms to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Tianyu Geng , Feng Ji , Wee Peng Tay

Space-time video super-resolution (STVSR) aims to increase the spatial and temporal resolutions of low-resolution and low-frame-rate videos. Recently, deformable convolution based methods have achieved promising STVSR performance, but they…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Gang Xu , Jun Xu , Zhen Li , Liang Wang , Xing Sun , Ming-Ming Cheng

The advent of neuralmorphic spike cameras has garnered significant attention for their ability to capture continuous motion with unparalleled temporal resolution.However, this imaging attribute necessitates considerable resources for binary…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Kexiang Feng , Chuanmin Jia , Siwei Ma , Wen Gao

The emerging technology of snapshot compressive imaging (SCI) enables capturing high dimensional (HD) data in an efficient way. It is generally implemented by two components: an optical encoder that compresses HD signals into a 2D…

Image and Video Processing · Electrical Eng. & Systems 2022-02-03 Jiamian Wang , Yulun Zhang , Xin Yuan , Yun Fu , Zhiqiang Tao

High resolution images are widely used in our daily life, whereas high-speed video capture is challenging due to the low frame rate of cameras working at the high resolution mode. Digging deeper, the main bottleneck lies in the low…

Image and Video Processing · Electrical Eng. & Systems 2021-08-23 Zhihong Zhang , Chao Deng , Yang Liu , Xin Yuan , Jinli Suo , Qionghai Dai

We introduce a compressive single-pixel imaging (SPI) framework for high-resolution image capture in fractions of a second. This framework combines a dedicated sampling strategy with a tailored reconstruction method to enable high-quality…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Anna Pastuszczak , Rafał Stojek , Piotr Wróbel , Magdalena Cwojdzińska , Kacper Sobczak , Rafał Kotyński

The pursuit of higher compression efficiency continuously drives the advances of video coding technologies. Fundamentally, we wish to find better "predictions" or "priors" that are reconstructed previously to remove the signal dependency…

Image and Video Processing · Electrical Eng. & Systems 2019-02-22 Haojie Liu , Tong Chen , Ming Lu , Qiu Shen , Zhan Ma

Snapshot compressive imaging (SCI) systems aim to capture high-dimensional ($\ge3$D) images in a single shot using 2D detectors. SCI devices include two main parts: a hardware encoder and a software decoder. The hardware encoder typically…

Image and Video Processing · Electrical Eng. & Systems 2020-12-16 Ziyi Meng , Shirin Jalali , Xin Yuan

Video block compressive sensing has been studied for use in resource constrained scenarios, such as wireless sensor networks, but the approach still suffers from low performance and long reconstruction time. Inspired by classical…

Image and Video Processing · Electrical Eng. & Systems 2021-04-02 Joseph Zammit , Ian J Wassell

This paper introduces the concept of adaptive temporal compressive sensing (CS) for video. We propose a CS algorithm to adapt the compression ratio based on the scene's temporal complexity, computed from the compressed data, without…

Applications · Statistics 2016-11-17 Xin Yuan , Jianbo Yang , Patrick Llull , Xuejun Liao , Guillermo Sapiro , David J. Brady , Lawrence Carin

In this paper, we consider the task of space-time video super-resolution (ST-VSR), namely, expanding a given source video to a higher frame rate and resolution simultaneously. However, most existing schemes either consider a fixed…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Yuantong Zhang , Daiqin Yang , Zhenzhong Chen , Wenpeng Ding

One of the solutions of depth imaging of moving scene is to project a static pattern on the object and use just a single image for reconstruction. However, if the motion of the object is too fast with respect to the exposure time of the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-03 Yuki Shiba , Satoshi Ono , Ryo Furukawa , Shinsaku Hiura , Hiroshi Kawasaki

Snapshot compressive imaging (SCI) recovers high-dimensional (3D) data cubes from a single 2D measurement, enabling diverse applications like video and hyperspectral imaging to go beyond standard techniques in terms of acquisition speed and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Mengyu Zhao , Xi Chen , Xin Yuan , Shirin Jalali

Recently, Space-Time Memory Network (STM) based methods have achieved state-of-the-art performance in semi-supervised video object segmentation (VOS). A crucial problem in this task is how to model the dependency both among different frames…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Jianbiao Mei , Mengmeng Wang , Yeneng Lin , Yi Yuan , Yong Liu

Snapshot compressive imaging (SCI) can record the 3D information by a 2D measurement and from this 2D measurement to reconstruct the original 3D information by reconstruction algorithm. As we can see, the reconstruction algorithm plays a…

Image and Video Processing · Electrical Eng. & Systems 2022-08-23 Chengshuai Yang , Shiyu Zhang , Xin Yuan

Convolutional neural networks have enabled accurate image super-resolution in real-time. However, recent attempts to benefit from temporal correlations in video super-resolution have been limited to naive or inefficient architectures. In…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Jose Caballero , Christian Ledig , Andrew Aitken , Alejandro Acosta , Johannes Totz , Zehan Wang , Wenzhe Shi