English
Related papers

Related papers: SwinSF: Image Reconstruction from Spatial-Temporal…

200 papers

The extraction of a clean background image by removing foreground occlusion holds immense practical significance, but it also presents several challenges. Presently, the majority of de-occlusion research focuses on addressing this issue…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Jiyuan Zhang , Shiyan Chen , Yajing Zheng , Zhaofei Yu , Tiejun Huang

The advent of neuralmorphic spike cameras has garnered significant attention for their ability to capture continuous motion with unparalleled temporal resolution.However, this imaging attribute necessitates considerable resources for binary…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Kexiang Feng , Chuanmin Jia , Siwei Ma , Wen Gao

Structured illumination microscopy (SIM) reconstructs a super-resolved image from multiple raw images captured with different illumination patterns; hence, acquisition speed is limited, making it unsuitable for dynamic scenes. We propose a…

Optics · Physics 2025-06-17 Ruiming Cao , Fanglin Linda Liu , Li-Hao Yeh , Laura Waller

Spike cameras, with their exceptional temporal resolution, are revolutionizing high-speed visual applications. Large-scale synthetic datasets have significantly accelerated the development of these cameras, particularly in reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Liwen Hu , Lei Ma , Yijia Guo , Tiejun Huang

As a bio-inspired vision sensor, the spike camera emulates the operational principles of the fovea, a compact retinal region, by employing spike discharges to encode the accumulation of per-pixel luminance intensity. Leveraging its high…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Lin Zhu , Xianzhang Chen , Xiao Wang , Hua Huang

One of the most critical factors in achieving sharp Novel View Synthesis (NVS) using neural field methods like Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) is the quality of the training images. However, Conventional RGB…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Gaole Dai , Zhenyu Wang , Qinwen Xu , Ming Lu , Wen Chen , Boxin Shi , Shanghang Zhang , Tiejun Huang

Spike cameras, as an innovative neuromorphic camera that captures scenes with the 0-1 bit stream at 40 kHz, are increasingly employed for the 3D reconstruction task via Neural Radiance Fields (NeRF) or 3D Gaussian Splatting (3DGS). Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Kang Chen , Jiyuan Zhang , Zecheng Hao , Yajing Zheng , Tiejun Huang , Zhaofei Yu

As a neuromorphic sensor with high temporal resolution, the spike camera shows enormous potential in high-speed visual tasks. However, the high-speed sampling of light propagation processes by existing cameras brings unavoidable noise…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Liwen hu , Lei Ma , Zhaofei Yu , Boxin Shi , Tiejun Huang

Spiking Neural Networks (SNNs) are bio-inspired networks that process information conveyed as temporal spikes rather than numeric values. A spiking neuron of an SNN only produces a spike whenever a significant number of spikes occur within…

Neural and Evolutionary Computing · Computer Science 2020-03-06 Mathias Gehrig , Sumit Bam Shrestha , Daniel Mouritzen , Davide Scaramuzza

Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep learning by emulating the event-driven processing manner of the brain. Incorporating Transformers with SNNs has shown promise for accuracy. However,…

Neural and Evolutionary Computing · Computer Science 2024-09-05 Yuetong Fang , Ziqing Wang , Lingfeng Zhang , Jiahang Cao , Honglei Chen , Renjing Xu

Event-based cameras have recently shown great potential for high-speed motion estimation owing to their ability to capture temporally rich information asynchronously. Spiking Neural Networks (SNNs), with their neuro-inspired event-driven…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Adarsh Kumar Kosta , Kaushik Roy

Recently, a novel bio-inspired spike camera has been proposed, which continuously accumulates luminance intensity and fires spikes while the dispatch threshold is reached. Compared to the conventional frame-based cameras and the emerging…

Multimedia · Computer Science 2019-12-23 Siwei Dong , Lin Zhu , Daoyuan Xu , Yonghong Tian , Tiejun Huang

Spiking Neural Networks (SNNs) have emerged as a compelling, energy-efficient alternative to traditional Artificial Neural Networks (ANNs) for static image tasks such as image classification and segmentation. However, in the more complex…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Shiting Xiao , Yuhang Li , Youngeun Kim , Donghyun Lee , Priyadarshini Panda

This study introduces a novel approach to enhance the spatial-temporal resolution of time-event pixels based on luminance changes captured by event cameras. These cameras present unique challenges due to their low resolution and the sparse,…

Image and Video Processing · Electrical Eng. & Systems 2024-08-14 Waseem Shariff , Joe Lemley , Peter Corcoran

Spiking Neural Networks (SNNs), characterized by discrete binary activations, offer high computational efficiency and low energy consumption, making them well-suited for computation-intensive tasks such as stereo image restoration. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ronghua Xu , Jin Xie , Jing Nie , Jiale Cao , Yanwei Pang

Spiking Neural Networks (SNNs) have emerged as a popular spatio-temporal computing paradigm for complex vision tasks. Recently proposed SNN training algorithms have significantly reduced the number of time steps (down to 1) for improved…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Gourav Datta , Zeyu Liu , Anni Li , Peter A. Beerel

Spiking Neural Networks (SNNs), as one of the algorithmic models in neuromorphic computing, have gained a great deal of research attention owing to temporal information processing capability, low power consumption, and high biological…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Chengting Yu , Zheming Gu , Da Li , Gaoang Wang , Aili Wang , Erping Li

Event cameras are considered to have great potential for computer vision and robotics applications because of their high temporal resolution and low power consumption characteristics. However, the event stream output from event cameras has…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Xiaoshan Wu , Weihua He , Man Yao , Ziyang Zhang , Yaoyuan Wang , Guoqi Li

Event-based cameras display great potential for a variety of tasks such as high-speed motion detection and navigation in low-light environments where conventional frame-based cameras suffer critically. This is attributed to their high…

Neural and Evolutionary Computing · Computer Science 2020-09-16 Chankyu Lee , Adarsh Kumar Kosta , Alex Zihao Zhu , Kenneth Chaney , Kostas Daniilidis , Kaushik Roy

Restoring clear frames from rainy videos presents a significant challenge due to the rapid motion of rain streaks. Traditional frame-based visual sensors, which capture scene content synchronously, struggle to capture the fast-moving…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Hanwen Liang , Xian Zhong , Wenxuan Liu , Yajing Zheng , Wenxin Huang , Zhaofei Yu , Tiejun Huang