中文
相关论文

相关论文: SwinSF: Image Reconstruction from Spatial-Temporal…

200 篇论文

The extraction of a clean background image by removing foreground occlusion holds immense practical significance, but it also presents several challenges. Presently, the majority of de-occlusion research focuses on addressing this issue…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Jiyuan Zhang , Shiyan Chen , Yajing Zheng , Zhaofei Yu , Tiejun Huang

The advent of neuralmorphic spike cameras has garnered significant attention for their ability to capture continuous motion with unparalleled temporal resolution.However, this imaging attribute necessitates considerable resources for binary…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Kexiang Feng , Chuanmin Jia , Siwei Ma , Wen Gao

Structured illumination microscopy (SIM) reconstructs a super-resolved image from multiple raw images captured with different illumination patterns; hence, acquisition speed is limited, making it unsuitable for dynamic scenes. We propose a…

光学 · 物理学 2025-06-17 Ruiming Cao , Fanglin Linda Liu , Li-Hao Yeh , Laura Waller

Spike cameras, with their exceptional temporal resolution, are revolutionizing high-speed visual applications. Large-scale synthetic datasets have significantly accelerated the development of these cameras, particularly in reconstruction…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Liwen Hu , Lei Ma , Yijia Guo , Tiejun Huang

As a bio-inspired vision sensor, the spike camera emulates the operational principles of the fovea, a compact retinal region, by employing spike discharges to encode the accumulation of per-pixel luminance intensity. Leveraging its high…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Lin Zhu , Xianzhang Chen , Xiao Wang , Hua Huang

One of the most critical factors in achieving sharp Novel View Synthesis (NVS) using neural field methods like Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) is the quality of the training images. However, Conventional RGB…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Gaole Dai , Zhenyu Wang , Qinwen Xu , Ming Lu , Wen Chen , Boxin Shi , Shanghang Zhang , Tiejun Huang

Spike cameras, as an innovative neuromorphic camera that captures scenes with the 0-1 bit stream at 40 kHz, are increasingly employed for the 3D reconstruction task via Neural Radiance Fields (NeRF) or 3D Gaussian Splatting (3DGS). Previous…

计算机视觉与模式识别 · 计算机科学 2025-06-26 Kang Chen , Jiyuan Zhang , Zecheng Hao , Yajing Zheng , Tiejun Huang , Zhaofei Yu

As a neuromorphic sensor with high temporal resolution, the spike camera shows enormous potential in high-speed visual tasks. However, the high-speed sampling of light propagation processes by existing cameras brings unavoidable noise…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Liwen hu , Lei Ma , Zhaofei Yu , Boxin Shi , Tiejun Huang

Spiking Neural Networks (SNNs) are bio-inspired networks that process information conveyed as temporal spikes rather than numeric values. A spiking neuron of an SNN only produces a spike whenever a significant number of spikes occur within…

神经与进化计算 · 计算机科学 2020-03-06 Mathias Gehrig , Sumit Bam Shrestha , Daniel Mouritzen , Davide Scaramuzza

Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep learning by emulating the event-driven processing manner of the brain. Incorporating Transformers with SNNs has shown promise for accuracy. However,…

神经与进化计算 · 计算机科学 2024-09-05 Yuetong Fang , Ziqing Wang , Lingfeng Zhang , Jiahang Cao , Honglei Chen , Renjing Xu

Event-based cameras have recently shown great potential for high-speed motion estimation owing to their ability to capture temporally rich information asynchronously. Spiking Neural Networks (SNNs), with their neuro-inspired event-driven…

计算机视觉与模式识别 · 计算机科学 2023-03-15 Adarsh Kumar Kosta , Kaushik Roy

Recently, a novel bio-inspired spike camera has been proposed, which continuously accumulates luminance intensity and fires spikes while the dispatch threshold is reached. Compared to the conventional frame-based cameras and the emerging…

多媒体 · 计算机科学 2019-12-23 Siwei Dong , Lin Zhu , Daoyuan Xu , Yonghong Tian , Tiejun Huang

Spiking Neural Networks (SNNs) have emerged as a compelling, energy-efficient alternative to traditional Artificial Neural Networks (ANNs) for static image tasks such as image classification and segmentation. However, in the more complex…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Shiting Xiao , Yuhang Li , Youngeun Kim , Donghyun Lee , Priyadarshini Panda

This study introduces a novel approach to enhance the spatial-temporal resolution of time-event pixels based on luminance changes captured by event cameras. These cameras present unique challenges due to their low resolution and the sparse,…

图像与视频处理 · 电气工程与系统科学 2024-08-14 Waseem Shariff , Joe Lemley , Peter Corcoran

Spiking Neural Networks (SNNs), characterized by discrete binary activations, offer high computational efficiency and low energy consumption, making them well-suited for computation-intensive tasks such as stereo image restoration. In this…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Ronghua Xu , Jin Xie , Jing Nie , Jiale Cao , Yanwei Pang

Spiking Neural Networks (SNNs) have emerged as a popular spatio-temporal computing paradigm for complex vision tasks. Recently proposed SNN training algorithms have significantly reduced the number of time steps (down to 1) for improved…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Gourav Datta , Zeyu Liu , Anni Li , Peter A. Beerel

Spiking Neural Networks (SNNs), as one of the algorithmic models in neuromorphic computing, have gained a great deal of research attention owing to temporal information processing capability, low power consumption, and high biological…

神经与进化计算 · 计算机科学 2023-06-07 Chengting Yu , Zheming Gu , Da Li , Gaoang Wang , Aili Wang , Erping Li

Event cameras are considered to have great potential for computer vision and robotics applications because of their high temporal resolution and low power consumption characteristics. However, the event stream output from event cameras has…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Xiaoshan Wu , Weihua He , Man Yao , Ziyang Zhang , Yaoyuan Wang , Guoqi Li

Event-based cameras display great potential for a variety of tasks such as high-speed motion detection and navigation in low-light environments where conventional frame-based cameras suffer critically. This is attributed to their high…

神经与进化计算 · 计算机科学 2020-09-16 Chankyu Lee , Adarsh Kumar Kosta , Alex Zihao Zhu , Kenneth Chaney , Kostas Daniilidis , Kaushik Roy

Restoring clear frames from rainy videos presents a significant challenge due to the rapid motion of rain streaks. Traditional frame-based visual sensors, which capture scene content synchronously, struggle to capture the fast-moving…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Hanwen Liang , Xian Zhong , Wenxuan Liu , Yajing Zheng , Wenxin Huang , Zhaofei Yu , Tiejun Huang