English
Related papers

Related papers: Can We Hear from Events? Generating Speech from Ev…

200 papers

Automated story generation is the problem of automatically selecting a sequence of events, actions, or words that can be told as a story. We seek to develop a system that can generate stories by learning everything it needs to know from…

Computation and Language · Computer Science 2023-01-19 Lara J. Martin , Prithviraj Ammanabrolu , Xinyu Wang , William Hancock , Shruti Singh , Brent Harrison , Mark O. Riedl

Recent advancements in event-based recognition have demonstrated significant promise, yet most existing approaches rely on extensive training, limiting their adaptability for efficient processing of event-driven visual content. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Zongyou Yu , Qiang Qu , Qian Zhang , Nan Zhang , Xiaoming Chen

Event cameras harness advantages such as low latency, high temporal resolution, and high dynamic range (HDR), compared to standard cameras. Due to the distinct imaging paradigm shift, a dominant line of research focuses on event-to-video…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Kanghao Chen , Hangyu Li , JiaZhou Zhou , Zeyu Wang , Lin Wang

Event cameras provide a number of benefits over traditional cameras, such as the ability to track incredibly fast motions, high dynamic range, and low power consumption. However, their application into computer vision problems, many of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Alex Zihao Zhu , Ziyun Wang , Kaung Khant , Kostas Daniilidis

Event-based cameras are bio-inspired novel sensors that asynchronously record changes in illumination in the form of events, thus resulting in significant advantages over conventional cameras in terms of low power utilization, high dynamic…

Machine Learning · Statistics 2020-02-18 Lakshmi Annamalai , Anirban Chakraborty , Chetan Singh Thakur

With the rapid development of deep learning, video deraining has experienced significant progress. However, existing video deraining pipelines cannot achieve satisfying performance for scenes with rain layers of complex spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Yueyi Zhang , Jin Wang , Wenming Weng , Xiaoyan Sun , Zhiwei Xiong

Event cameras are bio-inspired sensors that respond to per-pixel brightness changes in the form of asynchronous and sparse "events". Recently, pattern recognition algorithms, such as learning-based methods, have made significant progress…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Nico Messikommer , Daniel Gehrig , Antonio Loquercio , Davide Scaramuzza

We propose EventHub, a novel framework for training deep-event stereo networks without ground truth annotations from costly active sensors, relying instead on standard color images. From these images, we derive either proxy annotations and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Luca Bartolomei , Fabio Tosi , Matteo Poggi , Stefano Mattoccia , Guillermo Gallego

Gait recognition enables non-intrusive, privacy-preserving identification but suffers in uncontrolled environments due to illumination and motion sensitivity of conventional cameras. In this work, we explore gait recognition using event…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Senyan Xu , Shuai Chen , Chuanfu Shen , Kean Liu , Zhijing Sun , Chengzhi Cao , Xueyang Fu

We present ContinuityCam, a novel approach to generate a continuous video from a single static RGB image and an event camera stream. Conventional cameras struggle with high-speed motion capture due to bandwidth and dynamic range…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Ziyun Wang , Friedhelm Hamann , Kenneth Chaney , Wen Jiang , Guillermo Gallego , Kostas Daniilidis

The event camera is a novel bio-inspired vision sensor. When the brightness change exceeds the preset threshold, the sensor generates events asynchronously. The number of valid events directly affects the performance of event-based tasks,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Xijie Xiang , Lin Zhu , Jianing Li , Yonghong Tian , Tiejun Huang

Neuromorphic vision sensor is a new bio-inspired imaging paradigm that reports asynchronous, continuously per-pixel brightness changes called `events' with high temporal resolution and high dynamic range. So far, the event-based image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Lin Zhu , Xiao Wang , Yi Chang , Jianing Li , Tiejun Huang , Yonghong Tian

We present EvDNeRF, a pipeline for generating event data and training an event-based dynamic NeRF, for the purpose of faithfully reconstructing eventstreams on scenes with rigid and non-rigid deformations that may be too fast to capture…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Anish Bhattacharya , Ratnesh Madaan , Fernando Cladera , Sai Vemprala , Rogerio Bonatti , Kostas Daniilidis , Ashish Kapoor , Vijay Kumar , Nikolai Matni , Jayesh K. Gupta

Event cameras are a type of novel neuromorphic sen-sor that has been gaining increasing attention. Existing event-based backbones mainly rely on image-based designs to extract spatial information within the image transformed from events,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Yansong Peng , Yueyi Zhang , Zhiwei Xiong , Xiaoyan Sun , Feng Wu

Event, or neuromorphic cameras, offer a novel encoding of natural scenes by asynchronously reporting significant changes in brightness, known as events, with improved dynamic range, temporal resolution and lower data bandwidth when compared…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Joseph L. Greene , Adrish Kar , Ignacio Galindo , Elijah Quiles , Elliott Chen , Matthew Anderson

Spiking neural networks (SNNs) promise orders-of-magnitude efficiency gains by communicating with sparse, event-driven spikes rather than dense numerical activations. However, most training pipelines either rely on surrogate-gradient…

Neural and Evolutionary Computing · Computer Science 2025-12-17 Arman Ferdowsi , Atakan Aral

Event cameras are vision sensors that record asynchronous streams of per-pixel brightness changes, referred to as "events". They have appealing advantages over frame-based cameras for computer vision, including high temporal resolution,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Daniel Gehrig , Antonio Loquercio , Konstantinos G. Derpanis , Davide Scaramuzza

High-quality and challenging event stream datasets play an important role in the design of an efficient event-driven mechanism that mimics the brain. Although event cameras can provide high dynamic range and low-energy event stream data,…

Neural and Evolutionary Computing · Computer Science 2022-05-25 Guobin Shen , Dongcheng Zhao , Yi Zeng

Most earlier researches on talking face generation have focused on the synchronization of lip motion and speech content. However, head pose and facial emotions are equally important characteristics of natural faces. While audio-driven…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Changpeng Cai , Guinan Guo , Jiao Li , Junhao Su , Fei Shen , Chenghao He , Jing Xiao , Yuanxu Chen , Lei Dai , Feiyu Zhu

Event-based semantic segmentation has gained popularity due to its capability to deal with scenarios under high-speed motion and extreme lighting conditions, which cannot be addressed by conventional RGB cameras. Since it is hard to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Linglin Jing , Yiming Ding , Yunpeng Gao , Zhigang Wang , Xu Yan , Dong Wang , Gerald Schaefer , Hui Fang , Bin Zhao , Xuelong Li