English
Related papers

Related papers: Enhanced Event-Based Video Reconstruction with Mot…

200 papers

Video summarization aims to generate a concise representation of a video, capturing its essential content and key moments while reducing its overall length. Although several methods employ attention mechanisms to handle long-term…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Jaewon Son , Jaehun Park , Kwangsu Kim

The use of machine learning in fluid dynamics is becoming more common to expedite the computation when solving forward and inverse problems of partial differential equations. Yet, a notable challenge with existing convolutional neural…

Fluid Dynamics · Physics 2024-05-10 Siming Shan , Pengkai Wang , Song Chen , Jiaxu Liu , Chao Xu , Shengze Cai

Compressive sensing (CS) is a technique that enables the recovery of sparse signals using fewer measurements than traditional sampling methods. To address the computational challenges of CS reconstruction, our objective is to develop an…

Image and Video Processing · Electrical Eng. & Systems 2024-01-08 Youhao Yu , Richard M. Dansereau

Event cameras are novel sensors that report brightness changes in the form of asynchronous "events" instead of intensity frames. They have significant advantages over conventional cameras: high temporal resolution, high dynamic range, and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Henri Rebecq , René Ranftl , Vladlen Koltun , Davide Scaramuzza

Deep unfolded neural networks are designed by unrolling the iterations of optimization algorithms. They can be shown to achieve faster convergence and higher accuracy than their optimization counterparts. This paper proposes a new…

Machine Learning · Computer Science 2020-10-05 Huynh Van Luong , Boris Joukovsky , Yonina C. Eldar , Nikos Deligiannis

The problem of phase retrieval (PR) involves recovering an unknown image from limited amplitude measurement data and is a challenge nonlinear inverse problem in computational imaging and image processing. However, many of the PR methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Aoxu Liu , Xiaohong Fan , Yin Yang , Jianping Zhang

As a neuromorphic sensor with high temporal resolution, spike camera can generate continuous binary spike streams to capture per-pixel light intensity. We can use reconstruction methods to restore scene details in high-speed scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Liwen Hu , Ziluo Ding , Mianzhi Liu , Lei Ma , Tiejun Huang

We propose a novel DNN based framework called the Enhanced Correlation Matching based Video Frame Interpolation Network to support high resolution like 4K, which has a large scale of motion and occlusion. Considering the extensibility of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Sungho Lee , Narae Choi , Woong Il Choi

Action recognition greatly benefits motion understanding in video analysis. Recurrent networks such as long short-term memory (LSTM) networks are a popular choice for motion-aware sequence learning tasks. Recently, a convolutional extension…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Sebastian Agethen , Winston H. Hsu

Recovering sharp video sequence from a motion-blurred image is highly ill-posed due to the significant loss of motion information in the blurring process. For event-based cameras, however, fast motion can be captured as events at high time…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Zhe Jiang , Yu Zhang , Dongqing Zou , Jimmy Ren , Jiancheng Lv , Yebin Liu

Event cameras have recently gained significant traction since they open up new avenues for low-latency and low-power solutions to complex computer vision problems. To unlock these solutions, it is necessary to develop algorithms that can…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Federico Paredes-Vallés , Kirk Y. W. Scheper , Christophe De Wagter , Guido C. H. E. de Croon

We present a new turbulent data reconstruction method with supervised machine learning techniques inspired by super resolution and inbetweening, which can recover high-resolution turbulent flows from grossly coarse flow data in space and…

Fluid Dynamics · Physics 2021-01-25 Kai Fukami , Koji Fukagata , Kunihiko Taira

The deep convolutional neural networks have achieved significant improvements in accuracy and speed for single image super-resolution. However, as the depth of network grows, the information flow is weakened and the training becomes harder…

Computer Vision and Pattern Recognition · Computer Science 2018-02-27 Yanting Hu , Xinbo Gao , Jie Li , Yuanfei Huang , Hanzi Wang

Detecting and magnifying imperceptible high-frequency motions in real-world scenarios has substantial implications for industrial and medical applications. These motions are characterized by small amplitudes and high frequencies.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Yutian Chen , Shi Guo , Fangzheng Yu , Feng Zhang , Jinwei Gu , Tianfan Xue

Reconstructing ghosting-free high dynamic range (HDR) images of dynamic scenes from a set of multi-exposure images is a challenging task, especially with large object motion and occlusions, leading to visible artifacts using existing…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Qian Ye , Masanori Suganuma , Jun Xiao , Takayuki Okatani

Chemical Species Tomography (CST) has been widely used for in situ imaging of critical parameters, e.g. species concentration and temperature, in reactive flows. However, even with state-of-the-art computational algorithms the method is…

Image and Video Processing · Electrical Eng. & Systems 2021-04-06 Yunfan Jiang , Jingjing Si , Rui Zhang , Godwin Enemali , Bin Zhou , Hugh McCann , Chang Liu

We propose a deep network that can be trained to tackle image reconstruction and classification problems that involve detection of multiple object instances, without any supervision regarding their whereabouts. The network learns to extract…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Baptiste Angles , Yuhe Jin , Simon Kornblith , Andrea Tagliasacchi , Kwang Moo Yi

In this work, we propose a novel framework for unsupervised learning for event cameras that learns motion information from only the event stream. In particular, we propose an input representation of the events in the form of a discretized…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Alex Zihao Zhu , Liangzhe Yuan , Kenneth Chaney , Kostas Daniilidis

Spiking Neural Networks (SNNs) have emerged as a promising tool for event-based optical flow estimation tasks due to their ability to leverage spatio-temporal information and low-power capabilities. However, the performance of SNN models is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hongze Sun , Jun Wang , Wuque Cai , Duo Chen , Qianqian Liao , Jiayi He , Yan Cui , Dezhong Yao , Daqing Guo

Under extreme operating conditions, characterized by high particle multiplicity and heavily overlapping shower energy deposits, classical particle flow algorithms encounter pronounced limitations in resolution, efficiency, and accuracy. To…

Instrumentation and Detectors · Physics 2025-05-13 Yu Wang , Yangguang Zhang , Shengxiang Lin , Xingyi Zhang , Han Zhang