English
Related papers

Related papers: 360VFI: A Dataset and Benchmark for Omnidirectiona…

200 papers

Omnidirectional depth perception is essential for mobile robotics applications that require scene understanding across a full 360{\deg} field of view. Camera-based setups offer a cost-effective option by using stereo depth estimation to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Jannik Endres , Oliver Hahn , Charles Corbière , Simone Schaub-Meyer , Stefan Roth , Alexandre Alahi

Video Frame Interpolation (VFI) is a fundamental yet challenging task in computer vision, particularly under conditions involving large motion, occlusion, and lighting variation. Recent advancements in event cameras have opened up new…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Hanle Zheng , Xujie Han , Zegang Peng , Shangbin Zhang , Guangxun Du , Zhuo Zou , Xilin Wang , Jibin Wu , Hao Guo , Lei Deng

Research on video frame interpolation has made significant progress in recent years. However, existing methods mostly use off-the-shelf metrics to measure the quality of interpolation results with the exception of a few methods that employ…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Qiqi Hou , Abhijay Ghildyal , Feng Liu

In general, deep learning-based video frame interpolation (VFI) methods have predominantly focused on estimating motion vectors between two input frames and warping them to the target time. While this approach has shown impressive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Jaemin Lee , Minseok Seo , Sangwoo Lee , Hyobin Park , Dong-Geol Choi

Omnidirectional images (also referred to as static 360{\deg} panoramas) impose viewing conditions much different from those of regular 2D images. How do humans perceive image distortions in immersive virtual reality (VR) environments is an…

Image and Video Processing · Electrical Eng. & Systems 2021-01-06 Xiangjie Sui , Kede Ma , Yiru Yao , Yuming Fang

Advances in neural fields are enabling high-fidelity capture of the shape and appearance of dynamic 3D scenes. However, their capabilities lag behind those offered by conventional representations such as 2D videos because of algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Cheng-You Lu , Peisen Zhou , Angela Xing , Chandradeep Pokhariya , Arnab Dey , Ishaan Shah , Rugved Mavidipalli , Dylan Hu , Andrew Comport , Kefan Chen , Srinath Sridhar

Existing Video Frame interpolation (VFI) models tend to suffer from time-to-location ambiguity when trained with video of non-uniform motions, such as accelerating, decelerating, and changing directions, which often yield blurred…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Wonyong Seo , Jihyong Oh , Munchurl Kim

360$^\circ$ video saliency detection is one of the challenging benchmarks for 360$^\circ$ video understanding since non-negligible distortion and discontinuity occur in the projection of any format of 360$^\circ$ videos, and capture-worthy…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Heeseung Yun , Sehun Lee , Gunhee Kim

Video frame interpolation task has recently become more and more prevalent in the computer vision field. At present, a number of researches based on deep learning have achieved great success. Most of them are either based on optical flow…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Haoyue Tian , Pan Gao , Xiaojiang Peng

Omnidirectional or 360-degree video is being increasingly deployed, largely due to the latest advancements in immersive virtual reality (VR) and extended reality (XR) technology. However, the adoption of these videos in streaming encounters…

Image and Video Processing · Electrical Eng. & Systems 2024-03-08 Ahmed Telili , Ibrahim Farhat , Wassim Hamidouche , Hadi Amirpour

Video frame interpolation is an increasingly important research task with several key industrial applications in the video coding, broadcast and production sectors. Recently, transformers have been introduced to the field resulting in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Issa Khalifeh , Luka Murn , Marta Mrak , Ebroul Izquierdo

Video frame interpolation, which aims to synthesize non-exist intermediate frames in a video sequence, is an important research topic in computer vision. Existing video frame interpolation methods have achieved remarkable results under…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Youjian Zhang , Chaoyue Wang , Dacheng Tao

360{\deg} omnidirectional images have gained research attention due to their immersive and interactive experience, particularly in AR/VR applications. However, they suffer from lower angular resolution due to being captured by fisheye…

Image and Video Processing · Electrical Eng. & Systems 2023-04-27 Xiaopeng Sun , Weiqi Li , Zhenyu Zhang , Qiufang Ma , Xuhan Sheng , Ming Cheng , Haoyu Ma , Shijie Zhao , Jian Zhang , Junlin Li , Li Zhang

With the emergence of VR and AR, 360{\deg} data attracts increasing attention from the computer vision and multimedia communities. Typically, 360{\deg} data is projected into 2D ERP (equirectangular projection) images for feature…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yinjie Zhao , Lichen Zhao , Qian Yu , Jing Zhang , Lu Sheng , Dong Xu

Every generation of mobile devices strives to capture video at higher resolution and frame rate than previous ones. This quality increase also requires additional power and computation to capture and encode high-quality media. We propose a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Hidekazu Takahashi , Takefumi Nagumo , Kensei Jo , Aumiller Andreas , Saeed Rad , Rodrigo Caye Daudt , Yoshitaka Miyatani , Hayato Wakabayashi , Christian Brandli

Video frame interpolation~(VFI) algorithms have improved considerably in recent years due to unprecedented progress in both data-driven algorithms and their implementations. Recent research has introduced advanced motion estimation or novel…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zhixiang Chi , Rasoul Mohammadi Nasiri , Zheng Liu , Yuanhao Yu , Juwei Lu , Jin Tang , Konstantinos N Plataniotis

Reconstructing the 3D shape of a deformable environment from the information captured by a moving depth camera is highly relevant to surgery. The underlying challenge is the fact that simultaneously estimating camera motion and tissue…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Guido Caccianiga , Julian Nubert , Cesar Cadena , Marco Hutter , Katherine J. Kuchenbecker

Video interpolation aims to generate a non-existent intermediate frame given the past and future frames. Many state-of-the-art methods achieve promising results by estimating the optical flow between the known frames and then generating the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Zhiqi Chen , Ran Wang , Haojie Liu , Yao Wang

Nowadays 360 video analysis has become a significant research topic in the field since the appearance of high-quality and low-cost 360 wearable devices. In this paper, we propose a novel LiteFlowNet360 architecture for 360 videos optical…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Keshav Bhandari , Ziliang Zong , Yan Yan

Video frame interpolation, the process of synthesizing intermediate frames between sequential video frames, has made remarkable progress with the use of event cameras. These sensors, with microsecond-level temporal resolution, fill…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yuhan Liu , Yongjian Deng , Hao Chen , Bochen Xie , Youfu Li , Zhen Yang