English
Related papers

Related papers: Self-Supervised Real-time Video Stabilization

200 papers

In this paper, we retarget video stitching to an emerging issue, named warping shake, when extending image stitching to video stitching. It unveils the temporal instability of warped content in non-overlapping regions, despite image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Lang Nie , Chunyu Lin , Kang Liao , Yun Zhang , Shuaicheng Liu , Rui Ai , Yao Zhao

Vision-based perception systems are typically exposed to large orientation changes in different robot applications. In such conditions, their performance might be compromised due to the inherent complexity of processing data captured under…

Nowadays, it is possible to scan faces and automatically register them with high quality. However, the resulting face meshes often need further processing: we need to stabilize them to remove unwanted head movement. Stabilization is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Jan Bednarik , Erroll Wood , Vasileios Choutas , Timo Bolkart , Daoye Wang , Chenglei Wu , Thabo Beeler

Image and video quality in Long Range Observation Systems (LOROS) suffer from atmospheric turbulence that causes small neighbourhoods in image frames to chaotically move in different directions and substantially hampers visual analysis of…

Optics · Physics 2010-07-27 Barak Fishbain , Leonid P. Yaroslavsky , Ianir A. Ideses

We present Steadiface, a new real-time face-centric video stabilization method that simultaneously removes hand shake and keeps subject's head stable. We use a CNN to estimate the face landmarks and use them to optimize a stabilized head…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Fuhao Shi , Sung-Fang Tsai , Youyou Wang , Chia-Kai Liang

We propose a self-supervised visual learning method by predicting the variable playback speeds of a video. Without semantic labels, we learn the spatio-temporal visual representation of the video by leveraging the variations in the visual…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Hyeon Cho , Taehoon Kim , Hyung Jin Chang , Wonjun Hwang

We propose a method for generating a temporally remapped video that matches the desired target duration while maximally preserving natural video dynamics. Our approach trains a neural network through self-supervision to recognize and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Simon Jenni , Markus Woodson , Fabian Caba Heilbron

When applied sequentially to video, frame-based networks often exhibit temporal inconsistency - for example, outputs that flicker between frames. This problem is amplified when the network inputs contain time-varying corruptions. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Matthew Dutson , Nathan Labiosa , Yin Li , Mohit Gupta

Thanks to the advances in the technology of low-cost digital cameras and the popularity of the self-recording culture, the amount of visual data on the Internet is going to the opposite side of the available time and patience of the users.…

Slow motion videos are becoming increasingly popular, but capturing high-resolution videos at extremely high frame rates requires professional high-speed cameras. To mitigate this problem, current techniques increase the frame rate of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Avinash Paliwal , Nima Khademi Kalantari

We retarget video stitching to an emerging issue, named warping shake, which unveils the temporal content shakes induced by sequentially unsmooth warps when extending image stitching to video stitching. Even if the input videos are stable,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Lang Nie , Chunyu Lin , Kang Liao , Yun Zhang , Shuaicheng Liu , Yao Zhao

Modern video summarization methods are based on deep neural networks that require a large amount of annotated data for training. However, existing datasets for video summarization are small-scale, easily leading to over-fitting of the deep…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Li Haopeng , Ke Qiuhong , Gong Mingming , Tom Drummond

Unpaired video-to-video translation aims to translate videos between a source and a target domain without the need of paired training data, making it more feasible for real applications. Unfortunately, the translated videos generally suffer…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Kaihong Wang , Kumar Akash , Teruhisa Misu

Video stabilization plays a central role to improve videos quality. However, despite the substantial progress made by these methods, they were, mainly, tested under standard weather and lighting conditions, and may perform poorly under…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Abdulrahman Kerim , Washington L. S. Ramos , Leandro Soriano Marcolino , Erickson R. Nascimento , Richard Jiang

Video stabilization is an in-camera processing commonly applied by modern acquisition devices. While significantly improving the visual quality of the resulting videos, it has been shown that such operation typically hinders the forensic…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Andrea Montibeller , Cecilia Pasquini , Giulia Boato , Stefano Dell'Anna , Fernando Pérez-González

In this paper, we present RStab, a novel framework for video stabilization that integrates 3D multi-frame fusion through volume rendering. Departing from conventional methods, we introduce a 3D multi-frame perspective to generate stabilized…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Zhan Peng , Xinyi Ye , Weiyue Zhao , Tianqi Liu , Huiqiang Sun , Baopu Li , Zhiguo Cao

Recent one-shot video tuning methods, which fine-tune the network on a specific video based on pre-trained text-to-image models (e.g., Stable Diffusion), are popular in the community because of the flexibility. However, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Liang Peng , Haoran Cheng , Zheng Yang , Ruisi Zhao , Linxuan Xia , Chaotian Song , Qinglin Lu , Boxi Wu , Wei Liu

We present a method for stabilizing handheld video that simulates the camera motions cinematographers achieve with equipment like tripods, dollies, and Steadicams. We formulate a constrained convex optimization problem minimizing the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Arwen Bradley , Jason Klivington , Joseph Triscari , Rudolph van der Merwe

Eliminating time-consuming post-production processes and delivering high-quality videos in today's fast-paced digital landscape are the key advantages of real-time approaches. To address these needs, we present Real Time GAZED: a real-time…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Sudheer Achary , Rohit Girmaji , Adhiraj Anil Deshmukh , Vineet Gandhi

Shooting video with handheld shooting devices often results in blurry frames due to shaking hands and other instability factors. Although previous video deblurring methods have achieved impressive progress, they still struggle to perform…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Honglei Xu , Zhilu Zhang , Junjie Fan , Xiaohe Wu , Wangmeng Zuo