English
Related papers

Related papers: Self-Supervised training for blind multi-frame vid…

200 papers

We propose a self-supervised visual learning method by predicting the variable playback speeds of a video. Without semantic labels, we learn the spatio-temporal visual representation of the video by leveraging the variations in the visual…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Hyeon Cho , Taehoon Kim , Hyung Jin Chang , Wonjun Hwang

In this paper, we address the problem of unsupervised video summarization that automatically extracts key-shots from an input video. Specifically, we tackle two critical issues based on our empirical observations: (i) Ineffective feature…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Yunjae Jung , Donghyeon Cho , Dahun Kim , Sanghyun Woo , In So Kweon

The success of deep learning based models for computer vision applications requires large scale human annotated data which are often expensive to generate. Self-supervised learning, a subset of unsupervised learning, handles this problem by…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Siladittya Manna , Saumik Bhattacharya , Umapada Pal

In this study, we propose a simple and effective fine-tuning algorithm called "restore-from-restored", which can greatly enhance the performance of fully pre-trained image denoising networks. Many supervised denoising approaches can produce…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Seunghwan Lee , Dongkyu Lee , Donghyeon Cho , Jiwon Kim , Tae Hyun Kim

We propose ViDeNN: a CNN for Video Denoising without prior knowledge on the noise distribution (blind denoising). The CNN architecture uses a combination of spatial and temporal filtering, learning to spatially denoise the frames first and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Michele Claus , Jan van Gemert

Image denoising is of great importance for medical imaging system, since it can improve image quality for disease diagnosis and downstream image analyses. In a variety of applications, dynamic imaging techniques are utilized to capture the…

Image and Video Processing · Electrical Eng. & Systems 2021-06-24 Junshen Xu , Elfar Adalsteinsson

We present an unsupervised simultaneous learning framework for the task of monocular camera re-localization and depth estimation from unlabeled video sequences. Monocular camera re-localization refers to the task of estimating the absolute…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Shun Taguchi , Noriaki Hirose

In this paper, we propose a learning-based approach for denoising raw videos captured under low lighting conditions. We propose to do this by first explicitly aligning the neighboring frames to the current frame using a convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Avinash Paliwal , Libing Zeng , Nima Khademi Kalantari

We present a new self-supervised pre-training of Vision Transformers for dense prediction tasks. It is based on a contrastive loss across views that compares pixel-level representations to global image representations. This strategy…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Jaonary Rabarisoa , Valentin Belissen , Florian Chabot , Quoc-Cuong Pham

In this study, we propose a self-supervised video denoising method called "restore-from-restored." This method fine-tunes a pre-trained network by using a pseudo clean video during the test phase. The pseudo clean video is obtained by…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Seunghwan Lee , Donghyeon Cho , Jiwon Kim , Tae Hyun Kim

Unsupervised learning poses one of the most difficult challenges in computer vision today. The task has an immense practical value with many applications in artificial intelligence and emerging technologies, as large quantities of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Ioana Croitoru , Simion-Vlad Bogolin , Marius Leordeanu

The advent of deep learning has brought a revolutionary transformation to image denoising techniques. However, the persistent challenge of acquiring noise-clean pairs for supervised methods in real-world scenarios remains formidable,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Dan Zhang , Fangfang Zhou , Felix Albu , Yuanzhou Wei , Xiao Yang , Yuan Gu , Qiang Li

Observations from ground based telescopes are affected by the presence of the Earth atmosphere, which severely perturbs them. The use of adaptive optics techniques has allowed us to partly beat this limitation. However, image selection or…

Instrumentation and Methods for Astrophysics · Physics 2021-02-17 A. Asensio Ramos , N. Olspert

Motion blur in videos captured by autonomous vehicles and robots can degrade their perception capability. In this work, we present a novel approach to video deblurring by fitting a deep network to the test video. Our key observation is that…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Xuanchi Ren , Zian Qian , Qifeng Chen

Deep learning methods have been successfully used in various computer vision tasks. Inspired by that success, deep learning has been explored in magnetic resonance imaging (MRI) reconstruction. In particular, integrating deep learning and…

Image and Video Processing · Electrical Eng. & Systems 2023-10-06 Peizhou Huang , Chaoyi Zhang , Xiaoliang Zhang , Xiaojuan Li , Liang Dong , Leslie Ying

Despite the advances in the field of generative models in computer vision, video stabilization still lacks a pure regressive deep-learning-based formulation. Deep video stabilization is generally formulated with the help of explicit motion…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Muhammad Kashif Ali , Sangjoon Yu , Tae Hyun Kim

We propose a self-supervised learning framework that uses unlabeled monocular video sequences to generate large-scale supervision for training a Visual Odometry (VO) frontend, a network which computes pointwise data associations across…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Daniel DeTone , Tomasz Malisiewicz , Andrew Rabinovich

With the advent of recent advances in unsupervised learning, efficient training of a deep network for image denoising without pairs of noisy and clean images has become feasible. However, most current unsupervised denoising methods are…

Image and Video Processing · Electrical Eng. & Systems 2020-12-08 Kanggeun Lee , Won-Ki Jeong

Self-supervised learning has been increasingly investigated for low-dose computed tomography (LDCT) image denoising, as it alleviates the dependence on paired normal-dose CT (NDCT) data, which are often difficult to collect. However, many…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yichao Liu , Zongru Shao , Yueyang Teng , Junwen Guo

Because noise can interfere with downstream analysis, image denoising has come to occupy an important place in the image processing toolbox. The most accurate state-of-the-art denoisers typically train on a representative dataset. But…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Jason Lequyer , Wen-Hsin Hsu , Reuben Philip , Anna Christina Erpf , Laurence Pelletier