English
Related papers

Related papers: Self-Supervised training for blind multi-frame vid…

200 papers

Although both self-supervised single-frame and multi-frame depth estimation methods only require unlabeled monocular videos for training, the information they leverage varies because single-frame methods mainly rely on appearance-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Jie Xiang , Yun Wang , Lifeng An , Haiyang Liu , Jian Liu

Deep learning methods have shown remarkable performance in image denoising, particularly when trained on large-scale paired datasets. However, acquiring such paired datasets for real-world scenarios poses a significant challenge. Although…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Xin Lin , Chao Ren , Xiao Liu , Jie Huang , Yinjie Lei

This paper proposes a self-supervised low light image enhancement method based on deep learning, which can improve the image contrast and reduce noise at the same time to avoid the blur caused by pre-/post-denoising. The method contains two…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Yu Zhang , Xiaoguang Di , Bin Zhang , Qingyan Li , Shiyu Yan , Chunhui Wang

Deep neural network based methods are the state of the art in various image restoration problems. Standard supervised learning frameworks require a set of noisy measurement and clean image pairs for which a distance between the output of…

Image and Video Processing · Electrical Eng. & Systems 2021-03-31 Rihuan Ke , Carola-Bibiane Schönlieb

Unsupervised multi-object segmentation has shown impressive results on images by utilizing powerful semantics learned from self-supervised pretraining. An additional modality such as depth or motion is often used to facilitate the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Görkay Aydemir , Weidi Xie , Fatma Güney

This paper proposes a self-supervised monocular image-to-depth prediction framework that is trained with an end-to-end photometric loss that handles not only 6-DOF camera motion but also 6-DOF moving object instances. Self-supervision is…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Houssem Boulahbal , Adrian Voicila , Andrew Comport

SAR despeckling is a problem of paramount importance in remote sensing, since it represents the first step of many scene analysis algorithms. Recently, deep learning techniques have outperformed classical model-based despeckling algorithms.…

Image and Video Processing · Electrical Eng. & Systems 2020-01-16 Andrea Bordone Molini , Diego Valsesia , Giulia Fracastoro , Enrico Magli

We propose a method to train deep networks to decompose videos into 3D geometry (camera and depth), moving objects, and their motions, with no supervision. We build on the idea of view synthesis, which uses classical camera geometry to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Dan Xu , Andrea Vedaldi , Joao F. Henriques

Natural videos captured by consumer cameras often suffer from low framerate and motion blur due to the combination of dynamic scene complexity, lens and sensor imperfection, and less than ideal exposure setting. As a result, computational…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Wei Shang , Dongwei Ren , Yi Yang , Hongzhi Zhang , Kede Ma , Wangmeng Zuo

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

Single-View depth estimation using the CNNs trained from unlabelled videos has shown significant promise. However, excellent results have mostly been obtained in street-scene driving scenarios, and such methods often fail in other settings,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Jia-Wang Bian , Huangying Zhan , Naiyan Wang , Tat-Jun Chin , Chunhua Shen , Ian Reid

In this work we address the challenging problem of unsupervised learning from videos. Existing methods utilize the spatio-temporal continuity in contiguous video frames as regularization for the learning process. Typically, this temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-10-12 Carolina Redondo-Cabrera , Roberto J. López-Sastre

In continual learning, a system must incrementally learn from a non-stationary data stream without catastrophic forgetting. Recently, multiple methods have been devised for incrementally learning classes on large-scale image classification…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jhair Gallardo , Tyler L. Hayes , Christopher Kanan

We present a novel unsupervised learning framework for single view depth estimation using monocular videos. It is well known in 3D vision that enlarging the baseline can increase the depth estimation accuracy, and jointly optimizing a set…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Lipu Zhou , Jiamin Ye , Montiel Abello , Shengze Wang , Michael Kaess

Self-supervised learning has made unsupervised pretraining relevant again for difficult computer vision tasks. The most effective self-supervised methods involve prediction tasks based on features extracted from diverse views of the data.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 R Devon Hjelm , Philip Bachman

Blind image denoising is an important yet very challenging problem in computer vision due to the complicated acquisition process of real images. In this work we propose a new variational inference method, which integrates both noise…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Zongsheng Yue , Hongwei Yong , Qian Zhao , Lei Zhang , Deyu Meng

Previous methods on estimating detailed human depth often require supervised training with `ground truth' depth data. This paper presents a self-supervised method that can be trained on YouTube videos without known depth, which makes…

Computer Vision and Pattern Recognition · Computer Science 2020-05-08 Feitong Tan , Hao Zhu , Zhaopeng Cui , Siyu Zhu , Marc Pollefeys , Ping Tan

Recent multimodal deepfake detection methods designed for generalization conjecture that single-stage supervised training struggles to generalize across unseen manipulations and datasets. However, such approaches that target generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Ashutosh Anshul , Shreyas Gopal , Deepu Rajan , Eng Siong Chng

Recent co-part segmentation methods mostly operate in a supervised learning setting, which requires a large amount of annotated data for training. To overcome this limitation, we propose a self-supervised deep learning method for co-part…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Aliaksandr Siarohin , Subhankar Roy , Stéphane Lathuilière , Sergey Tulyakov , Elisa Ricci , Nicu Sebe

Self-supervised learning allows for better utilization of unlabelled data. The feature representation obtained by self-supervision can be used in downstream tasks such as classification, object detection, segmentation, and anomaly…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Rabia Ali , Muhammad Umar Karim Khan , Chong Min Kyung