English
Related papers

Related papers: Self-supervised Learning of Depth Inference for Mu…

200 papers

Self-supervised learning (SSL) offers a powerful way to learn robust, generalizable representations without labeled data. In music, where labeled data is scarce, existing SSL methods typically use generated supervision and multi-view…

Sound · Computer Science 2024-11-06 Julia Wilkins , Sivan Ding , Magdalena Fuentes , Juan Pablo Bello

3D scene reconstruction from multiple views is an important classical problem in computer vision. Deep learning based approaches have recently demonstrated impressive reconstruction results. When training such models, self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Arijit Mallick , Jörg Stückler , Hendrik Lensch

Unsupervised depth learning takes the appearance difference between a target view and a view synthesized from its adjacent frame as supervisory signal. Since the supervisory signal only comes from images themselves, the resolution of…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Junsheng Zhou , Yuwang Wang , Kaihuai Qin , Wenjun Zeng

Estimating a depth map from a single RGB image has been investigated widely for localization, mapping, and 3-dimensional object detection. Recent studies on a single-view depth estimation are mostly based on deep Convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Dongseok Shim , H. Jin Kim

We present a multiview pseudo-labeling approach to video learning, a novel framework that uses complementary views in the form of appearance and motion information for semi-supervised learning in video. The complementary views help obtain…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Bo Xiong , Haoqi Fan , Kristen Grauman , Christoph Feichtenhofer

Self-supervised depth estimation has made a great success in learning depth from unlabeled image sequences. While the mappings between image and pixel-wise depth are well-studied in current methods, the correlation between image, depth and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Rui Li , Xiantuo He , Danna Xue , Shaolin Su , Qing Mao , Yu Zhu , Jinqiu Sun , Yanning Zhang

We propose a learning-based network for depth map estimation from multi-view stereo (MVS) images. Our proposed network consists of three sub-networks: 1) a base network for initial depth map estimation from an unstructured stereo image…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Sizhang Dai , Weibing Huang

Exiting deep-learning based dense stereo matching methods often rely on ground-truth disparity maps as the training signals, which are however not always available in many situations. In this paper, we design a simple convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Yiran Zhong , Yuchao Dai , Hongdong Li

In many fields, self-supervised learning solutions are rapidly evolving and filling the gap with supervised approaches. This fact occurs for depth estimation based on either monocular or stereo, with the latter often providing a valid…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Filippo Aleotti , Fabio Tosi , Li Zhang , Matteo Poggi , Stefano Mattoccia

We introduce NimbleD, an efficient self-supervised monocular depth estimation learning framework that incorporates supervision from pseudo-labels generated by a large vision model. This framework does not require camera intrinsics, enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Albert Luginov , Muhammad Shahzad

We introduce a novel framework for training deep stereo networks effortlessly and without any ground-truth. By leveraging state-of-the-art neural rendering solutions, we generate stereo training data from image sequences collected with a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Fabio Tosi , Alessio Tonioni , Daniele De Gregorio , Matteo Poggi

Pseudo-supervised learning methods have been shown to be effective for weakly supervised object localization tasks. However, the effectiveness depends on the powerful regularization ability of deep neural networks. Based on the assumption…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Kangbo Sun , Jie Zhu

Self-supervised monocular depth estimation networks are trained to predict scene depth using nearby frames as a supervision signal during training. However, for many applications, sequence information in the form of video frames is also…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Jamie Watson , Oisin Mac Aodha , Victor Prisacariu , Gabriel Brostow , Michael Firman

The promise of unsupervised multi-view-stereo (MVS) is to leverage large unlabeled datasets, yet current methods underperform when training on difficult data, such as handheld smartphone videos of indoor scenes. Meanwhile, high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Alex Rich , Noah Stier , Pradeep Sen , Tobias Höllerer

Deep learning demands a huge amount of well-labeled data to train the network parameters. How to use the least amount of labeled data to obtain the desired classification accuracy is of great practical significance, because for many…

Machine Learning · Computer Science 2019-12-20 Xiao Han , Zihao Wang , Enmei Tu , Gunnam Suryanarayana , Jie Yang

Multi-view clustering is an important research topic due to its capability to utilize complementary information from multiple views. However, there are few methods to consider the negative impact caused by certain views with unclear…

Machine Learning · Computer Science 2025-11-21 Jie Xu , Yazhou Ren , Huayi Tang , Zhimeng Yang , Lili Pan , Yang Yang , Xiaorong Pu , Philip S. Yu , Lifang He

Recent studies have witnessed that self-supervised methods based on view synthesis obtain clear progress on multi-view stereo (MVS). However, existing methods rely on the assumption that the corresponding points among different views share…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Hongbin Xu , Zhipeng Zhou , Yu Qiao , Wenxiong Kang , Qiuxia Wu

Training deep neural networks to estimate the viewpoint of objects requires large labeled training datasets. However, manually labeling viewpoints is notoriously hard, error-prone, and time-consuming. On the other hand, it is relatively…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Siva Karthik Mustikovela , Varun Jampani , Shalini De Mello , Sifei Liu , Umar Iqbal , Carsten Rother , Jan Kautz

In stereo-matching knowledge distillation methods of the self-supervised monocular depth estimation, the stereo-matching network's knowledge is distilled into a monocular depth network through pseudo-depth maps. In these methods, the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Woonghyun Ka , Jae Young Lee , Jaehyun Choi , Junmo Kim

In this paper, we study the problem of semi-supervised image recognition, which is to learn classifiers using both labeled and unlabeled images. We present Deep Co-Training, a deep learning based method inspired by the Co-Training…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Siyuan Qiao , Wei Shen , Zhishuai Zhang , Bo Wang , Alan Yuille