English
Related papers

Related papers: Self-supervised 360$^{\circ}$ Room Layout Estimati…

200 papers

Recently, end-to-end trainable deep neural networks have significantly improved stereo depth estimation for perspective images. However, 360{\deg} images captured under equirectangular projection cannot benefit from directly adopting…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Ning-Hsu Wang , Bolivar Solarte , Yi-Hsuan Tsai , Wei-Chen Chiu , Min Sun

Spherical cameras capture scenes in a holistic manner and have been used for room layout estimation. Recently, with the availability of appropriate datasets, there has also been progress in depth estimation from a single omnidirectional…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Nikolaos Zioulis , Federico Alvarez , Dimitrios Zarpalas , Petros Daras

While supervised object detection methods achieve impressive accuracy, they generalize poorly to images whose appearance significantly differs from the data they have been trained on. To address this in scenarios where annotating data is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Isinsu Katircioglu , Helge Rhodin , Victor Constantin , Jörg Spörri , Mathieu Salzmann , Pascal Fua

Supervised approaches to 3D pose estimation from single images are remarkably effective when labeled data is abundant. However, as the acquisition of ground-truth 3D labels is labor intensive and time consuming, recent attention has shifted…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Soumava Kumar Roy , Leonardo Citraro , Sina Honari , Pascal Fua

In this work, we study different approaches to self-supervised pretraining of object detection models. We first design a general framework to learn a spatially consistent dense representation from an image, by randomly sampling and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Trung Dang , Simon Kornblith , Huy Thong Nguyen , Peter Chin , Maryam Khademi

Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Clément Godard , Oisin Mac Aodha , Michael Firman , Gabriel Brostow

Understanding the 3D world without supervision is currently a major challenge in computer vision as the annotations required to supervise deep networks for tasks in this domain are expensive to obtain on a large scale. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

Self-supervised learning for depth estimation possesses several advantages over supervised learning. The benefits of no need for ground-truth depth, online fine-tuning, and better generalization with unlimited data attract researchers to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Weihao Yuan , Yazhan Zhang , Bingkun Wu , Siyu Zhu , Ping Tan , Michael Yu Wang , Qifeng Chen

As 360{\deg} cameras become prevalent in many autonomous systems (e.g., self-driving cars and drones), efficient 360{\deg} perception becomes more and more important. We propose a novel self-supervised learning approach for predicting the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-14 Fu-En Wang , Hou-Ning Hu , Hsien-Tzu Cheng , Juan-Ting Lin , Shang-Ta Yang , Meng-Li Shih , Hung-Kuo Chu , Min Sun

The dense depth estimation of a 3D scene has numerous applications, mainly in robotics and surveillance. LiDAR and radar sensors are the hardware solution for real-time depth estimation, but these sensors produce sparse depth maps and are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Alwyn Mathew , Aditya Prakash Patra , Jimson Mathew

Most self-supervised 6D object pose estimation methods can only work with additional depth information or rely on the accurate annotation of 2D segmentation masks, limiting their application range. In this paper, we propose a 6D object pose…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yang Hai , Rui Song , Jiaojiao Li , David Ferstl , Yinlin Hu

We present a convolutional neural network for joint 3D shape prediction and viewpoint estimation from a single input image. During training, our network gets the learning signal from a silhouette of an object in the input image - a form of…

Robotics · Computer Science 2019-10-18 Oier Mees , Maxim Tatarchenko , Thomas Brox , Wolfram Burgard

We study the problem of learning to assign a characteristic pose, i.e., scale and orientation, for an image region of interest. Despite its apparent simplicity, the problem is non-trivial; it is hard to obtain a large-scale set of image…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Jongmin Lee , Yoonwoo Jeong , Minsu Cho

Recent developments established deep learning as an inevitable tool to boost the performance of dense matching and stereo estimation. On the downside, learning these networks requires a substantial amount of training data to be successful.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Patrick Knöbelreiter , Christoph Vogel , Thomas Pock

Depth estimation, as a necessary clue to convert 2D images into the 3D space, has been applied in many machine vision areas. However, to achieve an entire surrounding 360-degree geometric sensing, traditional stereo matching algorithms for…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Keyang Zhou , Kailun Yang , Kaiwei Wang

While instruction-based image editing is emerging, extending it to 360$^\circ$ panoramas introduces additional challenges. Existing methods often produce implausible results in both equirectangular projections (ERP) and perspective views.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Haoyi Zhong , Fang-Lue Zhang , Andrew Chalmers , Taehyun Rhee

We propose a method for self-supervised image representation learning under the guidance of 3D geometric consistency. Our intuition is that 3D geometric consistency priors such as smooth regions and surface discontinuities may imply…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Nenglun Chen , Lei Chu , Hao Pan , Yan Lu , Wenping Wang

Training networks to perform metric relocalization traditionally requires accurate image correspondences. In practice, these are obtained by restricting domain coverage, employing additional sensors, or capturing large multi-view datasets.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Mike Kasper , Fernando Nobre , Christoffer Heckman , Nima Keivan

Representation learning approaches typically rely on images of objects captured from a single perspective that are transformed using affine transformations. Additionally, self-supervised learning, a successful paradigm of representation…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Omiros Pantazis , Mathew Salvaris

This paper focuses on self-supervised monocular depth estimation in dynamic scenes trained on monocular videos. Existing methods jointly estimate pixel-wise depth and motion, relying mainly on an image reconstruction loss. Dynamic regions1…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Hoang Chuong Nguyen , Tianyu Wang , Jose M. Alvarez , Miaomiao Liu