English
Related papers

Related papers: Deep Digging into the Generalization of Self-Super…

200 papers

Recent deep monocular depth estimation approaches based on supervised regression have achieved remarkable performance. However, they require costly ground truth annotations during training. To cope with this issue, in this paper we present…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Andrea Pilzer , Stéphane Lathuilière , Dan Xu , Mihai Marian Puscas , Elisa Ricci , Nicu Sebe

This paper proposes the first pure Transformer structure inversion network called SwinStyleformer, which can compensate for the shortcomings of the CNNs inversion framework by handling long-range dependencies and learning the global…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Jiawei Mao , Guangyi Zhao , Xuesong Yin , Yuanqi Chang

Learned image compression methods have exhibited superior rate-distortion performance than classical image compression standards. Most existing learned image compression models are based on Convolutional Neural Networks (CNNs). Despite…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Renjie Zou , Chunfeng Song , Zhaoxiang Zhang

Convolution Neural Networks (CNNs) are widely used in medical image analysis, but their performance degrade when the magnification of testing images differ from the training images. The inability of CNNs to generalize across magnification…

Image and Video Processing · Electrical Eng. & Systems 2023-02-23 Pranav Jeevan , Nikhil Cherian Kurian , Amit Sethi

In this work we propose a novel model-based deep convolutional autoencoder that addresses the highly challenging problem of reconstructing a 3D human face from a single in-the-wild color image. To this end, we combine a convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-12-11 Ayush Tewari , Michael Zollhöfer , Hyeongwoo Kim , Pablo Garrido , Florian Bernard , Patrick Pérez , Christian Theobalt

Estimating depth from RGB images can facilitate many computer vision tasks, such as indoor localization, height estimation, and simultaneous localization and mapping (SLAM). Recently, monocular depth estimation has obtained great progress…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Qing Li , Jiasong Zhu , Jun Liu , Rui Cao , Qingquan Li , Sen Jia , Guoping Qiu

Self-supervised methods have showed promising results on depth estimation task. However, previous methods estimate the target depth map and camera ego-motion simultaneously, underusing multi-frame correlation information and ignoring the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Songchun Zhang , Chunhui Zhao

Photometric consistency loss is one of the representative objective functions commonly used for self-supervised monocular depth estimation. However, this loss often causes unstable depth predictions in textureless or occluded regions due to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Byeongjun Park , Taekyung Kim , Hyojun Go , Changick Kim

Self-supervised monocular depth estimation is a salient task for 3D scene understanding. Learned jointly with monocular ego-motion estimation, several methods have been proposed to predict accurate pixel-wise depth without using labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Hemang Chawla , Kishaan Jeeveswaran , Elahe Arani , Bahram Zonooz

This paper considers the problem of single image depth estimation. The employment of convolutional neural networks (CNNs) has recently brought about significant advancements in the research of this problem. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2018-09-25 Junjie Hu , Mete Ozay , Yan Zhang , Takayuki Okatani

The self-supervised learning of depth and pose from monocular sequences provides an attractive solution by using the photometric consistency of nearby frames as it depends much less on the ground-truth data. In this paper, we address the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Tianwei Shen , Lei Zhou , Zixin Luo , Yao Yao , Shiwei Li , Jiahui Zhang , Tian Fang , Long Quan

Full surround monodepth (FSM) methods can learn from multiple camera views simultaneously in a self-supervised manner to predict the scale-aware depth, which is more practical for real-world applications in contrast to scale-ambiguous depth…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yuchen Yang , Xinyi Wang , Dong Li , Lu Tian , Ashish Sirasao , Xun Yang

Learning single image depth estimation model from monocular video sequence is a very challenging problem. In this paper, we propose a novel training loss which enables us to include more images for supervision during the training process.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Zhenwei Luo

Deep learning techniques have been successfully used in learning a common representation for multi-view data, wherein the different modalities are projected onto a common subspace. In a broader perspective, the techniques used to…

Computer Vision and Pattern Recognition · Computer Science 2017-11-02 Gaurav Bhatt , Piyush Jha , Balasubramanian Raman

In the field of self-supervised depth estimation, Convolutional Neural Networks (CNNs) and Transformers have traditionally been dominant. However, both architectures struggle with efficiently handling long-range dependencies due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Ionuţ Grigore , Călin-Adrian Popa

Estimating depth from a monocular image is an ill-posed problem: when the camera projects a 3D scene onto a 2D plane, depth information is inherently and permanently lost. Nevertheless, recent work has shown impressive results in estimating…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Jagpreet Chawla , Nikhil Thakurdesai , Anuj Godase , Md Reza , David Crandall , Soon-Heung Jung

One weakness of machine-learning algorithms is the need to train the models for a new task. This presents a specific challenge for biometric recognition due to the dynamic nature of databases and, in some instances, the reliance on subject…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Kevin Hernandez-Diaz , Fernando Alonso-Fernandez , Josef Bigun

This paper addresses the problem of end-to-end self-supervised forecasting of depth and ego motion. Given a sequence of raw images, the aim is to forecast both the geometry and ego-motion using a self supervised photometric loss. The…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Houssem Boulahbal , Adrian Voicila , Andrew Comport

There has been tremendous research progress in estimating the depth of a scene from a monocular camera image. Existing methods for single-image depth prediction are exclusively based on deep neural networks, and their training can be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Ali Jahani Amiri , Shing Yan Loo , Hong Zhang

Imaging through scattering is an important, yet challenging problem. Tremendous progress has been made by exploiting the deterministic input-output "transmission matrix" for a fixed medium. However, this "one-to-one" mapping is highly…

Image and Video Processing · Electrical Eng. & Systems 2018-09-27 Yunzhe Li , Yujia Xue , Lei Tian