English
Related papers

Related papers: Open-World Stereo Video Matching with Deep RNN

200 papers

Despite the recent success of stereo matching with convolutional neural networks (CNNs), it remains arduous to generalize a pre-trained deep stereo model to a novel domain. A major difficulty is to collect accurate ground-truth disparities…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Jiahao Pang , Wenxiu Sun , Chengxi Yang , Jimmy Ren , Ruichao Xiao , Jin Zeng , Liang Lin

Stereo matching is one of the widely used techniques for inferring depth from stereo images owing to its robustness and speed. It has become one of the major topics of research since it finds its applications in autonomous driving, robotic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Viny Saajan Victor , Peter Neigel

Stereo reconstruction models trained on small images do not generalize well to high-resolution data. Training a model on high-resolution image size faces difficulties of data availability and is often infeasible due to limited computing…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Yaoyu Hu , Wenshan Wang , Huai Yu , Weikun Zhen , Sebastian Scherer

Despite the remarkable progress facilitated by learning-based stereo-matching algorithms, disparity estimation in low-texture, occluded, and bordered regions still remains a bottleneck that limits the performance. To tackle these…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Zihua Liu , Songyan Zhang , Zhicheng Wang , Masatoshi Okutomi

Self-supervised learning for depth estimation possesses several advantages over supervised learning. The benefits of no need for ground-truth depth, online fine-tuning, and better generalization with unlimited data attract researchers to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Weihao Yuan , Yazhan Zhang , Bingkun Wu , Siyu Zhu , Ping Tan , Michael Yu Wang , Qifeng Chen

Stereo matching, a critical step of 3D reconstruction, has fully shifted towards deep learning due to its strong feature representation of remote sensing images. However, ground truth for stereo matching task relies on expensive airborne…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Liting Jiang , Feng Wang , Wenyi Zhang , Peifeng Li , Hongjian You , Yuming Xiang

There are increasing interests of studying the video-to-depth (V2D) problem with machine learning techniques. While earlier methods directly learn a mapping from images to depth maps and camera poses, more recent works enforce multi-view…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Xiaodong Gu , Weihao Yuan , Zuozhuo Dai , Siyu Zhu , Chengzhou Tang , Zilong Dong , Ping Tan

Stereo video retargeting aims to resize an image to a desired aspect ratio. The quality of retargeted videos can be significantly impacted by the stereo videos spatial, temporal, and disparity coherence, all of which can be impacted by the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Hassan Imani , Md Baharul Islam , Lai-Kuan Wong

Change detection is one of the central problems in earth observation and was extensively investigated over recent decades. In this paper, we propose a novel recurrent convolutional neural network (ReCNN) architecture, which is trained to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Lichao Mou , Lorenzo Bruzzone , Xiao Xiang Zhu

Recurrent neural networks (RNNs) are a powerful model for sequential data. End-to-end training methods such as Connectionist Temporal Classification make it possible to train RNNs for sequence labelling problems where the input-output…

Neural and Evolutionary Computing · Computer Science 2013-03-26 Alex Graves , Abdel-rahman Mohamed , Geoffrey Hinton

Unsupervised cross-spectral stereo matching aims at recovering disparity given cross-spectral image pairs without any supervision in the form of ground truth disparity or depth. The estimated depth provides additional information…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Mingyang Liang , Xiaoyang Guo , Hongsheng Li , Xiaogang Wang , You Song

Deep-learning metrics have recently demonstrated extremely good performance to match image patches for stereo reconstruction. However, training such metrics requires large amount of labeled stereo images, which can be difficult or costly to…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Stepan Tulyakov , Anton Ivanov , Francois Fleuret

Being a crucial task of autonomous driving, Stereo matching has made great progress in recent years. Existing stereo matching methods estimate disparity instead of depth. They treat the disparity errors as the evaluation metric of the depth…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Hong Zhang , Haojie Li , Shenglun Chen , Tiantian Yan , Zhihui Wang , Guo Lu , Wanli Ouyang

Unsupervised stereo matching has garnered significant attention for its independence from costly disparity annotations. Typical unsupervised methods rely on the multi-view consistency assumption for training networks, which suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Chuang-Wei Liu , Mingjian Sun , Cairong Zhao , Hanli Wang , Alexander Dvorkovich , Rui Fan

A key attribute that drives the unprecedented success of modern Recurrent Neural Networks (RNNs) on learning tasks which involve sequential data, is their ability to model intricate long-term temporal dependencies. However, a well…

Machine Learning · Computer Science 2020-03-24 Alon Ziv

Long short-term memory (LSTM) recurrent neural networks (RNNs) have been shown to give state-of-the-art performance on many speech recognition tasks, as they are able to provide the learned dynamically changing contextual window of all…

Computation and Language · Computer Science 2016-10-12 Xiangang Li , Xihong Wu

Deep convolutional neural networks trained end-to-end are the state-of-the-art methods to regress dense disparity maps from stereo pairs. These models, however, suffer from a notable decrease in accuracy when exposed to scenarios…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Alessio Tonioni , Fabio Tosi , Matteo Poggi , Stefano Mattoccia , Luigi Di Stefano

Despite stereo matching accuracy has greatly improved by deep learning in the last few years, recovering sharp boundaries and high-resolution outputs efficiently remains challenging. In this paper, we propose Stereo Mixture Density Networks…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Fabio Tosi , Yiyi Liao , Carolin Schmitt , Andreas Geiger

Leveraging on the recent developments in convolutional neural networks (CNNs), matching dense correspondence from a stereo pair has been cast as a learning problem, with performance exceeding traditional approaches. However, it remains…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Jiahao Pang , Wenxiu Sun , Jimmy SJ. Ren , Chengxi Yang , Qiong Yan

Dynamic stereo matching is the task of estimating consistent disparities from stereo videos with dynamic objects. Recent learning-based methods prioritize optimal performance on a single stereo pair, resulting in temporal inconsistencies.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Junpeng Jing , Ye Mao , Krystian Mikolajczyk