English
Related papers

Related papers: Content-Aware Inter-Scale Cost Aggregation for Ste…

200 papers

Efficient yet accurate extraction of depth from stereo image pairs is required by systems with low power resources, such as robotics and embedded systems. State-of-the-art stereo matching methods based on convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Rafael Brandt , Nicola Strisciuglio , Nicolai Petkov

n this paper, we propose an effective and efficient pyramid multi-view stereo (MVS) net with self-adaptive view aggregation for accurate and complete dense point cloud reconstruction. Different from using mean square variance to generate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Hongwei Yi , Zizhuang Wei , Mingyu Ding , Runze Zhang , Yisong Chen , Guoping Wang , Yu-Wing Tai

A Multistage Full Matching disparity estimation scheme (MFM) is proposed in this work. We demonstrate that decouple all similarity scores directly from the low-resolution 4D volume step by step instead of estimating low-resolution 3D cost…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Hong Zhang , Shenglun Chen , Zhihui Wang , Haojie Li , Wanli Ouyang

The complementary characteristics of active and passive depth sensing techniques motivate the fusion of the Li-DAR sensor and stereo camera for improved depth perception. Instead of directly fusing estimated depths across LiDAR and stereo…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Tsun-Hsuan Wang , Hou-Ning Hu , Chieh Hubert Lin , Yi-Hsuan Tsai , Wei-Chen Chiu , Min Sun

We present a method for extracting depth information from a rectified image pair. Our approach focuses on the first stage of many stereo algorithms: the matching cost computation. We approach the problem by learning a similarity measure on…

Computer Vision and Pattern Recognition · Computer Science 2016-05-19 Jure Žbontar , Yann LeCun

Cost aggregation is a highly important process in image matching tasks, which aims to disambiguate the noisy matching scores. Existing methods generally tackle this by hand-crafted or CNN-based methods, which either lack robustness to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Seokju Cho , Sunghwan Hong , Seungryong Kim

We present a method for extracting depth information from a rectified image pair. We train a convolutional neural network to predict how well two image patches match and use it to compute the stereo matching cost. The cost is refined by…

Computer Vision and Pattern Recognition · Computer Science 2015-10-21 Jure Žbontar , Yann LeCun

We propose a learning-based multi-view stereo (MVS) method in scattering media, such as fog or smoke, with a novel cost volume, called the dehazing cost volume. Images captured in scattering media are degraded due to light scattering and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Yuki Fujimura , Motoharu Sonogashira , Masaaki Iiyama

Matching cost aggregation plays a fundamental role in learning-based multi-view stereo networks. However, directly aggregating adjacent costs can lead to suboptimal results due to local geometric inconsistency. Related methods either seek…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Jiang Wu , Rui Li , Haofei Xu , Wenxun Zhao , Yu Zhu , Jinqiu Sun , Yanning Zhang

Multi-view Stereo (MVS) aims to estimate depth and reconstruct 3D point clouds from a series of overlapping images. Recent learning-based MVS frameworks overlook the geometric information embedded in features and correlations, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yuxi Hu , Jun Zhang , Zhe Zhang , Rafael Weilharter , Yuchen Rao , Kuangyi Chen , Runze Yuan , Friedrich Fraundorfer

Depth estimation based on stereo matching is a classic but popular computer vision problem, which has a wide range of real-world applications. Current stereo matching methods generally adopt the deep Siamese neural network architecture, and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Xingguang Jiang , Xiaofeng Bian , Chenggang Guo

Recently, end-to-end trainable deep neural networks have significantly improved stereo depth estimation for perspective images. However, 360{\deg} images captured under equirectangular projection cannot benefit from directly adopting…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Ning-Hsu Wang , Bolivar Solarte , Yi-Hsuan Tsai , Wei-Chen Chiu , Min Sun

Open-vocabulary semantic segmentation presents the challenge of labeling each pixel within an image based on a wide range of text descriptions. In this work, we introduce a novel cost-based approach to adapt vision-language foundation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Seokju Cho , Heeseong Shin , Sunghwan Hong , Anurag Arnab , Paul Hongsuck Seo , Seungryong Kim

In this paper, we propose a novel binary-based cost computation and aggregation approach for stereo matching problem. The cost volume is constructed through bitwise operations on a series of binary strings. Then this approach is combined…

Computer Vision and Pattern Recognition · Computer Science 2014-02-11 Kang Zhang , Jiyang Li , Yijing Li , Weidong Hu , Lifeng Sun , Shiqiang Yang

Accurate recovery of 3D geometrical surfaces from calibrated 2D multi-view images is a fundamental yet active research area in computer vision. Despite the steady progress in multi-view stereo reconstruction, most existing methods are still…

Computer Vision and Pattern Recognition · Computer Science 2016-01-20 Zhaoxin Li , Kuanquan Wang , Wangmeng Zuo , Deyu Meng , Lei Zhang

The core of Multi-view Stereo(MVS) is the matching process among reference and source pixels. Cost aggregation plays a significant role in this process, while previous methods focus on handling it via CNNs. This may inherit the natural…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Weitao Chen , Hongbin Xu , Zhipeng Zhou , Yang Liu , Baigui Sun , Wenxiong Kang , Xuansong Xie

Stereo matching is a fundamental building block for many vision and robotics applications. An informative and concise cost volume representation is vital for stereo matching of high accuracy and efficiency. In this paper, we present a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Gangwei Xu , Yun Wang , Junda Cheng , Jinhui Tang , Xin Yang

Dynamic stereo matching is the task of estimating consistent disparities from stereo videos with dynamic objects. Recent learning-based methods prioritize optimal performance on a single stereo pair, resulting in temporal inconsistencies.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Junpeng Jing , Ye Mao , Krystian Mikolajczyk

When a human matches two images, the viewer has a natural tendency to view the wide area around the target pixel to obtain clues of right correspondence. However, designing a matching cost function that works on a large window in the same…

Computer Vision and Pattern Recognition · Computer Science 2017-09-20 Haesol Park , Kyoung Mu Lee

Recent methods in stereo matching have continuously improved the accuracy using deep models. This gain, however, is attained with a high increase in computation cost, such that the network may not fit even on a moderate GPU. This issue…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Faranak Shamsafar , Samuel Woerz , Rafia Rahim , Andreas Zell