English
Related papers

Related papers: Boosting Multi-view Stereo with Late Cost Aggregat…

200 papers

We present LightStereo, a cutting-edge stereo-matching network crafted to accelerate the matching process. Departing from conventional methodologies that rely on aggregating computationally intensive 4D costs, LightStereo adopts the 3D cost…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Xianda Guo , Chenming Zhang , Youmin Zhang , Wenzhao Zheng , Dujun Nie , Matteo Poggi , Long Chen

Stereo matching is essential for robot navigation. However, the accuracy of current widely used traditional methods is low, while methods based on CNN need expensive computational cost and running time. This is because different cost…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Xiaogang Jia , Wei Chen , Zhengfa Liang , Mingfei Wu , Yusong Tan , Libo Huang

Multi-object tracking has been recently approached with the min-cost network flow optimization techniques. Such methods simultaneously resolve multiple object tracks in a video and enable modeling of dependencies among tracks. Min-cost…

Computer Vision and Pattern Recognition · Computer Science 2015-05-07 Visesh Chari , Simon Lacoste-Julien , Ivan Laptev , Josef Sivic

In recent years, supervised or unsupervised learning-based MVS methods achieved excellent performance compared with traditional methods. However, these methods only use the probability volume computed by cost volume regularization to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Jingliang Li , Zhengda Lu , Yiqun Wang , Ying Wang , Jun Xiao

In this paper, we present a novel recurrent multi-view stereo network based on long short-term memory (LSTM) with adaptive aggregation, namely AA-RMVSNet. We firstly introduce an intra-view aggregation module to adaptively extract image…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Zizhuang Wei , Qingtian Zhu , Chen Min , Yisong Chen , Guoping Wang

We propose a cost volume-based neural network for depth inference from multi-view images. We demonstrate that building a cost volume pyramid in a coarse-to-fine manner instead of constructing a cost volume at a fixed resolution leads to a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jiayu Yang , Wei Mao , Jose M. Alvarez , Miaomiao Liu

Modern neural network-based algorithms are able to produce highly accurate depth estimates from stereo image pairs, nearly matching the reliability of measurements from more expensive depth sensors. However, this accuracy comes with a…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Kyle Yee , Ayan Chakrabarti

We introduce Point-MVSNet, a novel point-based deep framework for multi-view stereo (MVS). Distinct from existing cost volume approaches, our method directly processes the target scene as point clouds. More specifically, our method predicts…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Rui Chen , Songfang Han , Jing Xu , Hao Su

We propose a novel cost aggregation network, called Cost Aggregation Transformers (CATs), to find dense correspondences between semantically similar images with additional challenges posed by large intra-class appearance and geometric…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Seokju Cho , Sunghwan Hong , Sangryul Jeon , Yunsung Lee , Kwanghoon Sohn , Seungryong Kim

Recent work in multi-view stereo (MVS) combines learnable photometric scores and regularization with PatchMatch-based optimization to achieve robust pixelwise estimates of depth, normals, and visibility. However, non-learning based methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Jae Yong Lee , Chuhang Zou , Derek Hoiem

We propose an online multi-view depth prediction approach on posed video streams, where the scene geometry information computed in the previous time steps is propagated to the current time step in an efficient and geometrically plausible…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Arda Düzçeker , Silvano Galliani , Christoph Vogel , Pablo Speciale , Mihai Dusmanu , Marc Pollefeys

Learning-based multi-view stereo (MVS) has gained fine reconstructions on popular datasets. However, supervised learning methods require ground truth for training, which is hard to be collected, especially for the large-scale datasets.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Haonan Dong , Jian Yao

In this paper, we present a decomposition model for stereo matching to solve the problem of excessive growth in computational cost (time and memory cost) as the resolution increases. In order to reduce the huge cost of stereo matching at…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Chengtang Yao , Yunde Jia , Huijun Di , Pengxiang Li , Yuwei Wu

This paper presents a novel method, MaskMVS, to solve depth estimation for unstructured multi-view image-pose pairs. In the plane-sweep procedure, the depth planes are sampled by histogram matching that ensures covering the depth range of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Yuxin Hou , Arno Solin , Juho Kannala

Multi-view depth estimation plays a critical role in reconstructing and understanding the 3D world. Recent learning-based methods have made significant progress in it. However, multi-view depth estimation is fundamentally a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Kai Cheng , Hao Chen , Wei Yin , Guangkai Xu , Xuejin Chen

Volumetric deep learning approach towards stereo matching aggregates a cost volume computed from input left and right images using 3D convolutions. Recent works showed that utilization of extracted image features and a spatially varying…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Antyanta Bangunharcana , Jae Won Cho , Seokju Lee , In So Kweon , Kyung-Soo Kim , Soohyun Kim

PatchMatch based Multi-view Stereo (MVS) algorithms have achieved great success in large-scale scene reconstruction tasks. However, reconstruction of texture-less planes often fails as similarity measurement methods may become ineffective…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Shang Sun , Yunan Zheng , Xuelei Shi , Zhenyu Xu , Yiguang Liu

Although deep learning-based methods have dominated stereo matching leaderboards by yielding unprecedented disparity accuracy, their inference time is typically slow, on the order of seconds for a pair of 540p images. The main reason is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Yiran Zhong , Charles Loop , Wonmin Byeon , Stan Birchfield , Yuchao Dai , Kaihao Zhang , Alexey Kamenev , Thomas Breuel , Hongdong Li , Jan Kautz

Recent works have shown that depth information can be obtained from Dual-Pixel (DP) sensors. A DP arrangement provides two views in a single shot, thus resembling a stereo image pair with a tiny baseline. However, the different point spread…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Sagi Monin , Sagi Katz , Georgios Evangelidis

Late fusion multi-view clustering (LFMVC) has become a rapidly growing class of methods in the multi-view clustering (MVC) field, owing to its excellent computational speed and clustering performance. One bottleneck faced by existing late…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Qiyuan Ou , Pei Zhang , Sihang Zhou , En Zhu