English
Related papers

Related papers: ImmersePro: End-to-End Stereo Video Synthesis Via …

200 papers

Dense stereo matching with deep neural networks is of great interest to the research community. Existing stereo matching networks typically use slow and computationally expensive 3D convolutions to improve the performance, which is not…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Zhengyu Huang , Theodore B. Norris , Panqu Wang

We propose an online multi-view depth prediction approach on posed video streams, where the scene geometry information computed in the previous time steps is propagated to the current time step in an efficient and geometrically plausible…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Arda Düzçeker , Silvano Galliani , Christoph Vogel , Pablo Speciale , Mihai Dusmanu , Marc Pollefeys

The generalization and performance of stereo matching networks are limited due to the domain gap of the existing synthetic datasets and the sparseness of GT labels in the real datasets. In contrast, monocular depth estimation has achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Yuran Wang , Yingping Liang , Hesong Li , Ying Fu

In many fields, self-supervised learning solutions are rapidly evolving and filling the gap with supervised approaches. This fact occurs for depth estimation based on either monocular or stereo, with the latter often providing a valid…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Filippo Aleotti , Fabio Tosi , Li Zhang , Matteo Poggi , Stefano Mattoccia

Continual learning seeks to maintain stable adaptation under non-stationary environments, yet this problem becomes particularly challenging in object detection, where most existing methods implicitly assume relatively balanced visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Rangya Zhang , Jiaping Xiao , Lu Bai , Yuhang Zhang , Mir Feroskhan

This paper presents StereoNet, the first end-to-end deep architecture for real-time stereo matching that runs at 60 fps on an NVidia Titan X, producing high-quality, edge-preserved, quantization-free disparity maps. A key insight of this…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Sameh Khamis , Sean Fanello , Christoph Rhemann , Adarsh Kowdle , Julien Valentin , Shahram Izadi

Dataset distillation aims to synthesize compact yet informative datasets that allow models trained on them to achieve performance comparable to training on the full dataset. While this approach has shown promising results for image data,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Zhenghao Zhao , Haoxuan Wang , Kai Wang , Yuzhang Shang , Yuan Hong , Yan Yan

Multimodal summarization with multimodal output (MSMO) has emerged as a promising research direction. Nonetheless, numerous limitations exist within existing public MSMO datasets, including insufficient maintenance, data inaccessibility,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Jielin Qiu , Jiacheng Zhu , William Han , Aditesh Kumar , Karthik Mittal , Claire Jin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Ding Zhao , Bo Li , Lijuan Wang

Large-scale multi-view reconstruction models have made remarkable progress, but most existing approaches still rely on fully supervised training with ground-truth 3D/4D annotations. Such annotations are expensive and particularly scarce for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Nan Huang , Pengcheng Yu , Weijia Zeng , James M. Rehg , Angjoo Kanazawa , Haiwen Feng , Qianqian Wang

Current video editing models often rely on expensive paired video data, which limits their practical scalability. In essence, most video editing tasks can be formulated as a decoupled spatiotemporal process, where the temporal dynamics of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Jiayang Xu , Fan Zhuo , Majun Zhang , Changhao Pan , Zehan Wang , Siyu Chen , Xiaoda Yang , Tao Jin , Zhou Zhao

Recent deep learning based approaches have outperformed classical stereo matching methods. However, current deep learning based end-to-end stereo matching methods adopt a generic encoder-decoder style network with skip connections. To limit…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Kunal Swami , Kaushik Raghavan , Nikhilanj Pelluri , Rituparna Sarkar , Pankaj Bajpai

The view synthesis problem--generating novel views of a scene from known imagery--has garnered recent attention due in part to compelling applications in virtual and augmented reality. In this paper, we explore an intriguing scenario for…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Tinghui Zhou , Richard Tucker , John Flynn , Graham Fyffe , Noah Snavely

Recent video editing models have achieved impressive results, but most still require large-scale paired datasets. Collecting such naturally aligned pairs at scale remains highly challenging and constitutes a critical bottleneck, especially…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Tianlin Pan , Jiayi Dai , Chenpu Yuan , Zhengyao Lv , Binxin Yang , Hubery Yin , Chen Li , Jing Lyu , Caifeng Shan , Chenyang Si

In this paper, we propose an approach for view-time interpolation of stereo videos. Specifically, we build upon X-Fields that approximates an interpolatable mapping between the input coordinates and 2D RGB images using a convolutional…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Avinash Paliwal , Andrii Tsarov , Nima Khademi Kalantari

With the popularity of stereo cameras in computer assisted surgery techniques, a second viewpoint would provide additional information in surgery. However, how to effectively access and use stereo information for the super-resolution (SR)…

Image and Video Processing · Electrical Eng. & Systems 2020-03-20 Tianyi Zhang , Yun Gu , Xiaolin Huang , Enmei Tu , Jie Yang

Representing scenes with multiple semi-transparent colored layers has been a popular and successful choice for real-time novel view synthesis. Existing approaches infer colors and transparency values over regularly-spaced layers of planar…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Taras Khakhulin , Denis Korzhenkov , Pavel Solovev , Gleb Sterkin , Timotei Ardelean , Victor Lempitsky

Stereo image super-resolution (SSR) aims to enhance high-resolution details by leveraging information from stereo image pairs. However, existing stereo super-resolution (SSR) upsampling methods (e.g., pixel shuffle) often overlook…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Yi Liu , Xinyi Liu , Yi Wan , Panwang Xia , Qiong Wu , Yongjun Zhang

The prevailing video retrieval paradigm is structurally misaligned, as narrow benchmarks incentivize correspondingly limited data and single-task training. Therefore, universal capability is suppressed due to the absence of a diagnostic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Zhuoning Guo , Mingxin Li , Yanzhao Zhang , Dingkun Long , Pengjun Xie , Xiaowen Chu

Current self-supervised methods for monocular depth estimation are largely based on deeply nested convolutional networks that leverage stereo image pairs or monocular sequences during a training phase. However, they often exhibit inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jaehoon Cho , Dongbo Min , Youngjung Kim , Kwanghoon Sohn

Mask-free video object insertion has emerged as a challenging task, requiring harmonious integration of reference objects into source videos. However, existing methods struggle when references exhibit severe stylistic domain gaps with the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Xiao Cao , Yansong Qu , Xiangzhen , Chang , Wen Xiao , Jiakui Hu , Heyuan Li , Jialun Liu , Zhiyong Huang , Xuelong Li