English
Related papers

Related papers: Open-World Stereo Video Matching with Deep RNN

200 papers

In this paper, we present confidence inference approachin an unsupervised way in stereo matching. Deep Neu-ral Networks (DNNs) have recently been achieving state-of-the-art performance. However, it is often hard to tellwhether the trained…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Ruichao Xiao , Wenxiu Sun , Chengxi Yang

Accelerating the data acquisition of dynamic magnetic resonance imaging (MRI) leads to a challenging ill-posed inverse problem, which has received great interest from both the signal processing and machine learning community over the last…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Chen Qin , Jo Schlemper , Jose Caballero , Anthony Price , Joseph V. Hajnal , Daniel Rueckert

Many semantic video analysis tasks can benefit from multiple, heterogenous signals. For example, in addition to the original RGB input sequences, sequences of optical flow are usually used to boost the performance of human action…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Lin Sun , Kui Jia , Yuejia Shen , Silvio Savarese , Dit Yan Yeung , Bertram E. Shi

We propose a novel lightweight network for stereo estimation. Our network consists of a fully-convolutional densely connected neural network (FC-DCNN) that computes matching costs between rectified image pairs. Our FC-DCNN method learns…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Dominik Hirner , Friedrich Fraundorfer

In this paper, we propose a unified method to jointly learn optical flow and stereo matching. Our first intuition is stereo matching can be modeled as a special case of optical flow, and we can leverage 3D geometry behind stereoscopic…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Pengpeng Liu , Irwin King , Michael Lyu , Jia Xu

We introduce Stereo Risk, a new deep-learning approach to solve the classical stereo-matching problem in computer vision. As it is well-known that stereo matching boils down to a per-pixel disparity estimation problem, the popular…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Ce Liu , Suryansh Kumar , Shuhang Gu , Radu Timofte , Yao Yao , Luc Van Gool

We present a novel framework for applying deep neural networks (DNN) to soft decoding of linear codes at arbitrary block lengths. Unlike other approaches, our framework allows unconstrained DNN design, enabling the free application of…

Information Theory · Computer Science 2018-02-27 Amir Bennatan , Yoni Choukroun , Pavel Kisilev

Recurrent neural networks (RNNs) have shown excellent performance in processing sequence data. However, they are both complex and memory intensive due to their recursive nature. These limitations make RNNs difficult to embed on mobile…

Machine Learning · Computer Science 2019-01-28 Arash Ardakani , Zhengyun Ji , Sean C. Smithson , Brett H. Meyer , Warren J. Gross

Deep Neural Networks (DNNs) have the potential to improve the quality of image-based 3D reconstructions. However, the use of DNNs in the context of 3D reconstruction from large and high-resolution image datasets is still an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Andreas Kuhn , Christian Sormann , Mattia Rossi , Oliver Erdler , Friedrich Fraundorfer

This paper presents to the best of our knowledge the first end-to-end object tracking approach which directly maps from raw sensor input to object tracks in sensor space without requiring any feature engineering or system identification in…

Machine Learning · Computer Science 2016-03-10 Peter Ondruska , Ingmar Posner

We present a novel approach to online multi-target tracking based on recurrent neural networks (RNNs). Tracking multiple objects in real-world scenes involves many challenges, including a) an a-priori unknown and time-varying number of…

Computer Vision and Pattern Recognition · Computer Science 2016-12-08 Anton Milan , Seyed Hamid Rezatofighi , Anthony Dick , Ian Reid , Konrad Schindler

Recently, leveraging on the development of end-to-end convolutional neural networks (CNNs), deep stereo matching networks have achieved remarkable performance far exceeding traditional approaches. However, state-of-the-art stereo frameworks…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Xiao Song , Xu Zhao , Liangji Fang , Hanwen Hu

Convolutional neural networks(CNN) have been shown to perform better than the conventional stereo algorithms for stereo estimation. Numerous efforts focus on the pixel-wise matching cost computation, which is the important building block…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Haihua Lu , Hai Xu , Li Zhang , Yong Zhao

Emotion analysis is a crucial problem to endow artifact machines with real intelligence in many large potential applications. As external appearances of human emotions, electroencephalogram (EEG) signals and video face signals are widely…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Tong Zhang , Wenming Zheng , Zhen Cui , Yuan Zong , Yang Li

Recommendations can greatly benefit from good representations of the user state at recommendation time. Recent approaches that leverage Recurrent Neural Networks (RNNs) for session-based recommendations have shown that Deep Learning models…

Information Retrieval · Computer Science 2017-06-26 Elena Smirnova , Flavian Vasile

Text recognition in natural scene is a challenging problem due to the many factors affecting text appearance. In this paper, we presents a method that directly transcribes scene text images to text without needing of sophisticated character…

Computer Vision and Pattern Recognition · Computer Science 2016-01-07 Guo Qiang , Tu Dan , Li Guohui , Lei Jun

In this work we present a self-supervised learning framework to simultaneously train two Convolutional Neural Networks (CNNs) to predict depth and surface normals from a single image. In contrast to most existing frameworks which represent…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Huangying Zhan , Chamara Saroj Weerasekera , Ravi Garg , Ian Reid

This paper proposes a novel framework for recurrent neural networks (RNNs) inspired by the human memory models in the field of cognitive neuroscience to enhance information processing and transmission between adjacent RNNs' units. The…

Neural and Evolutionary Computing · Computer Science 2018-06-05 Xi Chen , Zhihong Deng , Gehui Shen , Ting Huang

Recently, deep learning has achieved very promising results in visual object tracking. Deep neural networks in existing tracking methods require a lot of training data to learn a large number of parameters. However, training data is not…

Computer Vision and Pattern Recognition · Computer Science 2018-01-09 Li Wang , Ting Liu , Bing Wang , Xulei Yang , Gang Wang

We propose a neural inverse rendering approach that jointly reconstructs geometry, spatially varying reflectance, and lighting conditions from multi-view images captured under varying directional lighting. Unlike prior multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Xu Cao , Takafumi Taketomi