English
Related papers

Related papers: Cubes3D: Neural Network based Optical Flow in Omni…

200 papers

Optical flow is a fundamental technique for motion estimation, widely applied in video stabilization, interpolation, and object tracking. Traditional optical flow estimation methods rely on restrictive assumptions like brightness constancy…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yu-Hsi Chen , Chin-Tien Wu

A recent paper by Gatys et al. describes a method for rendering an image in the style of another image. First, they use convolutional neural network features to build a statistical model for the style of an image. Then they create a new…

Computer Vision and Pattern Recognition · Computer Science 2016-05-27 Alexander G. Anderson , Cory P. Berg , Daniel P. Mossing , Bruno A. Olshausen

In this work, we extract the optical flow field corresponding to moving objects from an image sequence of a scene impacted by atmospheric turbulence \emph{and} captured from a moving camera. Our procedure first computes the optical flow…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Nicholas Ferrante , Jerome Gilles , Shibin Parameswaran

Real-time high-accuracy optical flow estimation is a crucial component in various applications, including localization and mapping in robotics, object tracking, and activity recognition in computer vision. While recent learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Zhiyong Zhang , Huaizu Jiang , Hanumant Singh

Omni-directional cameras have many advantages overconventional cameras in that they have a much wider field-of-view (FOV). Accordingly, several approaches have beenproposed recently to apply convolutional neural networks(CNNs) to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yeonkun Lee , Jaeseok Jeong , Jongseob Yun , Wonjune Cho , Kuk-Jin Yoon

Significant progress has been made for estimating optical flow using deep neural networks. Advanced deep models achieve accurate flow estimation often with a considerable computation complexity and time-consuming training processes. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Lingtong Kong , Jie Yang

Convolutional neural networks (CNNs) have massively impacted visual recognition in 2D images, and are now ubiquitous in state-of-the-art approaches. CNNs do not easily extend, however, to data that are not represented by regular grids, such…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Nitika Verma , Edmond Boyer , Jakob Verbeek

Existing optical flow methods make generic, spatially homogeneous, assumptions about the spatial structure of the flow. In reality, optical flow varies across an image depending on object class. Simply put, different objects move…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Laura Sevilla-Lara , Deqing Sun , Varun Jampani , Michael J. Black

Autonomous vehicle navigation is a key challenge in artificial intelligence, requiring robust and accurate decision-making processes. This research introduces a new end-to-end method that exploits multimodal information from a single…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Fouad Makiyeh , Mark Bastourous , Anass Bairouk , Wei Xiao , Mirjana Maras , Tsun-Hsuan Wangb , Marc Blanchon , Ramin Hasani , Patrick Chareyre , Daniela Rus

We present a general and flexible approximation model for near real-time prediction of steady turbulent flow in a 3D domain based on residual Convolutional Neural Networks (CNNs). This approach can provide immediate feedback for real-time…

Graphics · Computer Science 2019-12-05 Josef Musil , Jakub Knir , Athanasios Vitsas , Irene Gallou

The deep two-stream architecture exhibited excellent performance on video based action recognition. The most computationally expensive step in this approach comes from the calculation of optical flow which prevents it to be real-time. This…

Computer Vision and Pattern Recognition · Computer Science 2016-04-27 Bowen Zhang , Limin Wang , Zhe Wang , Yu Qiao , Hanli Wang

The sensitivity of thin-film materials and devices to defects motivates extensive research into the optimization of film morphology. This research could be accelerated by automated experiments that characterize the response of film…

This paper deals with the scarcity of data for training optical flow networks, highlighting the limitations of existing sources such as labeled synthetic datasets or unlabeled real videos. Specifically, we introduce a framework to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Filippo Aleotti , Matteo Poggi , Stefano Mattoccia

Scene understanding plays an important role in several high-level computer vision applications, such as autonomous vehicles, intelligent video surveillance, or robotics. However, too few solutions have been proposed for indoor/outdoor scene…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ayman Beghdadi , Azeddine Beghdadi , Mohib Ullah , Faouzi Alaya Cheikh , Malik Mallem

We study the unsupervised learning of CNNs for optical flow estimation using proxy ground truth data. Supervised CNNs, due to their immense learning capacity, have shown superior performance on a range of computer vision problems including…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Yi Zhu , Zhenzhong Lan , Shawn Newsam , Alexander G. Hauptmann

Computed Tomography is a powerful imaging technique that allows non-destructive visualization of the interior of physical objects in different scientific areas. In traditional reconstruction techniques the object of interest is mostly…

Image and Video Processing · Electrical Eng. & Systems 2019-05-03 Koen Ruymbeek , Wim Vanroose

Convolutional Neural Networks (CNN) have been found to have great potential in optical flow problems thanks to an abundance of data available for training a deep network. The displacement estimation step in UltraSound Elastography (USE) can…

Image and Video Processing · Electrical Eng. & Systems 2020-07-06 Ali K. Z. Tehrani , Morteza Mirzaei , Hassan Rivaz

We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints. We approach this as a learning task but, critically, instead of learning to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Tinghui Zhou , Shubham Tulsiani , Weilun Sun , Jitendra Malik , Alexei A. Efros

We address the problem of joint optical flow and camera motion estimation in rigid scenes by incorporating geometric constraints into an unsupervised deep learning framework. Unlike existing approaches which rely on brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Shihao Jiang , Dylan Campbell , Miaomiao Liu , Stephen Gould , Richard Hartley

Motion is a dominant cue in automated driving systems. Optical flow is typically computed to detect moving objects and to estimate depth using triangulation. In this paper, our motivation is to leverage the existing dense optical flow to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Hazem Rashed , Senthil Yogamani , Ahmad El-Sallab , Pavel Krizek , Mohamed El-Helw