English
Related papers

Related papers: Deep Optical Flow Estimation Via Multi-Scale Corre…

200 papers

Optical flow estimation is a fundamental problem of computer vision and has many applications in the fields of robot learning and autonomous driving. This paper reveals novel geometric laws of optical flow based on the insight and detailed…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Guangming Wang , Shuaiqi Ren , Hesheng Wang

In this paper, we investigate the research problem of unsupervised multi-view feature selection. Conventional solutions first simply combine multiple pre-constructed view-specific similarity structures into a collaborative similarity…

Information Retrieval · Computer Science 2019-04-26 Xiao Dong , Lei Zhu , Xuemeng Song , Jingjing Li , Zhiyong Cheng

Understanding the flow in 3D space of sparsely sampled points between two consecutive time frames is the core stone of modern geometric-driven systems such as VR/AR, Robotics, and Autonomous driving. The lack of real, non-simulated, labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Bojun Ouyang , Dan Raviv

Self-supervised learning of visual representations has been focusing on learning content features, which do not capture object motion or location, and focus on identifying and differentiating objects in images and videos. On the other hand,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Adrien Bardes , Jean Ponce , Yann LeCun

While Multi-view Graph Neural Networks (MVGNNs) excel at leveraging diverse modalities for learning object representation, existing methods assume identical local topology structures across modalities that overlook real-world discrepancies.…

Machine Learning · Computer Science 2024-06-05 Peiyu Liang , Hongchang Gao , Xubin He

In recent years, Multi-View Clustering (MVC) has attracted increasing attention for its potential to reduce the annotation burden associated with large datasets. The aim of MVC is to exploit the inherent consistency and complementarity…

Machine Learning · Computer Science 2024-07-12 Zhangci Xiong , Meng Cao

Optical flow estimation is a challenging problem remaining unsolved. Recent deep learning based optical flow models have achieved considerable success. However, these models often train networks from the scratch on standard optical flow…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Qiaole Dong , Chenjie Cao , Yanwei Fu

Current Multimodal Large Language Models (MLLMs) typically integrate a pre-trained LLM with another pre-trained vision transformer through a connector, such as an MLP, endowing the LLM with visual capabilities. However, the misalignment…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Shiyin Lu , Yang Li , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Han-Jia Ye

This paper deals with a challenging, frequently encountered, yet not properly investigated problem in two-frame optical flow estimation. That is, the input frames are compounds of two imaging layers -- one desired background layer of the…

Computer Vision and Pattern Recognition · Computer Science 2016-05-09 Jiaolong Yang , Hongdong Li , Yuchao Dai , Robby T. Tan

Monocular depth estimation, enabled by self-supervised learning, is a key technique for 3D perception in computer vision. However, it faces significant challenges in real-world scenarios, which encompass adverse weather variations, motion…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Runze Chen , Haiyong Luo , Fang Zhao , Jingze Yu , Yupeng Jia , Juan Wang , Xuepeng Ma

In machine learning, the cost function is crucial because it measures how good or bad a system is. In image classification, well-known networks only consider modifying the network structures and applying cross-entropy loss at the end of the…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Trung Dung Do , Cheng-Bin Jin , Hakil Kim , Van Huan Nguyen

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

Discriminative correlation filters (DCF) with deep convolutional features have achieved favorable performance in recent tracking benchmarks. However, most of existing DCF trackers only consider appearance features of current frame, and…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Zheng Zhu , Wei Wu , Wei Zou , Junjie Yan

Learning matching costs has been shown to be critical to the success of the state-of-the-art deep stereo matching methods, in which 3D convolutions are applied on a 4D feature volume to learn a 3D cost volume. However, this mechanism has…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Jianyuan Wang , Yiran Zhong , Yuchao Dai , Kaihao Zhang , Pan Ji , Hongdong Li

Because hyperspectral remote sensing images contain a lot of redundant information and the data structure is highly non-linear, leading to low classification accuracy of traditional machine learning methods. The latest research shows that…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Xiangdong Zhang , Tengjun Wang , Yun Yang

Super-resolution (SR) techniques based on deep learning have recently emerged as a promising approach to enhance the spatial resolution of computational fluid dynamics simulations while containing computational cost. In this paper, we…

Fluid Dynamics · Physics 2026-04-13 Armin Sheidani , Michele Girfoglio , Annalisa Quaini , Gianluigi Rozza

This paper introduces a new method for inter-frame coding based on two complementary autoencoders: MOFNet and CodecNet. MOFNet aims at computing and conveying the Optical Flow and a pixel-wise coding Mode selection. The optical flow is used…

Image and Video Processing · Electrical Eng. & Systems 2020-08-07 Théo Ladune , Pierrick Philippe , Wassim Hamidouche , Lu Zhang , Olivier Déforges

This paper addresses the problem of generating dense point clouds from given sparse point clouds to model the underlying geometric structures of objects/scenes. To tackle this challenging issue, we propose a novel end-to-end learning-based…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yue Qian , Junhui Hou , Sam Kwong , Ying He

Optical flow is a method aimed at predicting the movement velocity of any pixel in the image and is used in medicine and biology to estimate flow of particles in organs or organelles. However, a precise optical flow measurement requires…

Image and Video Processing · Electrical Eng. & Systems 2021-02-16 Adrian Shajkofci , Michael Liebling

We explore learning pixelwise correspondences between images of deformable objects in different configurations. Traditional correspondence matching approaches such as SIFT, SURF, and ORB can fail to provide sufficient contextual information…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Aditya Ganapathi , Priya Sundaresan , Brijen Thananjeyan , Ashwin Balakrishna , Daniel Seita , Ryan Hoque , Joseph E. Gonzalez , Ken Goldberg