English
Related papers

Related papers: Learning Dense Correspondence via 3D-guided Cycle …

200 papers

Dense visual correspondence plays a vital role in robotic perception. This work focuses on establishing the dense correspondence between a pair of images that captures dynamic scenes undergoing substantial transformations. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Zhenyu Jiang , Hanwen Jiang , Yuke Zhu

In this paper, we tackle the task of establishing dense visual correspondences between images containing objects of the same category. This is a challenging task due to large intra-class variations and a lack of dense pixel level…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Shuda Li , Kai Han , Theo W. Costain , Henry Howard-Jenkins , Victor Prisacariu

We propose a self-supervised approach to deep surface deformation. Given a pair of shapes, our algorithm directly predicts a parametric transformation from one shape to the other respecting correspondences. Our insight is to use…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Thibault Groueix , Matthew Fisher , Vladimir G. Kim , Bryan C. Russell , Mathieu Aubry

Establishing dense correspondences between a pair of images is an important and general problem. However, dense flow estimation is often inaccurate in the case of large displacements or homogeneous regions. For most applications and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Prune Truong , Martin Danelljan , Luc Van Gool , Radu Timofte

Crowdsourced 3D CAD models are becoming easily accessible online, and can potentially generate an infinite number of training images for almost any object category.We show that augmenting the training data of contemporary Deep Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2015-10-13 Xingchao Peng , Baochen Sun , Karim Ali , Kate Saenko

In this paper, we aim at establishing accurate dense correspondences between a pair of images with overlapping field of view under challenging illumination variation, viewpoint changes, and style differences. Through an extensive ablation…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Georgi Tinchev , Shuda Li , Kai Han , David Mitchell , Rigas Kouskouridas

We address the problem of semantic correspondence, that is, establishing a dense flow field between images depicting different instances of the same object or scene category. We propose to use images annotated with binary foreground masks…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Junghyup Lee , Dohyung Kim , Wonkyung Lee , Jean Ponce , Bumsub Ham

Recent work has shown that convolutional networks can be substantially deeper, more accurate, and efficient to train if they contain shorter connections between layers close to the input and those close to the output. In this paper, we…

Machine Learning · Computer Science 2020-01-09 Gao Huang , Zhuang Liu , Geoff Pleiss , Laurens van der Maaten , Kilian Q. Weinberger

We describe a method for unpaired realistic depth synthesis that learns diverse variations from the real-world depth scans and ensures geometric consistency between the synthetic and synthesized depth. The synthesized realistic depth can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yuefan Shen , Yanchao Yang , Youyi Zheng , C. Karen Liu , Leonidas Guibas

We present a deep learning framework for accurate visual correspondences and demonstrate its effectiveness for both geometric and semantic matching, spanning across rigid motions to intra-class shape or appearance variations. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2016-11-01 Christopher B. Choy , JunYoung Gwak , Silvio Savarese , Manmohan Chandraker

3D visual grounding is the task of localizing the object in a 3D scene which is referred by a description in natural language. With a wide range of applications ranging from autonomous indoor robotics to AR/VR, the task has recently risen…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Ozan Unal , Christos Sakaridis , Suman Saha , Luc Van Gool

Dense correspondence between humans carries powerful semantic information that can be utilized to solve fundamental problems for full-body understanding such as in-the-wild surface matching, tracking and reconstruction. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Anastasia Ianina , Nikolaos Sarafianos , Yuanlu Xu , Ignacio Rocco , Tony Tung

Semantic understanding of 3D objects is crucial in many applications such as object manipulation. However, it is hard to give a universal definition of point-level semantics that everyone would agree on. We observe that people have a…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Yujing Lou , Yang You , Chengkun Li , Zhoujun Cheng , Liangwei Li , Lizhuang Ma , Weiming Wang , Cewu Lu

While 6D object pose estimation has wide applications across computer vision and robotics, it remains far from being solved due to the lack of annotations. The problem becomes even more challenging when moving to category-level 6D pose,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Kaifeng Zhang , Yang Fu , Shubhankar Borse , Hong Cai , Fatih Porikli , Xiaolong Wang

At the heart of many robotics problems is the challenge of learning correspondences across domains. For instance, imitation learning requires obtaining correspondence between humans and robots; sim-to-real requires correspondence between…

Robotics · Computer Science 2020-12-18 Qiang Zhang , Tete Xiao , Alexei A. Efros , Lerrel Pinto , Xiaolong Wang

We present a new deep learning approach for matching deformable shapes by introducing {\it Shape Deformation Networks} which jointly encode 3D shapes and correspondences. This is achieved by factoring the surface representation into (i) a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Thibault Groueix , Matthew Fisher , Vladimir G. Kim , Bryan C. Russell , Mathieu Aubry

Recent work has shown that convolutional networks can be substantially deeper, more accurate, and efficient to train if they contain shorter connections between layers close to the input and those close to the output. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Gao Huang , Zhuang Liu , Laurens van der Maaten , Kilian Q. Weinberger

In cross-domain retrieval, a model is required to identify images from the same semantic category across two visual domains. For instance, given a sketch of an object, a model needs to retrieve a real image of it from an online store's…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Samarth Mishra , Carlos D. Castillo , Hongcheng Wang , Kate Saenko , Venkatesh Saligrama

This paper deals with the problem of 3D tracking, i.e., to find dense correspondences in a sequence of time-varying 3D shapes. Despite deep learning approaches have achieved promising performance for pairwise dense 3D shapes matching, it is…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Shuaihang Yuan , Xiang Li , Yi Fang

We tackle the problem of learning the geometry of multiple categories of deformable objects jointly. Recent work has shown that it is possible to learn a unified dense pose predictor for several categories of related objects. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Natalia Neverova , Artsiom Sanakoyeu , Patrick Labatut , David Novotny , Andrea Vedaldi