English
Related papers

Related papers: Dense Semantic Correspondence where Every Pixel is…

200 papers

This paper proposes to learn reliable dense correspondence from videos in a self-supervised manner. Our learning process integrates two highly related tasks: tracking large image regions \emph{and} establishing fine-grained pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Xueting Li , Sifei Liu , Shalini De Mello , Xiaolong Wang , Jan Kautz , Ming-Hsuan Yang

We address the problem of semantic correspondence, that is, establishing a dense flow field between images depicting different instances of the same object or scene category. We propose to use images annotated with binary foreground masks…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Junghyup Lee , Dohyung Kim , Jean Ponce , Bumsub Ham

Recent progress in deterministic prompt learning has become a promising alternative to various downstream vision tasks, enabling models to learn powerful visual representations with the help of pre-trained vision-language models. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Hyeongjun Kwon , Taeyong Song , Somi Jeong , Jin Kim , Jinhyun Jang , Kwanghoon Sohn

World models compress rich sensory streams into compact latent codes that anticipate future observations. We let separate agents acquire such models from distinct viewpoints of the same environment without any parameter sharing or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Haoran Zhang , Youjin Wang , Yi Duan , Rong Fu , Dianyu Zhao , Sicheng Fan , Shuaishuai Cao , Wentao Guo , Xiao Zhou

Aligned text-image encoders such as CLIP have become the de facto model for vision-language tasks. Furthermore, modality-specific encoders achieve impressive performances in their respective domains. This raises a central question: does an…

Finding point-wise correspondences between images is a long-standing problem in image analysis. This becomes particularly challenging for sketch images, due to the varying nature of human drawing style, projection distortions and viewport…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Pablo Navarro , José Ignacio Orlando , Claudio Delrieux , Emmanuel Iarussi

In this paper, we aim at establishing accurate dense correspondences between a pair of images with overlapping field of view under challenging illumination variation, viewpoint changes, and style differences. Through an extensive ablation…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Georgi Tinchev , Shuda Li , Kai Han , David Mitchell , Rigas Kouskouridas

This paper addresses the problem of determining dense pixel correspondences between two images and its application to geometric correspondence verification in image retrieval. The main contribution is a geometric correspondence verification…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Zakaria Laskar , Iaroslav Melekhov , Hamed R. Tavakoli , Juha Ylioinas , Juho Kannala

Video analysis tasks rely heavily on identifying the pixels from different frames that correspond to the same visual target. To tackle this problem, recent studies have advocated feature learning methods that aim to learn distinctive…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Rui Li , Shenglong Zhou , Dong Liu

In many modern computer application problems, the classification of image data plays an important role. Among many different supervised machine learning models, convolutional neural networks (CNNs) and linear discriminant analysis (LDA) as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Axel Klawonn , Martin Lanser , Janine Weber

Establishing robust and accurate correspondences is a fundamental backbone to many computer vision algorithms. While recent learning-based feature matching methods have shown promising results in providing robust correspondences under…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Hugo Germain , Guillaume Bourmaud , Vincent Lepetit

Understanding user interface (UI) functionality is a useful yet challenging task for both machines and people. In this paper, we investigate a machine learning approach for screen correspondence, which allows reasoning about UIs by mapping…

Human-Computer Interaction · Computer Science 2023-01-23 Jason Wu , Amanda Swearngin , Xiaoyi Zhang , Jeffrey Nichols , Jeffrey P. Bigham

We address the problem of finding reliable dense correspondences between a pair of images. This is a challenging task due to strong appearance differences between the corresponding scene elements and ambiguities generated by repetitive…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Ignacio Rocco , Mircea Cimpoi , Relja Arandjelović , Akihiko Torii , Tomas Pajdla , Josef Sivic

What representation do deep neural networks learn? How similar are images to each other for neural networks? Despite the overwhelming success of deep learning methods key questions about their internal workings still remain largely…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Tassilo Wald , Constantin Ulrich , Gregor Köhler , David Zimmerer , Stefan Denner , Michael Baumgartner , Fabian Isensee , Priyank Jaini , Klaus H. Maier-Hein

Establishing semantic correspondence is a core problem in computer vision and remains challenging due to large intra-class variations and lack of annotated data. In this paper, we aim to incorporate global semantic context in a flexible…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Shuaiyi Huang , Qiuyue Wang , Songyang Zhang , Shipeng Yan , Xuming He

In this work, we introduce a deep-learning framework designed for estimating dense image correspondences. Our fully convolutional model generates dense feature maps for images, where each pixel is associated with a descriptor that can be…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Monika Kwiatkowski , Simon Matern , Olaf Hellwich

Semantic image parsing, which refers to the process of decomposing images into semantic regions and constructing the structure representation of the input, has recently aroused widespread interest in the field of computer vision. The recent…

Computer Vision and Pattern Recognition · Computer Science 2018-10-11 Lili Huang , Jiefeng Peng , Ruimao Zhang , Guanbin Li , Liang Lin

Establishing dense semantic correspondences between object instances remains a challenging problem due to background clutter, significant scale and pose differences, and large intra-class variations. In this paper, we address weakly…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yun-Chun Chen , Po-Hsiang Huang , Li-Yu Yu , Jia-Bin Huang , Ming-Hsuan Yang , Yen-Yu Lin

Learning feature correspondence is a foundational task in computer vision, holding immense importance for downstream applications such as visual odometry and 3D reconstruction. Despite recent progress in data-driven models, feature…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Zitong Zhan , Dasong Gao , Yun-Jou Lin , Youjie Xia , Chen Wang

Applications such as textual entailment, plagiarism detection or document clustering rely on the notion of semantic similarity, and are usually approached with dimension reduction techniques like LDA or with embedding-based neural…

Computation and Language · Computer Science 2019-09-20 Ahmed Sabir , Francesc Moreno-Noguer , Lluís Padró