English
Related papers

Related papers: Cross-View Completion Models are Zero-shot Corresp…

200 papers

This paper proposes a novel zero-shot composed image retrieval (CIR) method considering the query-target relationship by masked image-text pairs. The objective of CIR is to retrieve the target image using a query image and a query text.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Huaying Zhang , Rintaro Yanagi , Ren Togo , Takahiro Ogawa , Miki Haseyama

We present a deep learning framework for accurate visual correspondences and demonstrate its effectiveness for both geometric and semantic matching, spanning across rigid motions to intra-class shape or appearance variations. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2016-11-01 Christopher B. Choy , JunYoung Gwak , Silvio Savarese , Manmohan Chandraker

Visual attention, derived from cognitive neuroscience, facilitates human perception on the most pertinent subset of the sensory data. Recently, significant efforts have been made to exploit attention schemes to advance computer vision…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Shi Pu , Yibing Song , Chao Ma , Honggang Zhang , Ming-Hsuan Yang

Zero-shot object detection (ZSD), the task that extends conventional detection models to detecting objects from unseen categories, has emerged as a new challenge in computer vision. Most existing approaches tackle the ZSD task with a strict…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Caixia Yan , Xiaojun Chang , Minnan Luo , Huan Liu , Xiaoqin Zhang , Qinghua Zheng

While dense retrieval has been shown effective and efficient across tasks and languages, it remains difficult to create effective fully zero-shot dense retrieval systems when no relevance label is available. In this paper, we recognize the…

Information Retrieval · Computer Science 2022-12-21 Luyu Gao , Xueguang Ma , Jimmy Lin , Jamie Callan

Recently, large-scale Contrastive Language-Image Pre-training (CLIP) has attracted unprecedented attention for its impressive zero-shot recognition ability and excellent transferability to downstream tasks. However, CLIP is quite…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Yangguang Li , Feng Liang , Lichen Zhao , Yufeng Cui , Wanli Ouyang , Jing Shao , Fengwei Yu , Junjie Yan

Zero-shot learning (ZSL) aims to recognize unseen image categories by learning an embedding space between image and semantic representations. For years, among existing works, it has been the center task to learn the proper mapping matrices…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Yan Li , Junge Zhang , Jianguo Zhang , Kaiqi Huang

Large language models trained primarily in a monolingual setting have demonstrated their ability to generalize to machine translation using zero- and few-shot examples with in-context learning. However, even though zero-shot translations…

Computation and Language · Computer Science 2023-11-07 Weiting Tan , Haoran Xu , Lingfeng Shen , Shuyue Stella Li , Kenton Murray , Philipp Koehn , Benjamin Van Durme , Yunmo Chen

Current methods for prompt learning in zeroshot scenarios widely rely on a development set with sufficient human-annotated data to select the best-performing prompt template a posteriori. This is not ideal because in a realworld zero-shot…

Computation and Language · Computer Science 2023-05-17 Jinghui Lu , Dongsheng Zhu , Weidong Han , Rui Zhao , Brian Mac Namee , Fei Tan

Accurate feature matching and correspondence in endoscopic images play a crucial role in various clinical applications, including patient follow-up and rapid anomaly localization through panoramic image generation. However, developing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Manel Farhat , Achraf Ben-Hamadou

CLIP has shown a remarkable zero-shot capability on a wide range of vision tasks. Previously, CLIP is only regarded as a powerful visual encoder. However, after being pre-trained by language supervision from a large amount of image-caption…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Haoyu Song , Li Dong , Wei-Nan Zhang , Ting Liu , Furu Wei

Pre-trained language models (PLMs) have been shown effective for zero-shot (0shot) text classification. 0shot models based on natural language inference (NLI) and next sentence prediction (NSP) employ cross-encoder architecture and infer by…

Computation and Language · Computer Science 2022-10-25 Prafulla Kumar Choubey , Yu Bai , Chien-Sheng Wu , Wenhao Liu , Nazneen Rajani

This paper proposes to learn reliable dense correspondence from videos in a self-supervised manner. Our learning process integrates two highly related tasks: tracking large image regions \emph{and} establishing fine-grained pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Xueting Li , Sifei Liu , Shalini De Mello , Xiaolong Wang , Jan Kautz , Ming-Hsuan Yang

Zero-shot learning aims to classify visual objects without any training data via knowledge transfer between seen and unseen classes. This is typically achieved by exploring a semantic embedding space where the seen and unseen classes can be…

Computer Vision and Pattern Recognition · Computer Science 2015-06-04 Zhen-Yong Fu , Tao Xiang , Shaogang Gong

Large-scale vision foundation models have demonstrated remarkable success across various tasks, underscoring their robust generalization capabilities. While their proficiency in two-view correspondence has been explored, their effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Görkay Aydemir , Weidi Xie , Fatma Güney

In this work, we propose a Cross-view Contrastive Learning framework for unsupervised 3D skeleton-based action Representation (CrosSCLR), by leveraging multi-view complementary supervision signal. CrosSCLR consists of both single-view…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Linguo Li , Minsi Wang , Bingbing Ni , Hang Wang , Jiancheng Yang , Wenjun Zhang

In this paper, we aim at establishing accurate dense correspondences between a pair of images with overlapping field of view under challenging illumination variation, viewpoint changes, and style differences. Through an extensive ablation…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Georgi Tinchev , Shuda Li , Kai Han , David Mitchell , Rigas Kouskouridas

The performance of generative zero-shot methods mainly depends on the quality of generated features and how well the model facilitates knowledge transfer between visual and semantic domains. The quality of generated features is a direct…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Shivam Chandhok , Vineeth N Balasubramanian

This paper addresses the problem of handling spatial misalignments due to camera-view changes or human-pose variations in person re-identification. We first introduce a boosting-based approach to learn a correspondence structure which…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Weiyao Lin , Yang Shen , Junchi Yan , Mingliang Xu , Jianxin Wu , Jingdong Wang , Ke Lu

Deep learning has significantly improved the precision of instance segmentation with abundant labeled data. However, in many areas like medical and manufacturing, collecting sufficient data is extremely hard and labeling this data requires…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Ye Zheng , Jiahong Wu , Yongqiang Qin , Faen Zhang , Li Cui