中文
相关论文

相关论文: Self-Supervised Approach to Addressing Zero-Shot L…

200 篇论文

Self-supervised learning techniques have shown their abilities to learn meaningful feature representation. This is made possible by training a model on pretext tasks that only requires to find correlations between inputs or parts of inputs.…

计算机视觉与模式识别 · 计算机科学 2020-01-17 Vishal Keshav , Fabien Delattre

We propose a method of aligning a source image to a target image, where the transform is specified by a dense vector field. The two images are encoded as feature hierarchies by siamese convolutional nets. Then a hierarchy of aligner modules…

计算机视觉与模式识别 · 计算机科学 2019-04-05 Eric Mitchell , Stefan Keselj , Sergiy Popovych , Davit Buniatyan , H. Sebastian Seung

Recent works in self-supervised learning have advanced the state-of-the-art by relying on the contrastive learning paradigm, which learns representations by pushing positive pairs, or similar examples from the same class, closer together…

机器学习 · 计算机科学 2022-06-27 Jeff Z. HaoChen , Colin Wei , Adrien Gaidon , Tengyu Ma

Recent self-supervised contrastive learning methods greatly benefit from the Siamese structure that aims at minimizing distances between positive pairs. For high performance Siamese representation learning, one of the keys is to design good…

计算机视觉与模式识别 · 计算机科学 2022-03-31 Xiangyu Peng , Kai Wang , Zheng Zhu , Mang Wang , Yang You

Zero-shot Learners are models capable of predicting unseen classes. In this work, we propose a Zero-shot Learning approach for text categorization. Our method involves training model on a large corpus of sentences to learn the relationship…

计算与语言 · 计算机科学 2017-12-27 Pushpankar Kumar Pushp , Muktabh Mayank Srivastava

Self-supervised learning has shown superior performances over supervised methods on various vision benchmarks. The siamese network, which encourages embeddings to be invariant to distortions, is one of the most successful self-supervised…

计算机视觉与模式识别 · 计算机科学 2022-06-16 Li Jing , Jiachen Zhu , Yann LeCun

This paper introduces SelfMatch, a semi-supervised learning method that combines the power of contrastive self-supervised learning and consistency regularization. SelfMatch consists of two stages: (1) self-supervised pre-training based on…

机器学习 · 计算机科学 2021-01-19 Byoungjip Kim , Jinho Choo , Yeong-Dae Kwon , Seongho Joe , Seungjai Min , Youngjune Gwon

Semi-supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi-supervised Contrastive Learning (SsCL), which combines the well-known contrastive loss…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Yuhang Zhang , Xiaopeng Zhang , Robert. C. Qiu , Jie Li , Haohang Xu , Qi Tian

Deep embeddings answer one simple question: How similar are two images? Learning these embeddings is the bedrock of verification, zero-shot learning, and visual search. The most prominent approaches optimize a deep convolutional network…

计算机视觉与模式识别 · 计算机科学 2018-01-17 Chao-Yuan Wu , R. Manmatha , Alexander J. Smola , Philipp Krähenbühl

The advent of deep learning has a profound effect on visual neuroscience. It paved the way for new models to predict neural data. Although deep convolutional neural networks are explicitly trained for categorization, they learn a…

神经元与认知 · 定量生物学 2019-07-08 Aakash Agrawal

Object classes that surround us have a natural tendency to emerge at varying levels of abstraction. We propose a Bayesian approach to zero-shot learning (ZSL) that introduces the notion of meta-classes and implements a Bayesian hierarchy…

计算机视觉与模式识别 · 计算机科学 2020-08-28 Sarkhan Badirli , Zeynep Akata , Murat Dundar

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

计算机视觉与模式识别 · 计算机科学 2022-10-10 Zhenyuan Lu

We consider the task of multimodal one-shot speech-image matching. An agent is shown a picture along with a spoken word describing the object in the picture, e.g. cookie, broccoli and ice-cream. After observing one paired speech-image…

计算与语言 · 计算机科学 2020-08-17 Leanne Nortje , Herman Kamper

Recent advances in audio-text cross-modal contrastive learning have shown its potential towards zero-shot learning. One possibility for this is by projecting item embeddings from pre-trained backbone neural networks into a cross-modal space…

声音 · 计算机科学 2025-09-29 Tiago Tavares , Fabio Ayres , Zhepei Wang , Paris Smaragdis

Reinforcement learning algorithms such as Q-learning have shown great promise in training models to learn the optimal action to take for a given system state; a goal in applications with an exploratory or adversarial nature such as…

计算与语言 · 计算机科学 2020-04-08 Xusen Yin , Jonathan May

Self-supervised representation learning is a fundamental problem in computer vision with many useful applications (e.g., image search, instance level recognition, copy detection). In this paper we present a new contrastive self-supervised…

计算机视觉与模式识别 · 计算机科学 2021-11-16 David Wu , Yunnan Wu

Sample contrastive methods, typically referred to simply as contrastive are the foundation of most unsupervised methods to learn text and sentence embeddings. On the other hand, a different class of self-supervised loss functions and…

计算与语言 · 计算机科学 2023-10-30 Marco Farina , Duccio Pappadopulo

This paper presents Dense Siamese Network (DenseSiam), a simple unsupervised learning framework for dense prediction tasks. It learns visual representations by maximizing the similarity between two views of one image with two types of…

计算机视觉与模式识别 · 计算机科学 2022-08-11 Wenwei Zhang , Jiangmiao Pang , Kai Chen , Chen Change Loy

Deep learning techniques have achieved great success in remote sensing image change detection. Most of them are supervised techniques, which usually require large amounts of training data and are limited to a particular application.…

图像与视频处理 · 电气工程与系统科学 2021-10-11 Yuxing Chen , Lorenzo Bruzzone

Multimodal self-supervised learning is getting more and more attention as it allows not only to train large networks without human supervision but also to search and retrieve data across various modalities. In this context, this paper…