中文
相关论文

相关论文: Improving memory banks for unsupervised learning w…

200 篇论文

Adversarial examples causing evasive predictions are widely used to evaluate and improve the robustness of machine learning models. However, current studies focus on supervised learning tasks, relying on the ground-truth data label, a…

机器学习 · 计算机科学 2021-12-09 Chia-Yi Hsu , Pin-Yu Chen , Songtao Lu , Sijia Liu , Chia-Mu Yu

In this paper, we study the problem of image recognition with non-differentiable constraints. A lot of real-life recognition applications require a rich output structure with deterministic constraints that are discrete or modeled by a…

计算机视觉与模式识别 · 计算机科学 2019-10-03 Xuan Li , Yuchen Lu , Peng Xu , Jizong Peng , Christian Desrosiers , Xue Liu

Previous deep learning approaches for survival analysis have primarily relied on ranking losses to improve discrimination performance, which often comes at the expense of calibration performance. To address such an issue, we propose a novel…

机器学习 · 计算机科学 2024-11-22 Dongjoon Lee , Hyeryn Park , Changhee Lee

In-Batch contrastive learning is a state-of-the-art self-supervised method that brings semantically-similar instances close while pushing dissimilar instances apart within a mini-batch. Its key to success is the negative sharing strategy,…

机器学习 · 计算机科学 2023-06-07 Zhen Yang , Tinglin Huang , Ming Ding , Yuxiao Dong , Rex Ying , Yukuo Cen , Yangliao Geng , Jie Tang

The memory dictionary-based contrastive learning method has achieved remarkable results in the field of unsupervised person Re-ID. However, The method of updating memory based on all samples does not fully utilize the hardest sample to…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Lingzhi Liu , Haiyang Zhang , Chengwei Tang , Tiantian Zhang

We study class-incremental learning, a training setup in which new classes of data are observed over time for the model to learn from. Despite the straightforward problem formulation, the naive application of classification models to…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Ahmet Iscen , Thomas Bird , Mathilde Caron , Alireza Fathi , Cordelia Schmid

Contrastive learning has gained significant attention as a method for self-supervised learning. The contrastive loss function ensures that embeddings of positive sample pairs (e.g., different samples from the same class or different views…

Negative sampling approaches are prevalent in implicit collaborative filtering for obtaining negative labels from massive unlabeled data. As two major concerns in negative sampling, efficiency and effectiveness are still not fully achieved…

机器学习 · 计算机科学 2020-09-09 Jingtao Ding , Yuhan Quan , Quanming Yao , Yong Li , Depeng Jin

Unsupervised feature learning has made great strides with contrastive learning based on instance discrimination and invariant mapping, as benchmarked on curated class-balanced datasets. However, natural data could be highly correlated and…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Xudong Wang , Ziwei Liu , Stella X. Yu

Feature selection methods have an important role on the readability of data and the reduction of complexity of learning algorithms. In recent years, a variety of efforts are investigated on feature selection problems based on unsupervised…

机器学习 · 计算机科学 2019-12-12 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

Although data-free incremental learning methods are memory-friendly, accurately estimating and counteracting representation shifts is challenging in the absence of historical data. This paper addresses this thorny problem by proposing a…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Zhiheng Ma , Xiaopeng Hong , Beinan Liu , Yabin Wang , Pinyue Guo , Huiyun Li

This paper introduces a fine-grained contrastive learning scheme for unsupervised node clustering. Previous clustering methods only focus on a small feature set (class-dependent features), which demonstrates explicit clustering…

社会与信息网络 · 计算机科学 2024-09-13 Hang Cui , Tarek Abdelzaher

We present a self-supervised learning method to learn audio and video representations. Prior work uses the natural correspondence between audio and video to define a standard cross-modal instance discrimination task, where a model is…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Pedro Morgado , Ishan Misra , Nuno Vasconcelos

In this work we present a novel unsupervised framework for hard training example mining. The only input to the method is a collection of images relevant to the target application and a meaningful initial representation, provided e.g. by…

计算机视觉与模式识别 · 计算机科学 2018-03-30 Ahmet Iscen , Giorgos Tolias , Yannis Avrithis , Ondrej Chum

Many leading self-supervised methods for unsupervised representation learning, in particular those for embedding image features, are built on variants of the instance discrimination task, whose optimization is known to be prone to…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Daniel Shalam , Simon Korman

Existing popular unsupervised embedding learning methods focus on enhancing the instance-level local discrimination of the given unlabeled images by exploring various negative data. However, the existed sample outliers which exhibit large…

计算机视觉与模式识别 · 计算机科学 2021-07-20 Jiahuan Zhou , Yansong Tang , Bing Su , Ying Wu

Variational Inference makes a trade-off between the capacity of the variational family and the tractability of finding an approximate posterior distribution. Instead, Boosting Variational Inference allows practitioners to obtain…

机器学习 · 计算机科学 2021-05-20 Gideon Dresdner , Saurav Shekhar , Fabian Pedregosa , Francesco Locatello , Gunnar Rätsch

Classifying hand-written digits and letters has taken a big leap with the introduction of ConvNets. However, on very constrained hardware the time necessary to train such models would be high. Our main contribution is twofold. First, we…

机器学习 · 计算机科学 2021-07-06 Tidor-Vlad Pricope

In this paper, we learn to classify visual object instances, incrementally and via self-supervision (self-incremental). Our learner observes a single instance at a time, which is then discarded from the dataset. Incremental instance…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Mert Kilickaya , Joaquin Vanschoren

We investigate how agents built on pretrained large language models (LLMs) can learn target classification functions from labeled examples without parameter updates. While conventional approaches like fine-tuning are often costly,…

计算与语言 · 计算机科学 2026-05-06 Jackson Hassell , Dan Zhang , Hannah Kim , Tom Mitchell , Estevam Hruschka