中文
相关论文

相关论文: Identifiable Contrastive Learning with Automatic F…

200 篇论文

Learning a deep model from small data is yet an opening and challenging problem. We focus on one-shot classification by deep learning approach based on a small quantity of training samples. We proposed a novel deep learning approach named…

机器学习 · 计算机科学 2018-02-13 Chuanyun Xu , Yang Zhang , Xin Feng , YongXing Ge , Yihao Zhang , Jianwu Long

Selective classification enables models to make predictions only when they are sufficiently confident, aiming to enhance safety and reliability, which is important in high-stakes scenarios. Previous methods mainly use deep neural networks…

机器学习 · 计算机科学 2024-06-10 Yu-Chang Wu , Shen-Huan Lyu , Haopu Shang , Xiangyu Wang , Chao Qian

Sequential recommendation (SR) aims to predict the subsequent behaviors of users by understanding their successive historical behaviors. Recently, some methods for SR are devoted to alleviating the data sparsity problem (i.e., limited…

信息检索 · 计算机科学 2022-08-30 Ziyang Wang , Huoyu Liu , Wei Wei , Yue Hu , Xian-Ling Mao , Shaojian He , Rui Fang , Dangyang chen

This paper is concerned with contrastive learning (CL) for low-level image restoration and enhancement tasks. We propose a new label-efficient learning paradigm based on residuals, residual contrastive learning (RCL), and derive an…

计算机视觉与模式识别 · 计算机科学 2022-04-28 Nanqing Dong , Matteo Maggioni , Yongxin Yang , Eduardo Pérez-Pellitero , Ales Leonardis , Steven McDonagh

This paper proposes a scalable and straightforward pre-training paradigm for efficient visual conceptual representation called occluded image contrastive learning (OCL). Our OCL approach is simple: we randomly mask patches to generate…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Xiaoyu Yang , Lijian Xu , Hongsheng Li , Shaoting Zhang

Enhancing feature transferability by matching marginal distributions has led to improvements in domain adaptation, although this is at the expense of feature discrimination. In particular, the ideal joint hypothesis error in the target…

计算机视觉与模式识别 · 计算机科学 2020-06-20 Changhwa Park , Jonghyun Lee , Jaeyoon Yoo , Minhoe Hur , Sungroh Yoon

Collaborative learning enables distributed clients to learn a shared model for prediction while keeping the training data local on each client. However, existing collaborative learning methods require fully-labeled data for training, which…

机器学习 · 计算机科学 2022-04-26 Yawen Wu , Zhepeng Wang , Dewen Zeng , Meng Li , Yiyu Shi , Jingtong Hu

Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario.…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Yun-Hao Cao , Jianxin Wu

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

机器学习 · 计算机科学 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin

Recently, graph collaborative filtering methods have been proposed as an effective recommendation approach, which can capture users' preference over items by modeling the user-item interaction graphs. In order to reduce the influence of…

信息检索 · 计算机科学 2022-02-16 Zihan Lin , Changxin Tian , Yupeng Hou , Wayne Xin Zhao

Multifold observations are common for different data modalities, e.g., a 3D shape can be represented by multi-view images and an image can be described with different captions. Existing cross-modal contrastive representation learning…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Ye Wang , Bowei Jiang , Changqing Zou , Rui Ma

While contrastive learning is proven to be an effective training strategy in computer vision, Natural Language Processing (NLP) is only recently adopting it as a self-supervised alternative to Masked Language Modeling (MLM) for improving…

计算与语言 · 计算机科学 2021-09-16 Hooman Sedghamiz , Shivam Raval , Enrico Santus , Tuka Alhanai , Mohammad Ghassemi

The top-k recommendation is a fundamental task in recommendation systems which is generally learned by comparing positive and negative pairs. The Contrastive Loss (CL) is the key in contrastive learning that has received more attention…

信息检索 · 计算机科学 2021-09-02 Hao Tang , Guoshuai Zhao , Yuxia Wu , Xueming Qian

In this paper, we present CLCC, a novel contrastive learning framework for color constancy. Contrastive learning has been applied for learning high-quality visual representations for image classification. One key aspect to yield useful…

计算机视觉与模式识别 · 计算机科学 2021-06-10 Yi-Chen Lo , Chia-Che Chang , Hsuan-Chao Chiu , Yu-Hao Huang , Chia-Ping Chen , Yu-Lin Chang , Kevin Jou

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

机器学习 · 计算机科学 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

Graph contrastive learning (GCL), learning the node representation by contrasting two augmented graphs in a self-supervised way, has attracted considerable attention. GCL is usually believed to learn the invariant representation. However,…

机器学习 · 计算机科学 2024-03-08 Yanhu Mo , Xiao Wang , Shaohua Fan , Chuan Shi

The generalization of representations learned via contrastive learning depends crucially on what features of the data are extracted. However, we observe that the contrastive loss does not always sufficiently guide which features are…

机器学习 · 计算机科学 2021-12-21 Joshua Robinson , Li Sun , Ke Yu , Kayhan Batmanghelich , Stefanie Jegelka , Suvrit Sra

Correlation exploitation is essential for efficient multi-user channel estimation (MUCE) in massive MIMO systems. However, the existing works either rely on presumed strong correlation or learn the correlation through large amount of…

信号处理 · 电气工程与系统科学 2023-03-07 Yihan Xu , Lixiang Lian

While effective in recommendation tasks, collaborative filtering (CF) techniques face the challenge of data sparsity. Researchers have begun leveraging contrastive learning to introduce additional self-supervised signals to address this.…

信息检索 · 计算机科学 2024-02-20 Peijie Sun , Le Wu , Kun Zhang , Xiangzhi Chen , Meng Wang

Recently, vehicle re-identification methods based on deep learning constitute remarkable achievement. However, this achievement requires large-scale and well-annotated datasets. In constructing the dataset, assigning globally available…

计算机视觉与模式识别 · 计算机科学 2021-09-15 Jongmin Yu , Junsik Kim , Minkyung Kim , Hyeontaek Oh