中文
相关论文

相关论文: Cycle-Contrast for Self-Supervised Video Represent…

200 篇论文

Vision-language representation learning largely benefits from image-text alignment through contrastive losses (e.g., InfoNCE loss). The success of this alignment strategy is attributed to its capability in maximizing the mutual information…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Jinyu Yang , Jiali Duan , Son Tran , Yi Xu , Sampath Chanda , Liqun Chen , Belinda Zeng , Trishul Chilimbi , Junzhou Huang

Contrastive learning, a dominant self-supervised technique, emphasizes similarity in representations between augmentations of the same input and dissimilarity for different ones. Although low contrastive loss often correlates with high…

机器学习 · 计算机科学 2023-11-22 Yunzhe Zhang , Yao Lu , Qi Xuan

Contrastive learning (CL) has emerged as a powerful framework for learning representations of images and text in a self-supervised manner while enhancing model robustness against adversarial attacks. More recently, researchers have extended…

机器学习 · 计算机科学 2023-12-04 Filippo Guerranti , Zinuo Yi , Anna Starovoit , Rafiq Kamel , Simon Geisler , Stephan Günnemann

Many Click-Through Rate (CTR) prediction works focused on designing advanced architectures to model complex feature interactions but neglected the importance of feature representation learning, e.g., adopting a plain embedding layer for…

信息检索 · 计算机科学 2022-12-02 Fangye Wang , Yingxu Wang , Dongsheng Li , Hansu Gu , Tun Lu , Peng Zhang , Ning Gu

Self-supervised contrastive learning (CL) has achieved remarkable empirical success, often producing representations that rival supervised pre-training on downstream tasks. Recent theory explains this by showing that the CL loss closely…

机器学习 · 计算机科学 2025-10-13 Achleshwar Luthra , Priyadarsi Mishra , Tomer Galanti

Learning a deep model from small data is yet an opening and challenging problem. We focus on one-shot classification by deep learning approach based on a small quantity of training samples. We proposed a novel deep learning approach named…

机器学习 · 计算机科学 2018-02-13 Chuanyun Xu , Yang Zhang , Xin Feng , YongXing Ge , Yihao Zhang , Jianwu Long

In this paper we show that learning video feature spaces in which temporal cycles are maximally predictable benefits action classification. In particular, we propose a novel learning approach termed Cycle Encoding Prediction (CEP) that is…

计算机视觉与模式识别 · 计算机科学 2021-10-26 Xinyu Yang , Majid Mirmehdi , Tilo Burghardt

Video transformers have recently emerged as a competitive alternative to 3D CNNs for video understanding. However, due to their large number of parameters and reduced inductive biases, these models require supervised pretraining on…

计算机视觉与模式识别 · 计算机科学 2022-04-01 Jue Wang , Gedas Bertasius , Du Tran , Lorenzo Torresani

Collaborative learning enables distributed clients to learn a shared model for prediction while keeping the training data local on each client. However, existing collaborative learning methods require fully-labeled data for training, which…

机器学习 · 计算机科学 2022-04-26 Yawen Wu , Zhepeng Wang , Dewen Zeng , Meng Li , Yiyu Shi , Jingtong Hu

This paper presents a self-supervised feature learning method for hyperspectral image classification. Our method tries to construct two different views of the raw hyperspectral image through a cross-representation learning method. And then…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Anyu Zhang , Haotian Wu , Zeyu Cao

Contrastive, self-supervised learning of object representations recently emerged as an attractive alternative to reconstruction-based training. Prior approaches focus on contrasting individual object representations (slots) against one…

计算机视觉与模式识别 · 计算机科学 2020-11-23 Sindy Löwe , Klaus Greff , Rico Jonschkowski , Alexey Dosovitskiy , Thomas Kipf

Online continual learning (online CL) studies the problem of learning sequential tasks from an online data stream without task boundaries, aiming to adapt to new data while alleviating catastrophic forgetting on the past tasks. This paper…

机器学习 · 计算机科学 2022-07-28 Zhen Wang , Liu Liu , Yajing Kong , Jiaxian Guo , Dacheng Tao

The field of generating recommendations within the framework of causal inference has seen a recent surge, with recommendations being likened to treatments. This approach enhances insights into the influence of recommendations on user…

信息检索 · 计算机科学 2023-08-21 Guanglin Zhou , Chengkai Huang , Xiaocong Chen , Xiwei Xu , Chen Wang , Liming Zhu , Lina Yao

Contrastive Learning (CL), a leading paradigm in Self-Supervised Learning (SSL), typically relies on pairs of data views generated through augmentation. While multiple augmentations per instance (more than two) improve generalization in…

The recent breakthrough achieved by contrastive learning accelerates the pace for deploying unsupervised training on real-world data applications. However, unlabeled data in reality is commonly imbalanced and shows a long-tail distribution,…

计算机视觉与模式识别 · 计算机科学 2021-06-08 Ziyu Jiang , Tianlong Chen , Bobak Mortazavi , Zhangyang Wang

Contrastive learning is one of the fastest growing research areas in machine learning due to its ability to learn useful representations without labeled data. However, contrastive learning is susceptible to feature suppression, i.e., it may…

机器学习 · 计算机科学 2021-11-30 Tianhong Li , Lijie Fan , Yuan Yuan , Hao He , Yonglong Tian , Rogerio Feris , Piotr Indyk , Dina Katabi

Colonoscopic video retrieval, which is a critical part of polyp treatment, has great clinical significance for the prevention and treatment of colorectal cancer. However, retrieval models trained on action recognition datasets usually…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Qingzhong Chen , Shilun Cai , Crystal Cai , Zefang Yu , Dahong Qian , Suncheng Xiang

This paper presents a framework for learning visual representations from unlabeled video demonstrations captured from multiple viewpoints. We show that these representations are applicable for imitating several robotic tasks, including pick…

计算机视觉与模式识别 · 计算机科学 2023-01-30 André Correia , Luís A. Alexandre

Graph contrastive learning (GCL) has recently emerged as an effective learning paradigm to alleviate the reliance on labelling information for graph representation learning. The core of GCL is to maximise the mutual information between the…

机器学习 · 计算机科学 2022-10-18 Yizhen Zheng , Yu Zheng , Xiaofei Zhou , Chen Gong , Vincent CS Lee , Shirui Pan

Implicit degradation modeling-based blind super-resolution (SR) has attracted more increasing attention in the community due to its excellent generalization to complex degradation scenarios and wide application range. How to extract more…

计算机视觉与模式识别 · 计算机科学 2025-04-10 Jiang Yuan , Ji Ma , Bo Wang , Weiming Hu