中文
相关论文

相关论文: Time Series Contrastive Learning with Information-…

200 篇论文

Test-time adaptation aims to adapt pre-trained deep neural networks using solely online unlabelled test data during inference. Although TTA has shown promise in visual applications, its potential in time series contexts remains largely…

机器学习 · 计算机科学 2025-01-06 Peiliang Gong , Mohamed Ragab , Min Wu , Zhenghua Chen , Yongyi Su , Xiaoli Li , Daoqiang Zhang

Data augmentation methods have been shown to be a fundamental technique to improve generalization in tasks such as image, text and audio classification. Recently, automated augmentation methods have led to further improvements on image…

机器学习 · 计算机科学 2021-02-17 Elizabeth Fons , Paula Dawson , Xiao-jun Zeng , John Keane , Alexandros Iosifidis

The goal of contrasting learning is to learn a representation that preserves underlying clusters by keeping samples with similar content, e.g. the ``dogness'' of a dog, close to each other in the space generated by the representation. A…

机器学习 · 计算机科学 2023-02-17 Advait Parulekar , Liam Collins , Karthikeyan Shanmugam , Aryan Mokhtari , Sanjay Shakkottai

Inference, especially those derived from inductive processes, is a crucial component in our conversation to complement the information implicitly or explicitly conveyed by a speaker. While recent large language models show remarkable…

计算与语言 · 计算机科学 2023-11-14 Etsuko Ishii , Yan Xu , Bryan Wilie , Ziwei Ji , Holy Lovenia , Willy Chung , Pascale Fung

The research on intent-enhanced sequential recommendation algorithms focuses on how to better mine dynamic user intent based on user behavior data for sequential recommendation tasks. Various data augmentation methods are widely applied in…

信息检索 · 计算机科学 2024-10-14 Shuai Chen , Zhoujun Li

The standard approach to contrastive learning is to maximize the agreement between different views of the data. The views are ordered in pairs, such that they are either positive, encoding different views of the same object, or negative,…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Artem Moskalev , Ivan Sosnovik , Volker Fischer , Arnold Smeulders

Data augmentation is a technique to improve the generalization ability of machine learning methods by increasing the size of the dataset. However, since every augmentation method is not equally effective for every dataset, you need to…

机器学习 · 计算机科学 2022-05-31 Daisuke Oba , Shinnosuke Matsuo , Brian Kenji Iwana

Recently, contrastive learning (CL) has emerged as a successful method for unsupervised graph representation learning. Most graph CL methods first perform stochastic augmentation on the input graph to obtain two graph views and maximize the…

机器学习 · 计算机科学 2021-03-01 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Micro-video recommender systems suffer from the ubiquitous noises in users' behaviors, which might render the learned user representation indiscriminating, and lead to trivial recommendations (e.g., popular items) or even weird ones that…

信息检索 · 计算机科学 2022-08-18 Shengyu Zhang , Bofang Li , Dong Yao , Fuli Feng , Jieming Zhu , Wenyan Fan , Zhou Zhao , Xiaofei He , Tat-seng Chua , Fei Wu

Recently, pretext-task based methods are proposed one after another in self-supervised video feature learning. Meanwhile, contrastive learning methods also yield good performance. Usually, new methods can beat previous ones as claimed that…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Li Tao , Xueting Wang , Toshihiko Yamasaki

Contrastive learning has become a key component of self-supervised learning approaches for computer vision. By learning to embed two augmented versions of the same image close to each other and to push the embeddings of different images…

计算机视觉与模式识别 · 计算机科学 2020-12-07 Yannis Kalantidis , Mert Bulent Sariyildiz , Noe Pion , Philippe Weinzaepfel , Diane Larlus

Contrastive learning is among the most successful methods for visual representation learning, and its performance can be further improved by jointly performing clustering on the learned representations. However, existing methods for joint…

计算机视觉与模式识别 · 计算机科学 2022-09-16 Shunjie-Fabian Zheng , JaeEun Nam , Emilio Dorigatti , Bernd Bischl , Shekoofeh Azizi , Mina Rezaei

Recent methods for reinforcement learning from images use auxiliary tasks to learn image features that are used by the agent's policy or Q-function. In particular, methods based on contrastive learning that induce linearity of the latent…

机器学习 · 计算机科学 2022-03-04 Bang You , Oleg Arenz , Youping Chen , Jan Peters

In recent years, self-supervised representation learning for skeleton-based action recognition has been developed with the advance of contrastive learning methods. The existing contrastive learning methods use normal augmentations to…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Tianyu Guo , Hong Liu , Zhan Chen , Mengyuan Liu , Tao Wang , Runwei Ding

In recent years, self-supervised contrastive learning has emerged as a distinguished paradigm in the artificial intelligence landscape. It facilitates unsupervised feature learning through contrastive delineations at the instance level.…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Jiansong Zhang , Linlin Shen , Peizhong Liu

Citation classification, which identifies the intention behind academic citations, is pivotal for scholarly analysis. Previous works suggest fine-tuning pretrained language models (PLMs) on citation classification datasets, reaping the…

计算与语言 · 计算机科学 2025-05-29 Tong Li , Jiachuan Wang , Yongqi Zhang , Shuangyin Li , Lei Chen

Learning representations that transfer well to diverse downstream tasks remains a central challenge in representation learning. Existing paradigms -- contrastive learning, self-supervised masking, and denoising auto-encoders -- balance this…

机器学习 · 计算机科学 2025-09-29 Micha Livne

Contrastive learning has been shown to produce generalizable representations of audio and visual data by maximizing the lower bound on the mutual information (MI) between different views of an instance. However, obtaining a tight lower…

机器学习 · 计算机科学 2021-04-20 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Contrastive learning has made considerable progress in computer vision, outperforming supervised pretraining on a range of downstream datasets. However, is contrastive learning the better choice in all situations? We demonstrate two cases…

计算机视觉与模式识别 · 计算机科学 2021-12-13 Ananya Karthik , Mike Wu , Noah Goodman , Alex Tamkin

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

图像与视频处理 · 电气工程与系统科学 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski