中文
相关论文

相关论文: Adaptive Data Augmentation for Contrastive Learnin…

200 篇论文

Image retrieval is a crucial research topic in computer vision, with broad application prospects ranging from online product searches to security surveillance systems. In recent years, the accuracy and efficiency of image retrieval have…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Kim Jinwoo

Deep Imitation Learning requires a large number of expert demonstrations, which are not always easy to obtain, especially for complex tasks. A way to overcome this shortage of labels is through data augmentation. However, this cannot be…

机器学习 · 计算机科学 2021-03-29 Dafni Antotsiou , Carlo Ciliberto , Tae-Kyun Kim

Self-supervised contrastive learning has emerged as a powerful tool in machine learning and computer vision to learn meaningful representations from unlabeled data. Meanwhile, its empirical success has encouraged many theoretical studies to…

机器学习 · 计算机科学 2025-05-29 Jingyi Cui , Hongwei Wen , Yisen Wang

In neutrino physics, analyses often depend on large simulated datasets, making it essential for models to generalise effectively to real-world detector data. Contrastive learning, a well-established technique in deep learning, offers a…

高能物理 - 实验 · 物理学 2025-05-23 Alex Wilkinson , Radi Radev , Saul Alonso-Monsalve

Inspired by the idea of Positive-incentive Noise (Pi-Noise or $\pi$-Noise) that aims at learning the reliable noise beneficial to tasks, we scientifically investigate the connection between contrastive learning and $\pi$-noise in this…

机器学习 · 计算机科学 2026-05-11 Hongyuan Zhang , Yanchen Xu , Sida Huang , Xuelong Li

Random data augmentation is a critical technique to avoid overfitting in training deep neural network models. However, data augmentation and network training are usually treated as two isolated processes, limiting the effectiveness of…

计算机视觉与模式识别 · 计算机科学 2018-05-25 Xi Peng , Zhiqiang Tang , Fei Yang , Rogerio Feris , Dimitris Metaxas

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

机器学习 · 计算机科学 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat

Contrastive learning has demonstrated great effectiveness in representation learning especially for image classification tasks. However, there is still a shortage in the studies targeting regression tasks, and more specifically applications…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Mohamad Dhaini , Maxime Berar , Paul Honeine , Antonin Van Exem

Contrastive learning is a model pre-training technique by first creating similar views of the original data, and then encouraging the data and its corresponding views to be close in the embedding space. Contrastive learning has witnessed…

机器学习 · 计算机科学 2024-05-01 Wei Cui , Rasa Hosseinzadeh , Junwei Ma , Tongzi Wu , Yi Sui , Keyvan Golestan

Recent work has shown that, when integrated with adversarial training, self-supervised pre-training can lead to state-of-the-art robustness In this work, we improve robustness-aware self-supervised pre-training by learning representations…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Ziyu Jiang , Tianlong Chen , Ting Chen , Zhangyang Wang

Recent advances in domain adaptation reveal that adversarial learning on deep neural networks can learn domain invariant features to reduce the shift between source and target domains. While such adversarial approaches achieve domain-level…

计算机视觉与模式识别 · 计算机科学 2023-01-11 Nishant Yadav , Mahbubul Alam , Ahmed Farahat , Dipanjan Ghosh , Chetan Gupta , Auroop R. Ganguly

Graph contrastive learning (GCL) has emerged as an effective tool for learning unsupervised representations of graphs. The key idea is to maximize the agreement between two augmented views of each graph via data augmentation. Existing GCL…

机器学习 · 计算机科学 2022-09-16 Xin Zhang , Qiaoyu Tan , Xiao Huang , Bo Li

Unsupervised contrastive learning has gained increasing attention in the latest research and has proven to be a powerful method for learning representations from unlabeled data. However, little theoretical analysis was known for this…

机器学习 · 计算机科学 2021-06-01 Zixin Wen

Various contrastive learning approaches have been proposed in recent years and achieve significant empirical success. While effective and prevalent, contrastive learning has been less explored for time series data. A key component of…

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

Contrastive learning has been widely applied to graph representation learning, where the view generators play a vital role in generating effective contrastive samples. Most of the existing contrastive learning methods employ pre-defined…

机器学习 · 计算机科学 2022-01-04 Yihang Yin , Qingzhong Wang , Siyu Huang , Haoyi Xiong , Xiang Zhang

Test-time adaptation is a special setting of unsupervised domain adaptation where a trained model on the source domain has to adapt to the target domain without accessing source data. We propose a novel way to leverage self-supervised…

计算机视觉与模式识别 · 计算机科学 2022-04-25 Dian Chen , Dequan Wang , Trevor Darrell , Sayna Ebrahimi

Domain adaptation is an active area of research driven by the growing demand for robust machine learning models that perform well on real-world data. Adversarial learning for deep neural networks (DNNs) has emerged as a promising approach…

计算机视觉与模式识别 · 计算机科学 2025-01-08 Eugene Choi , Julian Rodriguez , Edmund Young

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

机器学习 · 计算机科学 2022-05-03 Ralph Peeters , Christian Bizer

Self-supervised learning (SSL) has potential for effective representation learning in medical imaging, but the choice of data augmentation is critical and domain-specific. It remains uncertain if general augmentation policies suit surgical…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Yuning Zhou , Henry Badgery , Matthew Read , James Bailey , Catherine E. Davey