中文
相关论文

相关论文: Rethinking Rotation in Self-Supervised Contrastive…

200 篇论文

Deep learning has achieved remarkable results in many computer vision tasks. Deep neural networks typically rely on large amounts of training data to avoid overfitting. However, labeled data for real-world applications may be limited. By…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Suorong Yang , Weikang Xiao , Mengchen Zhang , Suhan Guo , Jian Zhao , Furao Shen

Despite dropout's ubiquity in machine learning, its effectiveness as a form of data augmentation remains under-explored. We address two key questions: (i) When is dropout effective as an augmentation strategy? (ii) Is dropout uniquely…

机器学习 · 计算机科学 2025-06-02 Rickard Brüel-Gabrielsson , Tongzhou Wang , Manel Baradad , Justin Solomon

Contrastive learning has led to substantial improvements in the quality of learned embedding representations for tasks such as image classification. However, a key drawback of existing contrastive augmentation methods is that they may lead…

计算机视觉与模式识别 · 计算机科学 2022-04-19 Zhibo Zhang , Jongseong Jang , Chiheb Trabelsi , Ruiwen Li , Scott Sanner , Yeonjeong Jeong , Dongsub Shim

Self-supervised learning has recently shown great potential in vision tasks through contrastive learning, which aims to discriminate each image, or instance, in the dataset. However, such instance-level learning ignores the semantic…

计算机视觉与模式识别 · 计算机科学 2022-03-17 Tsai-Shien Chen , Wei-Chih Hung , Hung-Yu Tseng , Shao-Yi Chien , Ming-Hsuan Yang

Recognizing symmetries in data allows for significant boosts in neural network training. In many cases, however, the underlying symmetry is present only in an idealized dataset, and is broken in the training data, due to effects such as…

高能物理 - 实验 · 物理学 2023-11-13 Edmund Witkowski , Daniel Whiteson

Recent works have advanced the performance of self-supervised representation learning by a large margin. The core among these methods is intra-image invariance learning. Two different transformations of one image instance are considered as…

计算机视觉与模式识别 · 计算机科学 2021-05-14 Haiping Wu , Xiaolong Wang

The popularity of data augmentation techniques in machine learning has increased in recent years, as they enable the creation of new samples from existing datasets. Rotational augmentation, in particular, has shown great promise by…

计算机视觉与模式识别 · 计算机科学 2023-06-13 Unai Muñoz-Aseguinolaza , Basilio Sierra , Naiara Aginako

Large multimodal models (LMMs) often struggle to recognize novel concepts, as they rely on pre-trained knowledge and have limited ability to capture subtle visual details. Domain-specific knowledge gaps in training also make them prone to…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Yu Zhou , Bingxuan Li , Mohan Tang , Xiaomeng Jin , Te-Lin Wu , Kuan-Hao Huang , Heng Ji , Kai-Wei Chang , Nanyun Peng

In past research on self-supervised learning for image classification, the use of rotation as an augmentation has been common. However, relying solely on rotation as a self-supervised transformation can limit the ability of the model to…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Erland Hilman Fuadi , Aristo Renaldo Ruslim , Putu Wahyu Kusuma Wardhana , Novanto Yudistira

Contrastive learning has demonstrated great effectiveness in representation learning especially for image classification tasks. However, there is still a shortage in the studies targeting regression tasks, and more specifically applications…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Mohamad Dhaini , Maxime Berar , Paul Honeine , Antonin Van Exem

Convolutional Neural Network (CNN)-based accurate prediction typically requires large-scale annotated training data. In Medical Imaging, however, both obtaining medical data and annotating them by expert physicians are challenging; to…

计算机视觉与模式识别 · 计算机科学 2019-05-30 Changhee Han , Kohei Murao , Shin'ichi Satoh , Hideki Nakayama

Contrastive learning is a model pre-training technique by first creating similar views of the original data, and then encouraging the data and its corresponding views to be close in the embedding space. Contrastive learning has witnessed…

机器学习 · 计算机科学 2024-05-01 Wei Cui , Rasa Hosseinzadeh , Junwei Ma , Tongzi Wu , Yi Sui , Keyvan Golestan

Contextual ranking models have delivered impressive performance improvements over classical models in the document ranking task. However, these highly over-parameterized models tend to be data-hungry and require large amounts of data even…

信息检索 · 计算机科学 2022-07-08 Abhijit Anand , Jurek Leonhardt , Koustav Rudra , Avishek Anand

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To…

图像与视频处理 · 电气工程与系统科学 2021-06-30 Zalan Fabian , Reinhard Heckel , Mahdi Soltanolkotabi

In this paper, we introduce a novel approach to novel object captioning which employs relative contrastive learning to learn visual and semantic alignment. Our approach maximizes compatibility between regions and object tags in a…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Jiashuo Fan , Yaoyuan Liang , Leyao Liu , Shaolun Huang , Lei Zhang

Counterfactually Augmented Data (CAD) involves creating new data samples by applying minimal yet sufficient modifications to flip the label of existing data samples to other classes. Training with CAD enhances model robustness against…

机器学习 · 计算机科学 2024-06-12 Xiaoqi Qiu , Yongjie Wang , Xu Guo , Zhiwei Zeng , Yue Yu , Yuhong Feng , Chunyan Miao

Rotation invariance has been studied in the computer vision community primarily in the context of small in-plane rotations. This is usually achieved by building invariant image features. However, the problem of achieving invariance for…

计算机视觉与模式识别 · 计算机科学 2016-11-18 Lokesh Boominathan , Suraj Srinivas , R. Venkatesh Babu

Deep neural networks are increasingly being used to detect and diagnose medical conditions using medical imaging. Despite their utility, these models are highly vulnerable to adversarial attacks and distribution shifts, which can affect…

图像与视频处理 · 电气工程与系统科学 2025-06-23 Josué Martínez-Martínez , Olivia Brown , Mostafa Karami , Sheida Nabavi

Data augmentation is one of the most effective approaches for improving the accuracy of modern machine learning models, and it is also indispensable to train a deep model for meta-learning. In this paper, we introduce a task augmentation…

计算机视觉与模式识别 · 计算机科学 2020-03-03 Jialin Liu , Fei Chao , Chih-Min Lin

Personalized and content-adaptive image enhancement can find many applications in the age of social media and mobile computing. This paper presents a relative-learning-based approach, which, unlike previous methods, does not require…

计算机视觉与模式识别 · 计算机科学 2017-04-06 Parag S. Chandakkar , Qiongjie Tian , Baoxin Li