中文
相关论文

相关论文: The Impact of Semantic Pairs on Self-Supervised Re…

200 篇论文

Most self-supervised learning (SSL) methods learn continuous visual representations by aligning different views of the same input, offering limited control over how information is structured across representation dimensions. In this work,…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Kawtar Zaher , Ilyass Moummad , Olivier Buisson , Alexis Joly

Recently, there have been efforts to improve the performance in sign language recognition by designing self-supervised learning methods. However, these methods capture limited information from sign pose data in a frame-wise learning manner,…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Weichao Zhao , Wengang Zhou , Hezhen Hu , Min Wang , Houqiang Li

We are concerned with a challenging scenario in unpaired multiview video learning. In this case, the model aims to learn comprehensive multiview representations while the cross-view semantic information exhibits variations. We propose…

计算机视觉与模式识别 · 计算机科学 2023-08-24 Qitong Wang , Long Zhao , Liangzhe Yuan , Ting Liu , Xi Peng

Self-supervised learning holds promise in leveraging large numbers of unlabeled data. However, its success heavily relies on the highly-curated dataset, e.g., ImageNet, which still needs human cleaning. Directly learning representations…

计算机视觉与模式识别 · 计算机科学 2023-02-24 Meilin Chen , Yizhou Wang , Shixiang Tang , Feng Zhu , Haiyang Yang , Lei Bai , Rui Zhao , Donglian Qi , Wanli Ouyang

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

机器学习 · 计算机科学 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

Contrastive learning has achieved promising performance in the field of multi-view clustering recently. However, the positive and negative sample construction mechanisms ignoring semantic consistency lead to false negative pairs, limiting…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Siwen Liu , Jinyan Liu , Hanning Yuan , Qi Li , Jing Geng , Ziqiang Yuan , Huaxu Han

At the core of self-supervised learning for vision is the idea of learning invariant or equivariant representations with respect to a set of data transformations. This approach, however, introduces strong inductive biases, which can render…

机器学习 · 计算机科学 2024-05-29 Sharut Gupta , Chenyu Wang , Yifei Wang , Tommi Jaakkola , Stefanie Jegelka

Recent works have advanced the performance of self-supervised representation learning by a large margin. The core among these methods is intra-image invariance learning. Two different transformations of one image instance are considered as…

计算机视觉与模式识别 · 计算机科学 2021-05-14 Haiping Wu , Xiaolong Wang

Multimodal representation learning, exemplified by multimodal contrastive learning (MMCL) using image-text pairs, aims to learn powerful representations by aligning cues across modalities. This approach relies on the core assumption that…

机器学习 · 计算机科学 2025-09-29 Yichao Cai , Yuhang Liu , Erdun Gao , Tianjiao Jiang , Zhen Zhang , Anton van den Hengel , Javen Qinfeng Shi

The lack of labeled data is a major obstacle to learning high-quality sentence embeddings. Recently, self-supervised contrastive learning (SCL) is regarded as a promising way to address this problem. However, the existing works mainly rely…

计算与语言 · 计算机科学 2022-03-01 Junhan Yang , Zheng Liu , Shitao Xiao , Jianxun Lian , Lijun Wu , Defu Lian , Guangzhong Sun , Xing Xie

Grounding-based vision and language models have been successfully applied to low-level vision tasks, aiming to precisely locate objects referred in captions. The effectiveness of grounding representation learning heavily relies on the scale…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Jingru Yi , Burak Uzkent , Oana Ignat , Zili Li , Amanmeet Garg , Xiang Yu , Linda Liu

Recently, pretext-task based methods are proposed one after another in self-supervised video feature learning. Meanwhile, contrastive learning methods also yield good performance. Usually, new methods can beat previous ones as claimed that…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Li Tao , Xueting Wang , Toshihiko Yamasaki

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu

Knowledge transfer, zero-shot learning and semantic image retrieval are methods that aim at improving accuracy by utilizing semantic information, e.g. from WordNet. It is assumed that this information can augment or replace missing visual…

计算机视觉与模式识别 · 计算机科学 2019-06-03 Clemens-Alexander Brust , Joachim Denzler

Although supervised learning has been highly successful in improving the state-of-the-art in the domain of image-based computer vision in the past, the margin of improvement has diminished significantly in recent years, indicating that a…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Utku Ozbulak , Hyun Jung Lee , Beril Boga , Esla Timothy Anzaku , Homin Park , Arnout Van Messem , Wesley De Neve , Joris Vankerschaver

Existing self-supervised learning (SSL) methods primarily learn object-invariant representations but often neglect the spatial structure and relationships among object parts. To address this limitation, we introduce Spatial Prediction (SP),…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Yang Shen , Yusen Cai , Weronika Hryniewska-Guzik , Qing Lin , Mengmi Zhang

Contrastive learning has achieved remarkable success in representation learning via self-supervision in unsupervised settings. However, effectively adapting contrastive learning to supervised learning tasks remains as a challenge in…

计算与语言 · 计算机科学 2022-01-24 Qianben Chen , Richong Zhang , Yaowei Zheng , Yongyi Mao

Treating texts as images, combining prompts with textual labels for prompt tuning, and leveraging the alignment properties of CLIP have been successfully applied in zero-shot multi-label image recognition. Nonetheless, relying solely on…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Haonan Xu , Dian Chao , Xiangyu Wu , Zhonghua Wan , Yang Yang

Semi-supervised learning (SSL) has been widely explored in recent years, and it is an effective way of leveraging unlabeled data to reduce the reliance on labeled data. In this work, we adjust neural processes (NPs) to the semi-supervised…

Self-supervised learning (SSL) learns high-quality representations from large pools of unlabeled training data. As datasets grow larger, it becomes crucial to identify the examples that contribute the most to learning such representations.…

机器学习 · 计算机科学 2024-03-14 Siddharth Joshi , Baharan Mirzasoleiman