中文
相关论文

相关论文: Preservational Learning Improves Self-supervised M…

200 篇论文

Representation learning has significantly been developed with the advance of contrastive learning methods. Most of those methods have benefited from various data augmentations that are carefully designated to maintain their identities so…

计算机视觉与模式识别 · 计算机科学 2022-01-24 Xiao Wang , Guo-Jun Qi

Self-supervised learning (SSL) has become prevalent for learning representations in computer vision. Notably, SSL exploits contrastive learning to encourage visual representations to be invariant under various image transformations. The…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Swati Jindal , Roberto Manduchi

We present Cycle-Contrastive Learning (CCL), a novel self-supervised method for learning video representation. Following a nature that there is a belong and inclusion relation of video and its frames, CCL is designed to find correspondences…

计算机视觉与模式识别 · 计算机科学 2020-10-29 Quan Kong , Wenpeng Wei , Ziwei Deng , Tomoaki Yoshinaga , Tomokazu Murakami

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to…

图像与视频处理 · 电气工程与系统科学 2022-02-15 Xinkai Zhao , Chaowei Fang , De-Jun Fan , Xutao Lin , Feng Gao , Guanbin Li

Contrastive learning allows us to flexibly define powerful losses by contrasting positive pairs from sets of negative samples. Recently, the principle has also been used to learn cross-modal embeddings for video and text, yet without…

计算机视觉与模式识别 · 计算机科学 2021-10-01 Mohammadreza Zolfaghari , Yi Zhu , Peter Gehler , Thomas Brox

Contrastive learning-based recommendation algorithms have significantly advanced the field of self-supervised recommendation, particularly with BPR as a representative ranking prediction task that dominates implicit collaborative filtering.…

信息检索 · 计算机科学 2024-03-13 Shipeng Song , Bin Liu , Fei Teng , Tianrui Li

We present a new self-supervised paradigm on point cloud sequence understanding. Inspired by the discriminative and generative self-supervised methods, we design two tasks, namely point cloud sequence based Contrastive Prediction and…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao

A topic of great current interest is Causal Representation Learning (CRL), whose goal is to learn a causal model for hidden features in a data-driven manner. Unfortunately, CRL is severely ill-posed since it is a combination of the two…

机器学习 · 统计学 2024-06-10 Hiroshi Morioka , Aapo Hyvärinen

Multi-label image classification presents a challenging task in many domains, including computer vision and medical imaging. Recent advancements have introduced graph-based and transformer-based methods to improve performance and capture…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Ahmad Sajedi , Samir Khaki , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Self-supervised representation learning of biological sequence embeddings alleviates computational resource constraints on downstream tasks while circumventing expensive experimental label acquisition. However, existing methods mostly…

生物大分子 · 定量生物学 2020-12-29 Amy X. Lu , Alex X. Lu , Alan Moses

Self-supervised contrastive representation learning has proved incredibly successful in the vision and natural language domains, enabling state-of-the-art performance with orders of magnitude less labeled data. However, such methods are…

机器学习 · 计算机科学 2022-03-17 Dara Bahri , Heinrich Jiang , Yi Tay , Donald Metzler

Learning representations for individual instances when only bag-level labels are available is a fundamental challenge in multiple instance learning (MIL). Recent works have shown promising results using contrastive self-supervised learning…

计算机视觉与模式识别 · 计算机科学 2023-07-13 Kangning Liu , Weicheng Zhu , Yiqiu Shen , Sheng Liu , Narges Razavian , Krzysztof J. Geras , Carlos Fernandez-Granda

Although an object may appear in numerous contexts, we often describe it in a limited number of ways. Language allows us to abstract away visual variation to represent and communicate concepts. Building on this intuition, we propose an…

计算机视觉与模式识别 · 计算机科学 2023-03-30 Mohamed El Banani , Karan Desai , Justin Johnson

Recent breakthroughs in semi-supervised semantic segmentation have been developed through contrastive learning. In prevalent pixel-wise contrastive learning solutions, the model maps pixels to deterministic representations and regularizes…

计算机视觉与模式识别 · 计算机科学 2022-12-19 Haoyu Xie , Changqi Wang , Mingkai Zheng , Minjing Dong , Shan You , Chong Fu , Chang Xu

Self-supervised learning has become a popular approach in recent years for its ability to learn meaningful representations without the need for data annotation. This paper proposes a novel image augmentation technique, overlaying images,…

计算机视觉与模式识别 · 计算机科学 2023-01-25 Yinheng Li , Han Ding , Shaofei Wang

We develop an approach to learning visual representations that embraces multimodal data, driven by a combination of intra- and inter-modal similarity preservation objectives. Unlike existing visual pre-training methods, which solve a proxy…

计算机视觉与模式识别 · 计算机科学 2021-04-28 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , Yilin Wang , Michael Maire , Ajinkya Kale , Baldo Faieta

Previous work on action representation learning focused on global representations for short video clips. In contrast, many practical applications, such as video alignment, strongly demand learning the intensive representation of long…

计算机视觉与模式识别 · 计算机科学 2023-03-03 Minghao Chen , Renbo Tu , Chenxi Huang , Yuqi Lin , Boxi Wu , Deng Cai

Over the last decade, supervised deep learning on manually annotated big data has been progressing significantly on computer vision tasks. But the application of deep learning in medical image analysis was limited by the scarcity of…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Wei-Chien Wang , Euijoon Ahn , Dagan Feng , Jinman Kim

Unsupervised clustering aims at discovering the semantic categories of data according to some distance measured in the representation space. However, different categories often overlap with each other in the representation space at the…

Change captioning aims to succinctly describe the semantic change between a pair of similar images, while being immune to distractors (illumination and viewpoint changes). Under these distractors, unchanged objects often appear pseudo…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Yunbin Tu , Liang Li , Li Su , Chenggang Yan , Qingming Huang