中文
相关论文

相关论文: Inter-intra Variant Dual Representations forSelf-s…

200 篇论文

In this paper, we propose a novel learning scheme for self-supervised video representation learning. Motivated by how humans understand videos, we propose to first learn general visual concepts then attend to discriminative local areas for…

计算机视觉与模式识别 · 计算机科学 2022-07-27 Rui Qian , Shuangrui Ding , Xian Liu , Dahua Lin

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

机器学习 · 计算机科学 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

The remarkable success of deep learning in various domains relies on the availability of large-scale annotated datasets. However, obtaining annotations is expensive and requires great effort, which is especially challenging for videos.…

计算机视觉与模式识别 · 计算机科学 2023-07-20 Madeline C. Schiappa , Yogesh S. Rawat , Mubarak Shah

We propose a supervised contrastive learning framework for video representation learning that leverages temporally global context. We introduce a video to image aggregation strategy that spatially arranges multiple frames from each video…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Shaif Chowdhury , Mushfika Rahman , Greg Hamerly

Learning robust representations to discriminate cell phenotypes based on microscopy images is important for drug discovery. Drug development efforts typically analyse thousands of cell images to screen for potential treatments. Early works…

计算机视觉与模式识别 · 计算机科学 2021-12-28 Alexis Perakis , Ali Gorji , Samriddhi Jain , Krishna Chaitanya , Simone Rizza , Ender Konukoglu

Despite the success of a number of recent techniques for visual self-supervised deep learning, there has been limited investigation into the representations that are ultimately learned. By leveraging recent advances in the comparison of…

计算机视觉与模式识别 · 计算机科学 2021-12-06 Tom George Grigg , Dan Busbridge , Jason Ramapuram , Russ Webb

We focus on contrastive methods for self-supervised video representation learning. A common paradigm in contrastive learning is to construct positive pairs by sampling different data views for the same instance, with different data…

计算机视觉与模式识别 · 计算机科学 2021-08-23 Chen Sun , Arsha Nagrani , Yonglong Tian , Cordelia Schmid

In recent years, discriminative self-supervised methods have made significant strides in advancing various visual tasks. The central idea of learning a data encoder that is robust to data distortions/augmentations is straightforward yet…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Yuewei Yang , Hai Li , Yiran Chen

Implicit neural representations (INR) have gained increasing attention in representing 3D scenes and images, and have been recently applied to encode videos (e.g., NeRV, E-NeRV). While achieving promising results, existing INR-based methods…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Bo He , Xitong Yang , Hanyu Wang , Zuxuan Wu , Hao Chen , Shuaiyi Huang , Yixuan Ren , Ser-Nam Lim , Abhinav Shrivastava

Contrastive learning has achieved great success in self-supervised visual representation learning, but existing approaches mostly ignored spatial information which is often crucial for visual representation. This paper presents…

计算机视觉与模式识别 · 计算机科学 2020-11-20 Xinyue Huo , Lingxi Xie , Longhui Wei , Xiaopeng Zhang , Hao Li , Zijie Yang , Wengang Zhou , Houqiang Li , Qi Tian

Contrastive learning has revolutionized the field of computer vision, learning rich representations from unlabeled data, which generalize well to diverse vision tasks. Consequently, it has become increasingly important to explain these…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Fawaz Sammani , Boris Joukovsky , Nikos Deligiannis

Contrastive learning has revolutionized self-supervised image representation learning field, and recently been adapted to video domain. One of the greatest advantages of contrastive learning is that it allows us to flexibly define powerful…

计算机视觉与模式识别 · 计算机科学 2021-08-06 Haofei Kuang , Yi Zhu , Zhi Zhang , Xinyu Li , Joseph Tighe , Sören Schwertfeger , Cyrill Stachniss , Mu Li

Recent self-supervised representation learning techniques have largely closed the gap between supervised and unsupervised learning on ImageNet classification. While the particulars of pretraining on ImageNet are now relatively well…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Elijah Cole , Xuan Yang , Kimberly Wilber , Oisin Mac Aodha , Serge Belongie

Attempt to fully discover the temporal diversity and chronological characteristics for self-supervised video representation learning, this work takes advantage of the temporal dependencies within videos and further proposes a novel…

计算机视觉与模式识别 · 计算机科学 2021-03-18 Yang Liu , Keze Wang , Haoyuan Lan , Liang Lin

In low-level video analyses, effective representations are important to derive the correspondences between video frames. These representations have been learned in a self-supervised fashion from unlabeled images or videos, using carefully…

计算机视觉与模式识别 · 计算机科学 2023-06-23 Rui Li , Dong Liu

Video transformers have recently emerged as a competitive alternative to 3D CNNs for video understanding. However, due to their large number of parameters and reduced inductive biases, these models require supervised pretraining on…

计算机视觉与模式识别 · 计算机科学 2022-04-01 Jue Wang , Gedas Bertasius , Du Tran , Lorenzo Torresani

Unsupervised learning methods based on contrastive learning have drawn increasing attention and achieved promising results. Most of them aim to learn representations invariant to instance-level variations, which are provided by different…

计算机视觉与模式识别 · 计算机科学 2020-11-04 Feng Wang , Huaping Liu , Di Guo , Fuchun Sun

At the core of self-supervised learning for vision is the idea of learning invariant or equivariant representations with respect to a set of data transformations. This approach, however, introduces strong inductive biases, which can render…

机器学习 · 计算机科学 2024-05-29 Sharut Gupta , Chenyu Wang , Yifei Wang , Tommi Jaakkola , Stefanie Jegelka

Video grounding aims to localize a moment from an untrimmed video for a given textual query. Existing approaches focus more on the alignment of visual and language stimuli with various likelihood-based matching or regression strategies,…

计算机视觉与模式识别 · 计算机科学 2021-07-08 Guoshun Nan , Rui Qiao , Yao Xiao , Jun Liu , Sicong Leng , Hao Zhang , Wei Lu

We propose Graph Contrastive Learning (GraphCL), a general framework for learning node representations in a self supervised manner. GraphCL learns node embeddings by maximizing the similarity between the representations of two randomly…

机器学习 · 计算机科学 2020-07-17 Hakim Hafidi , Mounir Ghogho , Philippe Ciblat , Ananthram Swami