中文
相关论文

相关论文: Supervised Contrastive Frame Aggregation for Video…

200 篇论文

In this paper, we propose a new framework for compressive video sensing (CVS) that exploits the inherent spatial and temporal redundancies of a video sequence, effectively. The proposed method splits the video sequence into the key and…

多媒体 · 计算机科学 2015-09-01 Nasser Eslahi , Ali Aghagolzadeh , Seyed Mehdi Hosseini Andargoli

Recent progress in contrastive learning has revolutionized unsupervised representation learning. Concretely, multiple views (augmentations) from the same image are encouraged to map to the similar embeddings, while views from different…

计算机视觉与模式识别 · 计算机科学 2021-01-20 Nanxuan Zhao , Zhirong Wu , Rynson W. H. Lau , Stephen Lin

Supervised (pre-)training currently yields state-of-the-art performance for representation learning for visual recognition, yet it comes at the cost of (1) intensive manual annotations and (2) an inherent restriction in the scope of data…

计算机视觉与模式识别 · 计算机科学 2016-12-05 Ruohan Gao , Dinesh Jayaraman , Kristen Grauman

Self-supervised learning has achieved remarkable success in acquiring high-quality representations from unlabeled data. The widely adopted contrastive learning framework aims to learn invariant representations by minimizing the distance…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Xiaojie Li , Yibo Yang , Xiangtai Li , Jianlong Wu , Yue Yu , Bernard Ghanem , Min Zhang

Self-supervision allows learning meaningful representations of natural images, which usually contain one central object. How well does it transfer to multi-entity scenes? We discuss key aspects of learning structured object-centric…

计算机视觉与模式识别 · 计算机科学 2022-04-15 Federico Baldassarre , Hossein Azizpour

Contrastive Learning has recently received interest due to its success in self-supervised representation learning in the computer vision domain. However, the origins of Contrastive Learning date as far back as the 1990s and its development…

机器学习 · 计算机科学 2020-10-29 Phuc H. Le-Khac , Graham Healy , Alan F. Smeaton

Learning visual representations with self-supervised learning has become popular in computer vision. The idea is to design auxiliary tasks where labels are free to obtain. Most of these tasks end up providing data to learn specific kinds of…

计算机视觉与模式识别 · 计算机科学 2017-08-16 Xiaolong Wang , Kaiming He , Abhinav Gupta

Self-supervised learning, especially contrastive learning, has made an outstanding contribution to the development of many deep learning research fields. Recently, researchers in the acoustic signal processing field noticed its success and…

声音 · 计算机科学 2022-04-05 Dong Yao , Zhou Zhao , Shengyu Zhang , Jieming Zhu , Yudong Zhu , Rui Zhang , Xiuqiang He

Unsupervised image retrieval aims to learn the important visual characteristics without any given level to retrieve the similar images for a given query image. The Convolutional Neural Network (CNN)-based approaches have been extensively…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Ayush Dubey , Shiv Ram Dubey , Satish Kumar Singh , Wei-Ta Chu

We consider graph representation learning in a self-supervised manner. Graph neural networks (GNNs) use neighborhood aggregation as a core component that results in feature smoothing among nodes in proximity. While successful in various…

机器学习 · 计算机科学 2021-07-20 Wei Zhuo , Guang Tan

Unsupervised learning has made substantial progress over the last few years, especially by means of contrastive self-supervised learning. The dominating dataset for benchmarking self-supervised learning has been ImageNet, for which recent…

图像与视频处理 · 电气工程与系统科学 2022-08-17 Karin Stacke , Jonas Unger , Claes Lundström , Gabriel Eilertsen

In this work, we leverage estimated depth to boost self-supervised contrastive learning for segmentation of urban scenes, where unlabeled videos are readily available for training self-supervised depth estimation. We argue that the…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Liang Zeng , Attila Lengyel , Nergis Tömen , Jan van Gemert

We propose a self-supervised approach for learning representations and robotic behaviors entirely from unlabeled videos recorded from multiple viewpoints, and study how this representation can be used in two robotic imitation settings:…

计算机视觉与模式识别 · 计算机科学 2018-03-21 Pierre Sermanet , Corey Lynch , Yevgen Chebotar , Jasmine Hsu , Eric Jang , Stefan Schaal , Sergey Levine

Contrastive learning is a powerful technique to learn representations that are semantically distinctive and geometrically invariant. While most of the earlier approaches have demonstrated its effectiveness on single-modality learning tasks…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Anurag Jain , Yashaswi Verma

This paper introduces a novel approach named CrossVideo, which aims to enhance self-supervised cross-modal contrastive learning in the field of point cloud video understanding. Traditional supervised learning methods encounter limitations…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Yunze Liu , Changxi Chen , Zifan Wang , Li Yi

With the advent of large-scale multimodal video datasets, especially sequences with audio or transcribed speech, there has been a growing interest in self-supervised learning of video representations. Most prior work formulates the…

计算机视觉与模式识别 · 计算机科学 2020-09-21 Bruno Korbar , Fabio Petroni , Rohit Girdhar , Lorenzo Torresani

High-quality representation of transactional sequences is vital for modern banking applications, including risk management, churn prediction, and personalized customer offers. Different tasks require distinct representation properties:…

机器学习 · 计算机科学 2024-12-24 Aleksandr Yugay , Alexey Zaytsev

We propose a novel contrastive learning framework to effectively address the challenges of data heterogeneity in federated learning. We first analyze the inconsistency of gradient updates across clients during local training and establish…

机器学习 · 计算机科学 2024-06-03 Seonguk Seo , Jinkyu Kim , Geeho Kim , Bohyung Han

The recent success in deep learning has lead to various effective representation learning methods for videos. However, the current approaches for video representation require large amount of human labeled datasets for effective learning. We…

计算机视觉与模式识别 · 计算机科学 2018-11-30 Shruti Vyas , Yogesh S Rawat , Mubarak Shah

In the past few years, we have witnessed remarkable breakthroughs in self-supervised representation learning. Despite the success and adoption of representations learned through this paradigm, much is yet to be understood about how…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Klemen Kotar , Gabriel Ilharco , Ludwig Schmidt , Kiana Ehsani , Roozbeh Mottaghi