中文
相关论文

相关论文: Dual Contrastive Learning for Spatio-temporal Repr…

200 篇论文

Incorporating contrastive learning objectives in sentence representation learning (SRL) has yielded significant improvements on many sentence-level NLP tasks. However, it is not well understood why contrastive learning works for learning…

计算与语言 · 计算机科学 2023-05-30 Chenghao Xiao , Yang Long , Noura Al Moubayed

Recently, as an effective way of learning latent representations, contrastive learning has been increasingly popular and successful in various domains. The success of constrastive learning in single-label classifications motivates us to…

计算机视觉与模式识别 · 计算机科学 2021-07-27 Son D. Dao , Ethan Zhao , Dinh Phung , Jianfei Cai

Contrastive learning -- a modern approach to extract useful representations from unlabeled data by training models to distinguish similar samples from dissimilar ones -- has driven significant progress in foundation models. In this work, we…

机器学习 · 统计学 2025-10-15 Licong Lin , Song Mei

In this paper we propose an unsupervised feature extraction method to capture temporal information on monocular videos, where we detect and encode subject of interest in each frame and leverage contrastive self-supervised (CSS) learning to…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Sina Honari , Victor Constantin , Helge Rhodin , Mathieu Salzmann , Pascal Fua

Graphs serve as versatile data structures in numerous real-world domains-including social networks, molecular biology, and knowledge graphs-by capturing intricate relational information among entities. Among graph-based learning techniques,…

机器学习 · 计算机科学 2025-05-21 Chou-Ying Hsieh , Chun-Fu Jang , Cheng-En Hsieh , Qian-Hui Chen , Sy-Yen Kuo

Recently, contrastive learning has achieved great results in self-supervised learning, where the main idea is to push two augmentations of an image (positive pairs) closer compared to other random images (negative pairs). We argue that not…

计算机视觉与模式识别 · 计算机科学 2021-09-13 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Vipin Pillai , Paolo Favaro , Hamed Pirsiavash

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

Contrastive, self-supervised learning of object representations recently emerged as an attractive alternative to reconstruction-based training. Prior approaches focus on contrasting individual object representations (slots) against one…

计算机视觉与模式识别 · 计算机科学 2020-11-23 Sindy Löwe , Klaus Greff , Rico Jonschkowski , Alexey Dosovitskiy , Thomas Kipf

Camera shake or target movement often leads to undesired blur effects in videos captured by a hand-held camera. Despite significant efforts having been devoted to video-deblur research, two major challenges remain: 1) how to model the…

计算机视觉与模式识别 · 计算机科学 2018-10-17 Kaihao Zhang , Wenhan Luo , Yiran Zhong , Lin Ma , Wei Liu , Hongdong Li

Noise contrastive learning is a popular technique for unsupervised representation learning. In this approach, a representation is obtained via reduction to supervised learning, where given a notion of semantic similarity, the learner tries…

机器学习 · 计算机科学 2021-06-21 Jordan T. Ash , Surbhi Goel , Akshay Krishnamurthy , Dipendra Misra

Image-Text Retrieval (ITR) is challenging in bridging visual and lingual modalities. Contrastive learning has been adopted by most prior arts. Except for limited amount of negative image-text pairs, the capability of constrastive learning…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Haoran Wang , Dongliang He , Wenhao Wu , Boyang Xia , Min Yang , Fu Li , Yunlong Yu , Zhong Ji , Errui Ding , Jingdong Wang

Correspondence estimation is one of the most widely researched and yet only partially solved area of computer vision with many applications in tracking, mapping, recognition of objects and environment. In this paper, we propose a novel way…

计算机视觉与模式识别 · 计算机科学 2020-04-16 Umashankar Deekshith , Nishit Gajjar , Max Schwarz , Sven Behnke

Improving sample efficiency is a key research problem in reinforcement learning (RL), and CURL, which uses contrastive learning to extract high-level features from raw pixels of individual video frames, is an efficient…

机器学习 · 计算机科学 2020-10-16 Jinhua Zhu , Yingce Xia , Lijun Wu , Jiajun Deng , Wengang Zhou , Tao Qin , Houqiang Li

Negative-free contrastive learning methods have attracted a lot of attention with simplicity and impressive performances for large-scale pretraining. However, its disentanglement property remains unexplored. In this paper, we examine…

机器学习 · 计算机科学 2022-10-18 Jinkun Cao , Ruiqian Nai , Qing Yang , Jialei Huang , Yang Gao

To equip artificial intelligence with a comprehensive understanding towards a temporal world, video and 4D panoptic scene graph generation abstracts visual data into nodes to represent entities and edges to capture temporal relations.…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Thong Thanh Nguyen , Xiaobao Wu , Yi Bin , Cong-Duy T Nguyen , See-Kiong Ng , Anh Tuan Luu

Efficiently capturing the complex spatiotemporal representations from large-scale unlabeled traffic data remains to be a challenging task. In considering of the dilemma, this work employs the advanced contrastive learning and proposes a…

机器学习 · 计算机科学 2023-12-19 Lincan Li , Kaixiang Yang , Fengji Luo , Jichao Bi

In recent years, the explosion of web videos makes text-video retrieval increasingly essential and popular for video filtering, recommendation, and search. Text-video retrieval aims to rank relevant text/video higher than irrelevant ones.…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Chen Jiang , Hong Liu , Xuzheng Yu , Qing Wang , Yuan Cheng , Jia Xu , Zhongyi Liu , Qingpei Guo , Wei Chu , Ming Yang , Yuan Qi

Visual-only self-supervised learning has achieved significant improvement in video representation learning. Existing related methods encourage models to learn video representations by utilizing contrastive learning or designing specific…

计算机视觉与模式识别 · 计算机科学 2022-04-12 Jinyu Liu , Ying Cheng , Yuejie Zhang , Rui-Wei Zhao , Rui Feng

Contrastive learning with the nearest neighbor has proved to be one of the most efficient self-supervised learning (SSL) techniques by utilizing the similarity of multiple instances within the same class. However, its efficacy is…

计算机视觉与模式识别 · 计算机科学 2025-04-25 Dewen Zeng , Yawen Wu , Xinrong Hu , Xiaowei Xu , Yiyu Shi

Self-supervised learning has been widely used to obtain transferrable representations from unlabeled images. Especially, recent contrastive learning methods have shown impressive performances on downstream image classification tasks. While…

计算机视觉与模式识别 · 计算机科学 2021-04-29 Byungseok Roh , Wuhyun Shin , Ildoo Kim , Sungwoong Kim