English
Related papers

Related papers: Combining Contrastive and Supervised Learning for …

200 papers

Abnormal event detection or anomaly detection in surveillance videos is currently a challenge because of the diversity of possible events. Due to the lack of anomalous events at training time, anomaly detection requires the design of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Darshan Venkatrayappa

Surveillance scenarios are prone to several problems since they usually involve low-resolution footage, and there is no control of how far the subjects may be from the camera in the first place. This situation is suitable for the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Angelo G. Menezes

Recent works have advanced the performance of self-supervised representation learning by a large margin. The core among these methods is intra-image invariance learning. Two different transformations of one image instance are considered as…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Haiping Wu , Xiaolong Wang

The success of deep learning is usually accompanied by the growth in neural network depth. However, the traditional training method only supervises the neural network at its last layer and propagates the supervision layer-by-layer, which…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Linfeng Zhang , Xin Chen , Junbo Zhang , Runpei Dong , Kaisheng Ma

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

We apply reinforcement learning to video compressive sensing to adapt the compression ratio. Specifically, video snapshot compressive imaging (SCI), which captures high-speed video using a low-speed camera is considered in this work, in…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Sidi Lu , Xin Yuan , Aggelos K Katsaggelos , Weisong Shi

Tremendous progress has been made in visual representation learning, notably with the recent success of self-supervised contrastive learning methods. Supervised contrastive learning has also been shown to outperform its cross-entropy…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Ashraful Islam , Chun-Fu Chen , Rameswar Panda , Leonid Karlinsky , Richard Radke , Rogerio Feris

Improving generalization is a major challenge in audio classification due to labeled data scarcity. Self-supervised learning (SSL) methods tackle this by leveraging unlabeled data to learn useful features for downstream classification…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-22 Melikasadat Emami , Dung Tran , Kazuhito Koishida

In this paper, we propose a novel training procedure for the continual representation learning problem in which a neural network model is sequentially learned to alleviate catastrophic forgetting in visual search tasks. Our method, called…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Tommaso Barletti , Niccolo' Biondi , Federico Pernici , Matteo Bruni , Alberto Del Bimbo

Contrastive learning has become a key component of self-supervised learning approaches for computer vision. By learning to embed two augmented versions of the same image close to each other and to push the embeddings of different images…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Yannis Kalantidis , Mert Bulent Sariyildiz , Noe Pion , Philippe Weinzaepfel , Diane Larlus

We propose a supervised contrastive learning framework for video representation learning that leverages temporally global context. We introduce a video to image aggregation strategy that spatially arranges multiple frames from each video…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shaif Chowdhury , Mushfika Rahman , Greg Hamerly

Recent single image unsupervised representation learning techniques show remarkable success on a variety of tasks. The basic principle in these works is instance discrimination: learning to differentiate between two augmented versions of…

Computer Vision and Pattern Recognition · Computer Science 2020-05-08 Daniel Gordon , Kiana Ehsani , Dieter Fox , Ali Farhadi

Contrastive self-supervised learning has attracted significant research attention recently. It learns effective visual representations from unlabeled data by embedding augmented views of the same image close to each other while pushing away…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yichen Zhang , Yifang Yin , Ying Zhang , Roger Zimmermann

Deep video inpainting is typically used as malicious manipulation to remove important objects for creating fake videos. It is significant to identify the inpainted regions blindly. This letter proposes a simple yet effective forensic scheme…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Zijie Lou , Gang Cao , Man Lin

How can neural networks trained by contrastive learning extract features from the unlabeled data? Why does contrastive learning usually need much stronger data augmentations than supervised learning to ensure good representations? These…

Machine Learning · Computer Science 2021-07-06 Zixin Wen , Yuanzhi Li

Traditional supervised learning methods are hitting a bottleneck because of their dependency on expensive manually labeled data and their weaknesses such as limited generalization ability and vulnerability to adversarial attacks. A…

Machine Learning · Computer Science 2021-06-08 Ran Liu

With the recent boom of video-based social platforms (e.g., YouTube and TikTok), video retrieval using sentence queries has become an important demand and attracts increasing research attention. Despite the decent performance, existing…

Information Retrieval · Computer Science 2022-02-11 Jinpeng Wang , Bin Chen , Dongliang Liao , Ziyun Zeng , Gongfu Li , Shu-Tao Xia , Jin Xu

Online tracking of multiple objects in videos requires strong capacity of modeling and matching object appearances. Previous methods for learning appearance embedding mostly rely on instance-level matching without considering the temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Wei Li , Yuanjun Xiong , Shuo Yang , Mingze Xu , Yongxin Wang , Wei Xia

Image retrieval is a crucial research topic in computer vision, with broad application prospects ranging from online product searches to security surveillance systems. In recent years, the accuracy and efficiency of image retrieval have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Kim Jinwoo

Bicubic downscaling is a prevalent technique used to reduce the video storage burden or to accelerate the downstream processing speed. However, the inverse upscaling step is non-trivial, and the downscaled video may also deteriorate the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Yuan Tian , Guo Lu , Xiongkuo Min , Zhaohui Che , Guangtao Zhai , Guodong Guo , Zhiyong Gao