中文
相关论文

相关论文: Contrastive Learning under Noisy Temporal Self-Sup…

200 篇论文

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

计算机视觉与模式识别 · 计算机科学 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

Contrastive learning allows us to flexibly define powerful losses by contrasting positive pairs from sets of negative samples. Recently, the principle has also been used to learn cross-modal embeddings for video and text, yet without…

计算机视觉与模式识别 · 计算机科学 2021-10-01 Mohammadreza Zolfaghari , Yi Zhu , Peter Gehler , Thomas Brox

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

机器学习 · 计算机科学 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin

Contrastive learning has emerged as a transformative method for learning effective visual representations through the alignment of image and text embeddings. However, pairwise similarity computation in contrastive loss between image and…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Sachin Mehta , Maxwell Horton , Fartash Faghri , Mohammad Hossein Sekhavat , Mahyar Najibi , Mehrdad Farajtabar , Oncel Tuzel , Mohammad Rastegari

Contrastive Self-supervised Learning (CSL) is a practical solution that learns meaningful visual representations from massive data in an unsupervised approach. The ordinary CSL embeds the features extracted from neural networks onto…

计算机视觉与模式识别 · 计算机科学 2022-08-19 Shentong Mo , Zhun Sun , Chao Li

Unsupervised object-centric learning from videos is a promising approach to extract structured representations from large, unlabeled collections of videos. To support downstream tasks like autonomous control, these representations must be…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Anna Manasyan , Maximilian Seitzer , Filip Radovic , Georg Martius , Andrii Zadaianchuk

Early detection, accurate segmentation, classification and tracking of polyps during colonoscopy are critical for preventing colorectal cancer. Many existing deep-learning-based methods for analyzing colonoscopic videos either require…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Anwesa Choudhuri , Zhongpai Gao , Meng Zheng , Benjamin Planche , Terrence Chen , Ziyan Wu

In this paper we propose an unsupervised feature extraction method to capture temporal information on monocular videos, where we detect and encode subject of interest in each frame and leverage contrastive self-supervised (CSS) learning to…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Sina Honari , Victor Constantin , Helge Rhodin , Mathieu Salzmann , Pascal Fua

A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to…

计算机视觉与模式识别 · 计算机科学 2020-11-02 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

An efficient deep learning model that can be implemented in real-time for polyp detection is crucial to reducing polyp miss-rate during screening procedures. Convolutional neural networks (CNNs) are vulnerable to small changes in the input…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Hemin Ali Qadir , Younghak Shin , Jacob Bergsland , Ilangko Balasingham

Self-supervised contrastive learning offers a means of learning informative features from a pool of unlabeled data. In this paper, we delve into another useful approach -- providing a way of selecting a core-set that is entirely unlabeled.…

机器学习 · 计算机科学 2021-04-08 Jeongwoo Ju , Heechul Jung , Yoonju Oh , Junmo Kim

Colonic polyps are well-recognized precursors to colorectal cancer (CRC), typically detected during colonoscopy. However, the variability in appearance, location, and size of these polyps complicates their detection and removal, leading to…

Automatic detection of polyps is challenging because different polyps vary greatly, while the changes between polyps and their analogues are small. The state-of-the-art methods are based on convolutional neural networks (CNNs). However,…

计算机视觉与模式识别 · 计算机科学 2022-01-26 Jianwei Xu , Ran Zhao , Yizhou Yu , Qingwei Zhang , Xianzhang Bian , Jun Wang , Zhizheng Ge , Dahong Qian

Rich temporal information and variations in viewpoints make video data an attractive choice for learning image representations using unsupervised contrastive learning (UCL) techniques. State-of-the-art (SOTA) contrastive learning techniques…

图像与视频处理 · 电气工程与系统科学 2022-07-28 Soumen Basu , Somanshu Singla , Mayank Gupta , Pratyaksha Rana , Pankaj Gupta , Chetan Arora

We introduce COLA, a self-supervised pre-training approach for learning a general-purpose representation of audio. Our approach is based on contrastive learning: it learns a representation which assigns high similarity to audio segments…

声音 · 计算机科学 2020-10-22 Aaqib Saeed , David Grangier , Neil Zeghidour

We introduce a novel self-supervised contrastive learning method to learn representations from unlabelled videos. Existing approaches ignore the specifics of input distortions, e.g., by learning invariance to temporal transformations.…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Simon Jenni , Hailin Jin

In this paper, we propose and analyse a system that can automatically detect, localise and classify polyps from colonoscopy videos. The detection of frames with polyps is formulated as a few-shot anomaly classification problem, where the…

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Learning discriminative representations of unlabelled data is a challenging task. Contrastive self-supervised learning provides a framework to learn meaningful representations using learned notions of similarity measures from simple pretext…

计算机视觉与模式识别 · 计算机科学 2023-01-04 Nicklas Boserup , Raghavendra Selvan

Attempt to fully discover the temporal diversity and chronological characteristics for self-supervised video representation learning, this work takes advantage of the temporal dependencies within videos and further proposes a novel…

计算机视觉与模式识别 · 计算机科学 2021-03-18 Yang Liu , Keze Wang , Haoyuan Lan , Liang Lin