中文
相关论文

相关论文: Self-supervised Learning with Local Attention-Awar…

200 篇论文

A core component of the recent success of self-supervised learning is cropping data augmentation, which selects sub-regions of an image to be used as positive views in the self-supervised loss. The underlying assumption is that randomly…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Shlok Mishra , Anshul Shah , Ankan Bansal , Abhyuday Jagannatha , Janit Anjaria , Abhishek Sharma , David Jacobs , Dilip Krishnan

This paper proposes a novel method of learning by predicting view assignments with support samples (PAWS). The method trains a model to minimize a consistency loss, which ensures that different views of the same unlabeled instance are…

计算机视觉与模式识别 · 计算机科学 2021-08-03 Mahmoud Assran , Mathilde Caron , Ishan Misra , Piotr Bojanowski , Armand Joulin , Nicolas Ballas , Michael Rabbat

Self-supervised learning aims to extract meaningful features from unlabeled data for further downstream tasks. In this paper, we consider classification as a downstream task in phase 2 and develop rigorous theories to realize the factors…

机器学习 · 计算机科学 2023-05-18 Ngoc N. Tran , Son Duong , Hoang Phan , Tung Pham , Dinh Phung , Trung Le

The goal of fine-grained few-shot learning is to recognize sub-categories under the same super-category by learning few labeled samples. Most of the recent approaches adopt a single similarity measure, that is, global or local measure…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Yan Qi , Han Sun , Ningzhong Liu , Huiyu Zhou

The rapid development of generative AI has made AI-generated images increasingly realistic and high-resolution. Most AI-generated image detection architectures typically downsample images before inputting them into models, risking the loss…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Lawrence Han

Recently, self-supervised vision transformers have attracted unprecedented attention for their impressive representation learning ability. However, the dominant method, contrastive learning, mainly relies on an instance discrimination…

计算机视觉与模式识别 · 计算机科学 2022-01-20 Luya Wang , Feng Liang , Yangguang Li , Honggang Zhang , Wanli Ouyang , Jing Shao

We propose a novel semi-supervised image segmentation method that simultaneously optimizes a supervised segmentation and an unsupervised reconstruction objectives. The reconstruction objective uses an attention mechanism that separates the…

计算机视觉与模式识别 · 计算机科学 2019-07-30 Shuai Chen , Gerda Bortsova , Antonio Garcia-Uceda Juarez , Gijs van Tulder , Marleen de Bruijne

Most existing weakly supervised localization (WSL) approaches learn detectors by finding positive bounding boxes based on features learned with image-level supervision. However, those features do not contain spatial location related…

计算机视觉与模式识别 · 计算机科学 2017-05-02 Zequn Jie , Yunchao Wei , Xiaojie Jin , Jiashi Feng , Wei Liu

We introduce a simple semi-supervised learning approach for images based on in-painting using an adversarial loss. Images with random patches removed are presented to a generator whose task is to fill in the hole, based on the surrounding…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Remi Denton , Sam Gross , Rob Fergus

Self-supervision has demonstrated to be an effective learning strategy when training target tasks on small annotated data-sets. While current research focuses on creating novel pretext tasks to learn meaningful and reusable representations…

计算机视觉与模式识别 · 计算机科学 2021-05-17 Fernando Navarro , Christopher Watanabe , Suprosanna Shit , Anjany Sekuboyina , Jan C. Peeken , Stephanie E. Combs , Bjoern H. Menze

In recent years, remarkable results have been achieved in self-supervised action recognition using skeleton sequences with contrastive learning. It has been observed that the semantic distinction of human action features is often…

计算机视觉与模式识别 · 计算机科学 2023-05-12 Yilei Hua , Wenhan Wu , Ce Zheng , Aidong Lu , Mengyuan Liu , Chen Chen , Shiqian Wu

In this paper, we propose a self-supervised visual representation learning approach which involves both generative and discriminative proxies, where we focus on the former part by requiring the target network to recover the original image…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Yunjie Tian , Lingxi Xie , Xiaopeng Zhang , Jiemin Fang , Haohang Xu , Wei Huang , Jianbin Jiao , Qi Tian , Qixiang Ye

We propose a self-supervised Gaussian ATtention network for image Clustering (GATCluster). Rather than extracting intermediate features first and then performing the traditional clustering algorithm, GATCluster directly outputs semantic…

计算机视觉与模式识别 · 计算机科学 2020-06-09 Chuang Niu , Jun Zhang , Ge Wang , Jimin Liang

We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human…

计算机视觉与模式识别 · 计算机科学 2021-11-04 Mrinal Anand , Aditya Garg

Recent unsupervised representation learning methods have shown to be effective in a range of vision tasks by learning representations invariant to data augmentations such as random cropping and color jittering. However, such invariance…

机器学习 · 计算机科学 2021-11-19 Hankook Lee , Kibok Lee , Kimin Lee , Honglak Lee , Jinwoo Shin

In recent years, Spiking Neural Networks (SNNs) have demonstrated great successes in completing various Machine Learning tasks. We introduce a method for learning image features by \textit{locally connected layers} in SNNs using…

神经与进化计算 · 计算机科学 2019-04-15 Daniel J. Saunders , Devdhar Patel , Hananel Hazan , Hava T. Siegelmann , Robert Kozma

Contrastive learning, which aims to capture general representation from unlabeled images to initialize the medical analysis models, has been proven effective in alleviating the high demand for expensive annotations. Current methods mainly…

计算机视觉与模式识别 · 计算机科学 2022-08-18 Huai Chen , Renzhen Wang , Xiuying Wang , Jieyu Li , Qu Fang , Hui Li , Jianhao Bai , Qing Peng , Deyu Meng , Lisheng Wang

Building accurate and robust artificial intelligence systems for medical image assessment requires not only the research and design of advanced deep learning models but also the creation of large and curated sets of annotated training…

Locally supervised learning aims to train a neural network based on a local estimation of the global loss function at each decoupled module of the network. Auxiliary networks are typically appended to the modules to approximate the gradient…

机器学习 · 计算机科学 2022-08-02 Hasnain Irshad Bhatti , Jaekyun Moon

Self-supervised learning has recently attracted considerable attention in the NLP community for its ability to learn discriminative features using a contrastive objective. This paper investigates whether contrastive learning can be extended…

计算与语言 · 计算机科学 2021-09-14 Tassilo Klein , Moin Nabi