English
Related papers

Related papers: Transfer Learning with Self-Supervised Vision Tran…

200 papers

In this paper, we introduce a novel self-supervised learning (SSL) loss for image representation learning. There is a growing belief that generalization in deep neural networks is linked to their ability to discriminate object shapes. Since…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Sepehr Sameni , Simon Jenni , Paolo Favaro

With the rapid development of technology in the field of AI, deepfake technology has emerged as a double-edged sword. It has not only created a large amount of AI-generated content but also posed unprecedented challenges to digital…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Xiaoya Zhu , Yibing Nan , Shiguo Lian

Deep neural networks face several challenges in hyperspectral image classification, including complex and sparse ground object distributions, small clustered structures, and elongated multi-branch features that often lead to missing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Guandong Li , Mengxia Ye

Material classification in natural settings is a challenge due to complex interplay of geometry, reflectance properties, and illumination. Previous work on material classification relies strongly on hand-engineered features of visual…

Computer Vision and Pattern Recognition · Computer Science 2016-09-21 Patrick Wieschollek , Hendrik P. A. Lensch

We present working notes for the DS@GT team on transfer learning with pseudo multi-label birdcall classification for the BirdCLEF 2024 competition, focused on identifying Indian bird species in recorded soundscapes. Our approach utilizes…

Sound · Computer Science 2024-07-10 Anthony Miyaguchi , Adrian Cheung , Murilo Gustineli , Ashley Kim

In this paper, we present a comparative analysis of various self-supervised Vision Transformers (ViTs), focusing on their local representative power. Inspired by large language models, we examine the abilities of ViTs to perform various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Ani Vanyan , Alvard Barseghyan , Hakob Tamazyan , Vahan Huroyan , Hrant Khachatrian , Martin Danelljan

We are witnessing a modeling shift from CNN to Transformers in computer vision. In this work, we present a self-supervised learning approach called MoBY, with Vision Transformers as its backbone architecture. The approach basically has no…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Zhenda Xie , Yutong Lin , Zhuliang Yao , Zheng Zhang , Qi Dai , Yue Cao , Han Hu

This study revisits the findings of Carl et al., who evaluated the pre-trained Google Inception-ResNet-v2 model for automated detection of European wild mammal species in camera trap images. To assess the reproducibility and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Tobias Abraham Haider

We explore methods to solve the multi-label classification task posed by the GeoLifeCLEF 2024 competition with the DS@GT team, which aims to predict the presence and absence of plant species at specific locations using spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Anthony Miyaguchi , Patcharapong Aphiwetsa , Mark McDuffie

The goal of our research is to develop methods advancing automatic visual recognition. In order to predict the unique or multiple labels associated to an image, we study different kind of Deep Neural Networks architectures and methods for…

Computer Vision and Pattern Recognition · Computer Science 2016-10-19 Rémi Cadène , Nicolas Thome , Matthieu Cord

Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yucheng Tang , Dong Yang , Wenqi Li , Holger Roth , Bennett Landman , Daguang Xu , Vishwesh Nath , Ali Hatamizadeh

The field of image classification has shown an outstanding success thanks to the development of deep learning techniques. Despite the great performance obtained, most of the work has focused on natural images ignoring other domains like…

Computer Vision and Pattern Recognition · Computer Science 2019-02-07 Manuel Lagunas , Elena Garces

This study investigates the potential of a pre-trained vision Transformer (VT) model, specifically the Swin Transformer V2 (SwinV2), to classify photometric light curves without the need for feature extraction or multi-band preprocessing.…

Instrumentation and Methods for Astrophysics · Physics 2025-11-05 Daniel Moreno-Cartagena , Pavlos Protopapas , Guillermo Cabrera-Vives , Martina Cádiz-Leyton , Ignacio Becker , Cristóbal Donoso-Oliva

Among the current mainstream change detection networks, transformer is deficient in the ability to capture accurate low-level details, while convolutional neural network (CNN) is wanting in the capacity to understand global information and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Dalong Zheng , Zebin Wu , Jia Liu , Zhihui Wei

Mosquito-related diseases pose a significant threat to global public health, necessitating efficient and accurate mosquito classification for effective surveillance and control. This work presents an innovative approach to mosquito…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Ahmed Akib Jawad Karim , Muhammad Zawad Mahmud , Riasat Khan

Kernel classifiers and regressors designed for structured data, such as sequences, trees and graphs, have significantly advanced a number of interdisciplinary areas such as computational biology and drug design. Typically, kernels are…

Machine Learning · Computer Science 2020-01-14 Hanjun Dai , Bo Dai , Le Song

The purpose of the Insect Detection System for Crop and Plant Health is to keep an eye out for and identify insect infestations in farming areas. By utilizing cutting-edge technology like computer vision and machine learning, the system…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Md. Mahmudul Hasan , SM Shaqib , Ms. Sharmin Akter , Rabiul Alam , Afraz Ul Haque , Shahrun akter khushbu

Reliable plant species and damage segmentation for herbicide field research trials requires models that can withstand substantial real-world variation across seasons, geographies, devices, and sensing modalities. Most deep learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Artzai Picon , Itziar Eguskiza , Daniel Mugica , Javier Romero , Carlos Javier Jimenez , Eric White , Gabriel Do-Lago-Junqueira , Christian Klukas , Ramon Navarra-Mestre

Camera traps generate millions of wildlife images, yet many datasets contain species that are absent from existing classifiers. This work evaluates zero-shot approaches for organizing unlabeled wildlife imagery using self-supervised vision…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Hugo Markoff , Jevgenijs Galaktionovs

Task-specific microscopy datasets are often too small to train deep learning models that learn robust feature representations. Self-supervised learning (SSL) can mitigate this by pretraining on large unlabeled datasets, but it remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Ben Isselmann , Dilara Göksu , Andreas Weinmann