English
Related papers

Related papers: Leveraging pre-trained vision Transformers for mul…

200 papers

Vision Transformers (ViTs) have shown significant promise in computer vision applications. However, their performance in few-shot learning is limited by challenges in refining token-level interactions, struggling with limited training data,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Mohammed Al-Habib , Zuping Zhang , Abdulrahman Noman

Few-shot class-incremental learning (FSCIL) has recently attracted extensive attention in various areas. Existing FSCIL methods highly depend on the robustness of the feature backbone pre-trained on base classes. In recent years, different…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Wenhao Qiu , Sichao Fu , Jingyi Zhang , Chengxiang Lei , Qinmu Peng

The Large Synoptic Survey Telescope will complete its survey in 2022 and produce terabytes of imaging data each night. To work with this massive onset of data, automated algorithms to classify astronomical light curves are crucial. Here, we…

Instrumentation and Methods for Astrophysics · Physics 2019-09-12 Tatiana Gabruseva , Sergey Zlobin , Peter Wang

Supervised classification of temporal sequences of astronomical images into meaningful transient astrophysical phenomena has been considered a hard problem because it requires the intervention of human experts. The classifier uses the…

Instrumentation and Methods for Astrophysics · Physics 2020-10-07 Catalina Gómez , Mauricio Neira , Marcela Hernández Hoyos , Pablo Arbeláez , Jaime E. Forero-Romero

Contrastive learning and equivariant learning are effective methods for self-supervised learning (SSL) for audio content analysis. Yet, their application to music information retrieval (MIR) faces a dilemma: the former is more effective on…

While annotated images for change detection using satellite imagery are scarce and costly to obtain, there is a wealth of unlabeled images being generated every day. In order to leverage these data to learn an image representation more…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Marrit Leenstra , Diego Marcos , Francesca Bovolo , Devis Tuia

In this paper, we present our approach to the Auto WCEBleedGen Challenge V2 2024. Our solution combines the Swin Transformer for the initial classification of bleeding frames and RT-DETR for further detection of bleeding in Wireless Capsule…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Sasidhar Alavala , Anil Kumar Vadde , Aparnamala Kancheti , Subrahmanyam Gorthi

Time-domain astronomy is entering a new era as wide-field surveys with higher cadences allow for more discoveries than ever before. The field has seen an increased use of machine learning and deep learning for automated classification of…

Instrumentation and Methods for Astrophysics · Physics 2022-12-28 Umar. F. Burhanudin , Justyn. R. Maund

Existing computer vision research in categorization struggles with fine-grained attributes recognition due to the inherently high intra-class variances and low inter-class variances. SOTA methods tackle this challenge by locating the most…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Marcos V. Conde , Kerem Turgutlu

Accurate skin disease classification is a critical yet challenging task due to high inter-class similarity, intra-class variability, and complex lesion textures. While deep learning-based computer-aided diagnosis (CAD) systems have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Enam Ahmed Taufik , Abdullah Khondoker , Antara Firoz Parsa , Seraj Al Mahmud Mostafa

In recent years, the integration of advanced imaging techniques and deep learning methods has significantly advanced computer-aided diagnosis (CAD) systems for breast cancer detection and classification. Transformers, which have shown great…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Mahtab Ranjbar , Mehdi Mohebbi , Mahdi Cherakhloo , Bijan Vosoughi. Vahdat

Skin diseases affect over a third of the global population, yet their impact is often underestimated. Automating skin disease classification to assist doctors with their prognosis might be difficult. Nevertheless, due to efficient feature…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jayanth Mohan , Arrun Sivasubramanian , V Sowmya , Ravi Vinayakumar

In this work, we present classification results on early supernova lightcurves from SCONE, a photometric classifier that uses convolutional neural networks to categorize supernovae (SNe) by type using lightcurve data. SCONE is able to…

Instrumentation and Methods for Astrophysics · Physics 2022-01-19 Helen Qu , Masao Sako

Accurate classification of celestial objects is essential for advancing our understanding of the universe. MargNet is a recently developed deep learning-based classifier applied to SDSS DR16 dataset to segregate stars, quasars, and compact…

Instrumentation and Methods for Astrophysics · Physics 2024-08-29 Srinadh Reddy Bhavanam , Sumohana S. Channappayya , P. K. Srijith , Shantanu Desai

In preparation for photometric classification of transients from the Legacy Survey of Space and Time (LSST) we run tests with different training data sets. Using estimates of the depth to which the 4-metre Multi-Object Spectroscopic…

Instrumentation and Methods for Astrophysics · Physics 2021-09-27 Jonathan E. Carrick , Isobel M. Hook , Elizabeth Swann , Kyle Boone , Chris Frohmaier , Alex G. Kim , Mark Sullivan

Can we complete pre-training of Vision Transformers (ViT) without natural images and human-annotated labels? Although a pre-trained ViT seems to heavily rely on a large-scale dataset and human-annotated labels, recent large-scale datasets…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Kodai Nakashima , Hirokatsu Kataoka , Asato Matsumoto , Kenji Iwata , Nakamasa Inoue

We present a multi-head vision transformer approach for multi-label plant species prediction in vegetation plot images, addressing the PlantCLEF 2025 challenge. The task involves training models on single-species plant images while testing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Hanna Herasimchyk , Robin Labryga , Tomislav Prusina

Large-scale NLP models have been shown to significantly improve the performance on language tasks with no signs of saturation. They also demonstrate amazing few-shot capabilities like that of human beings. This paper aims to explore…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Ze Liu , Han Hu , Yutong Lin , Zhuliang Yao , Zhenda Xie , Yixuan Wei , Jia Ning , Yue Cao , Zheng Zhang , Li Dong , Furu Wei , Baining Guo

We address the task of weakly-supervised few-shot image classification and segmentation, by leveraging a Vision Transformer (ViT) pretrained with self-supervision. Our proposed method takes token representations from the self-supervised ViT…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Dahyun Kang , Piotr Koniusz , Minsu Cho , Naila Murray