English
Related papers

Related papers: Attribute Surrogates Learning and Spectral Tokens …

200 papers

Few-shot learning requires to recognize novel classes with scarce labeled data. Prototypical network is useful in existing researches, however, training on narrow-size distribution of scarce data usually tends to get biased prototypes. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jinlu Liu , Liang Song , Yongqiang Qin

Transformers have been recently adapted for large scale image classification, achieving high scores shaking up the long supremacy of convolutional neural networks. However the optimization of image transformers has been little studied so…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Hugo Touvron , Matthieu Cord , Alexandre Sablayrolles , Gabriel Synnaeve , Hervé Jégou

Deep neural networks (DNNs) excel in computer vision tasks, especially, few-shot learning (FSL), which is increasingly important for generalizing from limited examples. However, DNNs are computationally expensive with scalability issues in…

Machine Learning · Computer Science 2025-05-16 Qi Xu , Junyang Zhu , Dongdong Zhou , Hao Chen , Yang Liu , Jiangrong Shen , Qiang Zhang

Unsupervised domain adaptation (UDA) and domain generalization (DG) enable machine learning models trained on a source domain to perform well on unlabeled or even unseen target domains. As previous UDA&DG semantic segmentation methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Lukas Hoyer , Dengxin Dai , Luc Van Gool

Many meta-learning approaches for few-shot learning rely on simple base learners such as nearest-neighbor classifiers. However, even in the few-shot regime, discriminatively trained linear predictors can offer better generalization. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Kwonjoon Lee , Subhransu Maji , Avinash Ravichandran , Stefano Soatto

Transformers-based methods have achieved significant performance in image deraining as they can model the non-local information which is vital for high-quality image reconstruction. In this paper, we find that most existing Transformers…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Xiang Chen , Hao Li , Mingqiang Li , Jinshan Pan

Transductive few-shot learning has recently triggered wide attention in computer vision. Yet, current methods introduce key hyper-parameters, which control the prediction statistics of the test batches, such as the level of class balance,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Long Zhou , Fereshteh Shakeri , Aymen Sadraoui , Mounir Kaaniche , Jean-Christophe Pesquet , Ismail Ben Ayed

Convolutional neural networks (CNNs) have allowed remarkable advances in single image super-resolution (SISR) over the last decade. Most SR methods based on CNNs have focused on achieving performance gains in terms of quality metrics, such…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Wonkyung Lee , Junghyup Lee , Dohyung Kim , Bumsub Ham

Transformer-based architectures start to emerge in single image super resolution (SISR) and have achieved promising performance. Most existing Vision Transformers divide images into the same number of patches with a fixed size, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Qing Cai , Yiming Qian , Jinxing Li , Jun Lv , Yee-Hong Yang , Feng Wu , David Zhang

Hyperspectral object tracking using snapshot mosaic cameras is emerging as it provides enhanced spectral information alongside spatial data, contributing to a more comprehensive understanding of material properties. Using transformers,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Shaheer Mohamed , Tharindu Fernando , Sridha Sridharan , Peyman Moghadam , Clinton Fookes

Deep learning-based methods in computational microscopy have been shown to be powerful but in general face some challenges due to limited generalization to new types of samples and requirements for large and diverse training data. Here, we…

Image and Video Processing · Electrical Eng. & Systems 2022-06-13 Luzhe Huang , Xilin Yang , Tairan Liu , Aydogan Ozcan

A common trend in simulation-driven engineering applications is the ever-increasing size and complexity of the problem, where classical numerical methods typically suffer from significant computational time and huge memory cost. Methods…

Computational Engineering, Finance, and Science · Computer Science 2025-10-28 Jiachen Guo , Chanwook Park , Xiaoyu Xie , Zhongsheng Sang , Gregory J. Wagner , Wing Kam Liu

High-Performance Computing (HPC) schedulers must balance user performance with facility-wide resource constraints. The task boils down to selecting the optimal number of nodes for a given job. We present a surrogate-assisted multi-objective…

Machine Learning · Computer Science 2026-01-23 Ashna Nawar Ahmed , Banooqa Banday , Terry Jones , Tanzima Z. Islam

Hierarchical structures are popular in recent vision transformers, however, they require sophisticated designs and massive datasets to work well. In this paper, we explore the idea of nesting basic local transformers on non-overlapping…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Zizhao Zhang , Han Zhang , Long Zhao , Ting Chen , Sercan O. Arik , Tomas Pfister

Convolutional neural networks (CNNs) have gained remarkable success in recent years. However, their performance highly relies on the architecture hyperparameters, and finding proper hyperparameters for a deep CNN is a challenging…

Neural and Evolutionary Computing · Computer Science 2023-02-28 An Chen , Zhigang Ren , Muyi Wang , Hui Chen , Haoxi Leng , Shuai Liu

This paper proposes a few-shot method based on Faster R-CNN and representation learning for object detection in aerial images. The two classification branches of Faster R-CNN are replaced by prototypical networks for online adaptation to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Pierre Le Jeune , Mustapha Lebbah , Anissa Mokraoui , Hanene Azzag

The successful application of deep learning to many visual recognition tasks relies heavily on the availability of a large amount of labeled data which is usually expensive to obtain. The few-shot learning problem has attracted increasing…

Machine Learning · Computer Science 2020-03-11 Zhongjie Yu , Lin Chen , Zhongwei Cheng , Jiebo Luo

Scattering networks are a class of designed Convolutional Neural Networks (CNNs) with fixed weights. We argue they can serve as generic representations for modelling images. In particular, by working in scattering space, we achieve…

Spiking Neural Networks (SNNs) have emerged as an attractive alternative to traditional deep learning frameworks, since they provide higher computational efficiency in event driven neuromorphic hardware. However, the state-of-the-art (SOTA)…

Neural and Evolutionary Computing · Computer Science 2021-09-05 Gourav Datta , Souvik Kundu , Peter A. Beerel

Recent advances in machine learning, specifically transformer architecture, have led to significant advancements in commercial domains. These powerful models have demonstrated superior capability to learn complex relationships and often…

Machine Learning · Computer Science 2024-05-29 Matthew L. Olson , Shusen Liu , Jayaraman J. Thiagarajan , Bogdan Kustowski , Weng-Keen Wong , Rushil Anirudh