English
Related papers

Related papers: Image Recognition with Online Lightweight Vision T…

200 papers

Visual Language Models (VLMs) are now increasingly being merged with Large Language Models (LLMs) to enable new capabilities, particularly in terms of improved interactivity and open-ended responsiveness. While these are remarkable…

This paper investigates two techniques for developing efficient self-supervised vision transformers (EsViT) for visual representation learning. First, we show through a comprehensive empirical study that multi-stage architectures with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Chunyuan Li , Jianwei Yang , Pengchuan Zhang , Mei Gao , Bin Xiao , Xiyang Dai , Lu Yuan , Jianfeng Gao

Since convolutional neural networks (CNNs) perform well at learning generalizable image priors from large-scale data, these models have been extensively applied to image restoration and related tasks. Recently, another class of neural…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Syed Waqas Zamir , Aditya Arora , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Ming-Hsuan Yang

Visual transformers have achieved remarkable performance in image classification tasks, but this performance gain has come at the cost of interpretability. One of the main obstacles to the interpretation of transformers is the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Guillaume Jeanneret , Loïc Simon , Frédéric Jurie

This paper introduces versatile filters to construct efficient convolutional neural networks that are widely used in various visual recognition tasks. Considering the demands of efficient deep learning techniques running on cost-effective…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Kai Han , Yunhe Wang , Chang Xu , Chunjing Xu , Enhua Wu , Dacheng Tao

It is a challenging task to learn discriminative representation from images and videos, due to large local redundancy and complex global dependency in these visual data. Convolution neural networks (CNNs) and vision transformers (ViTs) have…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Kunchang Li , Yali Wang , Junhao Zhang , Peng Gao , Guanglu Song , Yu Liu , Hongsheng Li , Yu Qiao

Recently, plain vision Transformers (ViTs) have shown impressive performance on various computer vision tasks, thanks to their strong modeling capacity and large-scale pretraining. However, they have not yet conquered the problem of image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Jingfeng Yao , Xinggang Wang , Shusheng Yang , Baoyuan Wang

Vision transformers (ViTs) have found only limited practical use in processing images, in spite of their state-of-the-art accuracy on certain benchmarks. The reason for their limited use include their need for larger training datasets and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Pranav Jeevan , Amit sethi

The emergence of vision transformers (ViTs) in image classification has shifted the methodologies for visual representation learning. In particular, ViTs learn visual representation at full receptive field per layer across all the image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Li Zhang , Jiachen Lu , Sixiao Zheng , Xinxuan Zhao , Xiatian Zhu , Yanwei Fu , Tao Xiang , Jianfeng Feng , Philip H. S. Torr

Deep learning has shown a tremendous growth in hashing techniques for image retrieval. Recently, Transformer has emerged as a new architecture by utilizing self-attention without convolution. Transformer is also extended to Vision…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Shiv Ram Dubey , Satish Kumar Singh , Wei-Ta Chu

Transformer has been applied in the field of computer vision due to its excellent performance in natural language processing, surpassing traditional convolutional neural networks and achieving new state-of-the-art. ViT divides an image into…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yuang Liu , Zhiheng Qiu , Xiaokai Qin

Vision transformers are emerging as a powerful tool to solve computer vision problems. Recent techniques have also proven the efficacy of transformers beyond the image domain to solve numerous video-related tasks. Among those, human action…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Anwaar Ulhaq , Naveed Akhtar , Ganna Pogrebna , Ajmal Mian

Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) are two dominant models for image analysis. While CNNs excel at extracting multi-scale features and ViTs effectively capture global dependencies, both suffer from high…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Shicheng Yin , Kaixuan Yin , Weixing Chen , Enbo Huang , Yang Liu

Transformers have demonstrated great potential in computer vision tasks. To avoid dense computations of self-attentions in high-resolution visual data, some recent Transformer models adopt a hierarchical design, where self-attentions are…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Jinpeng Li , Yichao Yan , Shengcai Liao , Xiaokang Yang , Ling Shao

Model binarization can significantly compress model size, reduce energy consumption, and accelerate inference through efficient bit-wise operations. Although binarizing convolutional neural networks have been extensively studied, there is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Yefei He , Zhenyu Lou , Luoming Zhang , Jing Liu , Weijia Wu , Hong Zhou , Bohan Zhuang

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

Holistic methods using CNNs and margin-based losses have dominated research on face recognition. In this work, we depart from this setting in two ways: (a) we employ the Vision Transformer as an architecture for training a very strong…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Zhonglin Sun , Georgios Tzimiropoulos

Self-attention and transformer architectures have become foundational components in modern deep learning. Recent efforts have integrated transformer blocks into compact neural architectures for computer vision, giving rise to various…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yancheng Wang , Yingzhen Yang

Vision Transformers have attracted a lot of attention recently since the successful implementation of Vision Transformer (ViT) on vision tasks. With vision Transformers, specifically the multi-head self-attention modules, networks can…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Xiangyu Chen , Ying Qin , Wenju Xu , Andrés M. Bur , Cuncong Zhong , Guanghui Wang

In the field of computer vision, visible light images often exhibit low contrast in low-light conditions, presenting a significant challenge. While infrared imagery provides a potential solution, its utilization entails high costs and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yijia Chen , Pinghua Chen , Xiangxin Zhou , Yingtie Lei , Ziyang Zhou , Mingxian Li