English
Related papers

Related papers: Training-free Transformer Architecture Search

200 papers

Vision Transformer (ViT) has shown high potential in video recognition, owing to its flexible design, adaptable self-attention mechanisms, and the efficacy of masked pre-training. Yet, it remains unclear how to adapt these pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Min Yang , Huan Gao , Ping Guo , Limin Wang

Despite the success of Transformer-based models in the time-series prediction (TSP) tasks, the existing Transformer architecture still face limitations and the literature lacks comprehensive explorations into alternative architectures. To…

Machine Learning · Computer Science 2025-02-20 Juyuan Zhang , Wei Zhu , Jiechao Gao

Very recently, a variety of vision transformer architectures for dense prediction tasks have been proposed and they show that the design of spatial attention is critical to their success in these tasks. In this work, we revisit the design…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Xiangxiang Chu , Zhi Tian , Yuqing Wang , Bo Zhang , Haibing Ren , Xiaolin Wei , Huaxia Xia , Chunhua Shen

Neural architecture search (NAS) enables the automatic design of neural network models. However, training the candidates generated by the search algorithm for performance evaluation incurs considerable computational overhead. Our method,…

Machine Learning · Computer Science 2025-06-23 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Chunheng Jiang , Jianxi Gao

Vision Transformer (ViT) has recently gained significant attention in solving computer vision (CV) problems due to its capability of extracting informative features and modeling long-range dependencies through the attention mechanism.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yao Qiang , Chengyin Li , Prashant Khanduri , Dongxiao Zhu

Motivated by the huge success of Transformers in the field of natural language processing (NLP), Vision Transformers (ViTs) have been rapidly developed and achieved remarkable performance in various computer vision tasks. However, their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Huihong Shi , Haikuo Shao , Wendong Mao , Zhongfeng Wang

Vision Transformer (ViT) is becoming more popular in image processing. Specifically, we investigate the effectiveness of test-time adaptation (TTA) on ViT, a technique that has emerged to correct its prediction during test-time by itself.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Takeshi Kojima , Yutaka Matsuo , Yusuke Iwasawa

Vision Transformers (ViTs) are becoming more popular and dominating technique for various vision tasks, compare to Convolutional Neural Networks (CNNs). As a demanding technique in computer vision, ViTs have been successfully solved various…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Khawar Islam

Vision Transformers (ViTs) have recently achieved competitive performance in broad vision tasks. Unfortunately, on popular threat models, naturally trained ViTs are shown to provide no more adversarial robustness than convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Yichuan Mo , Dongxian Wu , Yifei Wang , Yiwen Guo , Yisen Wang

Humans possess remarkable ability to accurately classify new, unseen images after being exposed to only a few examples. Such ability stems from their capacity to identify common features shared between new and previously seen images while…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Weihao Jiang , Chang Liu , Kun He

Much of the recent improvement in neural networks for computer vision has resulted from discovery of new networks architectures. Most prior work has used the performance of candidate models following limited training to automatically guide…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Pouya Bashivan , Mark Tensen , James J DiCarlo

Vision Transformers (ViTs) have demonstrated remarkable capabilities in learning representations, but their performance is compromised when applied to unseen domains. Previous methods either engage in prompt learning during the training…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Yunbei Zhang , Akshay Mehra , Jihun Hamm

In this paper, we ask whether Vision Transformers (ViTs) can serve as an underlying architecture for improving the adversarial robustness of machine learning models against evasion attacks. While earlier works have focused on improving…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Edoardo Debenedetti , Vikash Sehwag , Prateek Mittal

Vision Transformers (ViTs) have achieved strong performance in visual recognition, yet their deployment in resource-constrained industrial environments remains limited. Some main challenges are their high computational cost, memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Phat Nguyen , Xue Geng , Kaixin Xu , Wang Zhe , Xulei Yang , Ngai-Man Cheung

The wide application of pre-trained models is driving the trend of once-for-all training in one-shot neural architecture search (NAS). However, training within a huge sample space damages the performance of individual subnets and requires…

Networking and Internet Architecture · Computer Science 2023-06-19 Haibin Wang , Ce Ge , Hesen Chen , Xiuyu Sun

The recently proposed training-free NAS methods abandon the training phase and design various zero-cost proxies as scores to identify excellent architectures, arousing extreme computational efficiency for neural architecture search. In this…

Machine Learning · Computer Science 2023-05-15 Miao Zhang , Wei Huang , Li Wang

Neural architecture search (NAS) provides a systematic framework for automating the design of neural network architectures, yet its widespread adoption is hindered by prohibitive computational requirements. Existing zero-cost proxy methods,…

Computation and Language · Computer Science 2025-03-25 Zhen-Song Chen , Hong-Wei Ding , Xian-Jia Wang , Witold Pedrycz

Self-supervised learning on large-scale Vision Transformers (ViTs) as pre-training methods has achieved promising downstream performance. Yet, how much these pre-training paradigms promote lightweight ViTs' performance is considerably less…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Shaoru Wang , Jin Gao , Zeming Li , Xiaoqin Zhang , Weiming Hu

Techniques for automatically designing deep neural network architectures such as reinforcement learning based approaches have recently shown promising results. However, their success is based on vast computational resources (e.g. hundreds…

Machine Learning · Computer Science 2017-11-22 Han Cai , Tianyao Chen , Weinan Zhang , Yong Yu , Jun Wang

To reduce the reliance on large-scale datasets, recent works in 3D segmentation resort to few-shot learning. Current 3D few-shot semantic segmentation methods first pre-train the models on `seen' classes, and then evaluate their…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Xiangyang Zhu , Renrui Zhang , Bowei He , Ziyu Guo , Jiaming Liu , Hao Dong , Peng Gao