English
Related papers

Related papers: TreeFormers -- An Exploration of Vision Transforme…

200 papers

Recent work in financial machine learning has shown the virtue of complexity: the phenomenon by which deep learning methods capable of learning highly nonlinear relationships outperform simpler approaches in financial forecasting. While…

Machine Learning · Computer Science 2025-11-06 Emi Soroka , Artem Arzyn

Vision Transformers (ViT) have advanced computer vision, yet their efficacy in complex tasks like driving remains less explored. This study enhances ViT by integrating human eye gaze, captured via eye-tracking, to increase prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Sharath Koorathota , Nikolas Papadopoulos , Jia Li Ma , Shruti Kumar , Xiaoxiao Sun , Arunesh Mittal , Patrick Adelman , Paul Sajda

Recently, several Vision Transformer (ViT) based methods have been proposed for Fine-Grained Visual Classification (FGVC).These methods significantly surpass existing CNN-based ones, demonstrating the effectiveness of ViT in FGVC…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Zi-Chao Zhang , Zhen-Duo Chen , Yongxin Wang , Xin Luo , Xin-Shun Xu

Side-scan sonar (SSS) imagery presents unique challenges in the classification of man-made objects on the seafloor due to the complex and varied underwater environments. Historically, experts have manually interpreted SSS images, relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 BW Sheffield , Jeffrey Ellen , Ben Whitmore

This research proposes a reliable model for identifying different construction materials with the highest accuracy, which is exploited as an advantageous tool for a wide range of construction applications such as automated progress…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Maryam Soleymani , Mahdi Bonyani , Hadi Mahami , Farnad Nasirzadeh

Driving in a complex urban environment is a difficult task that requires a complex decision policy. In order to make informed decisions, one needs to gain an understanding of the long-range context and the importance of other vehicles. In…

Machine Learning · Computer Science 2021-09-15 Eshagh Kargar , Ville Kyrki

Vision transformers (ViTs) have gained popularity recently. Even without customized image operators such as convolutions, ViTs can yield competitive performance when properly trained on massive data. However, the computational overhead of…

Machine Learning · Computer Science 2022-03-17 Shixing Yu , Tianlong Chen , Jiayi Shen , Huan Yuan , Jianchao Tan , Sen Yang , Ji Liu , Zhangyang Wang

Vision Transformers (ViTs) have become prominent models for solving various vision tasks. However, the interpretability of ViTs has not kept pace with their promising performance. While there has been a surge of interest in developing {\it…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Yao Qiang , Chengyin Li , Prashant Khanduri , Dongxiao Zhu

Vision Transformer (ViT) architectures are becoming increasingly popular and widely employed to tackle computer vision applications. Their main feature is the capacity to extract global information through the self-attention mechanism,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Lorenzo Papa , Paolo Russo , Irene Amerini , Luping Zhou

Fine-grained classification is a challenging task that involves identifying subtle differences between objects within the same category. This task is particularly challenging in scenarios where data is scarce. Visual transformers (ViT) have…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Manuel Lagunas , Brayan Impata , Victor Martinez , Virginia Fernandez , Christos Georgakis , Sofia Braun , Felipe Bertrand

Transformers, composed of multiple self-attention layers, hold strong promises toward a generic learning primitive applicable to different data modalities, including the recent breakthroughs in computer vision achieving state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Sayak Paul , Pin-Yu Chen

Vision Transformers (ViTs) have emerged as the fundamental architecture for most computer vision fields, but the considerable memory and computation costs hinders their application on resource-limited devices. As one of the most powerful…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Junrui Xiao , Zhikai Li , Lianwei Yang , Qingyi Gu

Image Classification is a fundamental task in the field of computer vision that frequently serves as a benchmark for gauging advancements in Computer Vision. Over the past few years, significant progress has been made in image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Mahmoud Khalil , Ahmad Khalil , Alioune Ngom

Vision transformers (ViTs) quantization offers a promising prospect to facilitate deploying large pre-trained networks on resource-limited devices. Fully-binarized ViTs (Bi-ViT) that pushes the quantization of ViTs to its limit remain…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Yanjing Li , Sheng Xu , Mingbao Lin , Xianbin Cao , Chuanjian Liu , Xiao Sun , Baochang Zhang

Vision Transformers (ViTs) is emerging as an alternative to convolutional neural networks (CNNs) for visual recognition. They achieve competitive results with CNNs but the lack of the typical convolutional inductive bias makes them more…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Yun-Hao Cao , Hao Yu , Jianxin Wu

Our food security is built on the foundation of soil. Farmers would be unable to feed us with fiber, food, and fuel if the soils were not healthy. Accurately predicting the type of soil helps in planning the usage of the soil and thus…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Aaryan Jagetia , Umang Goenka , Priyadarshini Kumari , Mary Samuel

In recent years, deep learning has made brilliant achievements in Environmental Microorganism (EM) image classification. However, image classification of small EM datasets has still not obtained good research results. Therefore, researchers…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Peng Zhao , Chen Li , Md Mamunur Rahaman , Hao Xu , Hechen Yang , Hongzan Sun , Tao Jiang , Marcin Grzegorzek

Vision Transformers (ViTs) have demonstrated state-of-the-art performance on many Computer Vision Tasks. Unfortunately, deploying these large-scale ViTs is resource-consuming and impossible for many mobile devices. While most in the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Nahid Alam , Steven Kolawole , Simardeep Sethi , Nishant Bansali , Karina Nguyen

The most recent year has witnessed the success of applying the Vision Transformer (ViT) for image classification. However, there are still evidences indicating that ViT often suffers following two aspects, i) the high computation and the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Xian Wei , Bin Wang , Mingsong Chen , Ji Yuan , Hai Lan , Jiehuang Shi , Xuan Tang , Bo Jin , Guozhang Chen , Dongping Yang

Monitoring biodiversity is paramount to manage and protect natural resources. Collecting images of organisms over large temporal or spatial scales is a promising practice to monitor the biodiversity of natural ecosystems, providing large…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 S. Kyathanahally , T. Hardeman , M. Reyes , E. Merz , T. Bulas , P. Brun , F. Pomati , M. Baity-Jesi