English
Related papers

Related papers: Similarity-Guided Layer-Adaptive Vision Transforme…

200 papers

Prior correlation filter (CF)-based tracking methods for unmanned aerial vehicles (UAVs) have virtually focused on tracking in the daytime. However, when the night falls, the trackers will encounter more harsh scenes, which can easily lead…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Bowen Li , Changhong Fu , Fangqiang Ding , Junjie Ye , Fuling Lin

Existing adaptation techniques typically require architectural modifications or added parameters, leading to high computational costs and complexity. We introduce Attention Projection Layer Adaptation (APLA), a simple approach to adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Moein Sorkhei , Emir Konuk , Kevin Smith , Christos Matsoukas

Vision Transformer (ViT) architectures are becoming increasingly popular and widely employed to tackle computer vision applications. Their main feature is the capacity to extract global information through the self-attention mechanism,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Lorenzo Papa , Paolo Russo , Irene Amerini , Luping Zhou

Recent self-supervised learning (SSL) methods have shown impressive results in learning visual representations from unlabeled images. This paper aims to improve their performance further by utilizing the architectural advantages of the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Sukmin Yun , Hankook Lee , Jaehyung Kim , Jinwoo Shin

Vision Transformers (ViTs) are essential as foundation backbones in establishing the visual comprehension capabilities of Multimodal Large Language Models (MLLMs). Although most ViTs achieve impressive performance through image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Weijie Yin , Dingkang Yang , Hongyuan Dong , Zijian Kang , Jiacong Wang , Xiao Liang , Chao Feng , Jiao Ran

UAV tracking can be widely applied in scenarios such as disaster rescue, environmental monitoring, and logistics transportation. However, existing UAV tracking methods predominantly emphasize speed and lack exploration in semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Xinyu Zhou , Tongxin Pan , Lingyi Hong , Pinxue Guo , Haijing Guo , Zhaoyu Chen , Kaixun Jiang , Wenqiang Zhang

Vision Transformers (ViTs) have emerged as a promising approach for visual recognition tasks, revolutionizing the field by leveraging the power of transformer-based architectures. Among the various ViT models, Swin Transformers have gained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Sanad Aburass , Osama Dorgham

Transformers, composed of multiple self-attention layers, hold strong promises toward a generic learning primitive applicable to different data modalities, including the recent breakthroughs in computer vision achieving state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Sayak Paul , Pin-Yu Chen

In this paper, we ask whether Vision Transformers (ViTs) can serve as an underlying architecture for improving the adversarial robustness of machine learning models against evasion attacks. While earlier works have focused on improving…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Edoardo Debenedetti , Vikash Sehwag , Prateek Mittal

With the success of Vision Transformers (ViTs) in computer vision tasks, recent arts try to optimize the performance and complexity of ViTs to enable efficient deployment on mobile devices. Multiple approaches are proposed to accelerate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yanyu Li , Ju Hu , Yang Wen , Georgios Evangelidis , Kamyar Salahi , Yanzhi Wang , Sergey Tulyakov , Jian Ren

Transformers have been successfully applied to the visual tracking task and significantly promote tracking performance. The self-attention mechanism designed to model long-range dependencies is the key to the success of Transformers.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Zhihong Fu , Zehua Fu , Qingjie Liu , Wenrui Cai , Yunhong Wang

Vision transformers (ViTs) that model an image as a sequence of partitioned patches have shown notable performance in diverse vision tasks. Because partitioning patches eliminates the image structure, to reflect the order of patches, ViTs…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Bum Jun Kim , Hyeyeon Choi , Hyeonah Jang , Sang Woo Kim

We present a single neural network architecture composed of task-agnostic components (ViTs, convolutions, and LSTMs) that achieves state-of-art results on both the ImageNav ("go to location in <this picture>") and ObjectNav ("find a chair")…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Karmesh Yadav , Arjun Majumdar , Ram Ramrakhya , Naoki Yokoyama , Alexei Baevski , Zsolt Kira , Oleksandr Maksymets , Dhruv Batra

LiDAR has become one of the primary sensors in robotics and autonomous system for high-accuracy situational awareness. In recent years, multi-modal LiDAR systems emerged, and among them, LiDAR-as-a-camera sensors provide not only 3D point…

Robotics · Computer Science 2023-08-15 Ha Sier , Xianjia Yu , Iacopo Catalano , Jorge Pena Queralta , Zhuo Zou , Tomi Westerlund

The advent of Vision Transformers (ViTs) marks a substantial paradigm shift in the realm of computer vision. ViTs capture the global information of images through self-attention modules, which perform dot product computations among…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Shuoxi Zhang , Hanpeng Liu , Stephen Lin , Kun He

Previous advances in object tracking mostly reported on favorable illumination circumstances while neglecting performance at nighttime, which significantly impeded the development of related aerial robot applications. This work instead…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Junjie Ye , Changhong Fu , Guangze Zheng , Danda Pani Paudel , Guang Chen

Plant phenology-the study of recurrent life cycle events-is essential for understanding ecosystem dynamics and their responses to climate change impacts. While Unmanned Aerial Vehicles (UAVs) and near-surface cameras enable high-resolution…

Vision Transformers (ViTs) enabled the use of the transformer architecture on vision tasks showing impressive performances when trained on big datasets. However, on relatively small datasets, ViTs are less accurate given their lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Guglielmo Camporese , Elena Izzo , Lamberto Ballan

Vision Transformers (ViTs), with their ability to model long-range dependencies through self-attention mechanisms, have become a standard architecture in computer vision. However, the interpretability of these models remains a challenge. To…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Walid Bousselham , Angie Boggust , Sofian Chaybouti , Hendrik Strobelt , Hilde Kuehne

Legged robots, particularly quadrupeds, offer promising navigation capabilities, especially in scenarios requiring traversal over diverse terrains and obstacle avoidance. This paper addresses the challenge of enabling legged robots to…

Robotics · Computer Science 2023-10-12 Jianwei Liu , Shirui Lyu , Denis Hadjivelichkov , Valerio Modugno , Dimitrios Kanoulas