English
Related papers

Related papers: How Can Multimodal Remote Sensing Datasets Transfo…

200 papers

Vision Transformer (ViT) models have recently emerged as powerful and versatile models for various visual tasks. Recently, a work called PMF has achieved promising results in few-shot image classification by utilizing pre-trained vision…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Junjie Zhu , Yiying Li , Chunping Qiu , Ke Yang , Naiyang Guan , Xiaodong Yi

Supervised learning can learn large representational spaces, which are crucial for handling difficult learning tasks. However, due to the design of the model, classical image classification approaches struggle to generalize to new problems…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Safwen Naimi , Rien van Leeuwen , Wided Souidene , Slim Ben Saoud

Recent advances on Vision Transformer (ViT) and its improved variants have shown that self-attention-based networks surpass traditional Convolutional Neural Networks (CNNs) in most vision tasks. However, existing ViTs focus on the standard…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Xiaofeng Mao , Gege Qi , Yuefeng Chen , Xiaodan Li , Ranjie Duan , Shaokai Ye , Yuan He , Hui Xue

Vision Transformers (ViTs) is emerging as an alternative to convolutional neural networks (CNNs) for visual recognition. They achieve competitive results with CNNs but the lack of the typical convolutional inductive bias makes them more…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Yun-Hao Cao , Hao Yu , Jianxin Wu

What constitutes an object? This has been a long-standing question in computer vision. Towards this goal, numerous learning-free and learning-based approaches have been developed to score objectness. However, they generally do not scale…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Muhammad Maaz , Hanoona Rasheed , Salman Khan , Fahad Shahbaz Khan , Rao Muhammad Anwer , Ming-Hsuan Yang

In recent years, vision transformers (ViTs) have emerged as powerful and promising techniques for computer vision tasks such as image classification, object detection, and segmentation. Unlike convolutional neural networks (CNNs), which…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shaibal Saha , Lanyu Xu

Vision Transformers (ViTs) have achieved comparable or superior performance than Convolutional Neural Networks (CNNs) in computer vision. This empirical breakthrough is even more remarkable since, in contrast to CNNs, ViTs do not embed any…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Samy Jelassi , Michael E. Sander , Yuanzhi Li

Vision Transformer (ViT) demonstrates that Transformer for natural language processing can be applied to computer vision tasks and result in comparable performance to convolutional neural networks (CNN), which have been studied and adopted…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yi-Lun Liao , Sertac Karaman , Vivienne Sze

Using images acquired by different satellite sensors has shown to improve classification performance in the framework of crop mapping from satellite image time series (SITS). Existing state-of-the-art architectures use self-attention…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Theresa Follath , David Mickisch , Jan Hemmerling , Stefan Erasmi , Marcel Schwieder , Begüm Demir

Vision Transformers (ViTs) have demonstrated exceptional performance in various vision tasks. However, they tend to underperform on smaller datasets due to their inherent lack of inductive biases. Current approaches address this limitation…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Alan Luo , Kaiwen Yuan

Convolutional Neural Networks (CNNs) for computer vision sometimes struggle with understanding images in a global context, as they mainly focus on local patterns. On the other hand, Vision Transformers (ViTs), inspired by models originally…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Dimitrios N. Vlachogiannis , Dimitrios A. Koutsomitropoulos

Spatial relationships between objects represent key scene information for humans to understand and interact with the world. To study the capability of current computer vision systems to recognize physically grounded spatial relations, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Chuan Wen , Dinesh Jayaraman , Yang Gao

Driving in a complex urban environment is a difficult task that requires a complex decision policy. In order to make informed decisions, one needs to gain an understanding of the long-range context and the importance of other vehicles. In…

Machine Learning · Computer Science 2021-09-15 Eshagh Kargar , Ville Kyrki

Remote sensing scene classification (RSSC) is a critical task with diverse applications in land use and resource management. While unimodal image-based approaches show promise, they often struggle with limitations such as high intra-class…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Jinjin Cai , Kexin Meng , Baijian Yang , Gang Shao

Accurate classification of celestial objects is essential for advancing our understanding of the universe. MargNet is a recently developed deep learning-based classifier applied to SDSS DR16 dataset to segregate stars, quasars, and compact…

Instrumentation and Methods for Astrophysics · Physics 2024-08-29 Srinadh Reddy Bhavanam , Sumohana S. Channappayya , P. K. Srijith , Shantanu Desai

The Vision Transformer (ViT) excels in accuracy when handling high-resolution images, yet it confronts the challenge of significant spatial redundancy, leading to increased computational and memory requirements. To address this, we present…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Youbing Hu , Yun Cheng , Anqi Lu , Zhiqiang Cao , Dawei Wei , Jie Liu , Zhijun Li

Most recent successes in robot reinforcement learning involve learning a specialized single-task agent. However, robots capable of performing multiple tasks can be much more valuable in real-world applications. Multi-task reinforcement…

Robotics · Computer Science 2024-07-19 Elie Aljalbout , Nikolaos Sotirakis , Patrick van der Smagt , Maximilian Karl , Nutan Chen

Visual Transformers (VTs) are emerging as an architectural paradigm alternative to Convolutional networks (CNNs). Differently from CNNs, VTs can capture global relations between image elements and they potentially have a larger…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yahui Liu , Enver Sangineto , Wei Bi , Nicu Sebe , Bruno Lepri , Marco De Nadai

Vision Transformer (ViT) extends the application range of transformers from language processing to computer vision tasks as being an alternative architecture against the existing convolutional neural networks (CNN). Since the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Byeongho Heo , Sangdoo Yun , Dongyoon Han , Sanghyuk Chun , Junsuk Choe , Seong Joon Oh

Transferring the ImageNet pre-trained weights to the various remote sensing tasks has produced acceptable results and reduced the need for labeled samples. However, the domain differences between ground imageries and remote sensing images…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Ali Ghanbarzade , Hossein Soleimani