中文
相关论文

相关论文: Beyond RGB: Leveraging Vision Transformers for The…

200 篇论文

This work proposes a novel approach for hand gesture recognition using an inexpensive, low-resolution (24 x 32) thermal sensor processed by a Spiking Neural Network (SNN) followed by Sparse Segmentation and feature-based gesture…

计算机视觉与模式识别 · 计算机科学 2024-01-15 Ali Safa , Wout Mommen , Lars Keuninckx

Vision language models (VLMs) achieve strong performance on RGB imagery, but they do not generalize to thermal images. Thermal sensing plays a critical role in settings where visible light fails, including nighttime surveillance, search and…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Ayush Shrivastava , Kirtan Gangani , Laksh Jain , Mayank Goel , Nipun Batra

We introduce dense vision transformers, an architecture that leverages vision transformers in place of convolutional networks as a backbone for dense prediction tasks. We assemble tokens from various stages of the vision transformer into…

计算机视觉与模式识别 · 计算机科学 2021-03-26 René Ranftl , Alexey Bochkovskiy , Vladlen Koltun

The RGB-Thermal (RGB-T) information for semantic segmentation has been extensively explored in recent years. However, most existing RGB-T semantic segmentation usually compromises spatial resolution to achieve real-time inference speed,…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Fuqin Deng , Hua Feng , Mingjian Liang , Hongmin Wang , Yong Yang , Yuan Gao , Junfeng Chen , Junjie Hu , Xiyue Guo , Tin Lun Lam

Semantic segmentation assigns labels to pixels in images, a critical yet challenging task in computer vision. Convolutional methods, although capturing local dependencies well, struggle with long-range relationships. Vision Transformers…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Mian Muhammad Naeem Abid , Nancy Mehta , Zongwei Wu , Radu Timofte

Existing visual change detectors usually adopt CNNs or Transformers for feature representation learning and focus on learning effective representation for the changed regions between images. Although good performance can be obtained by…

计算机视觉与模式识别 · 计算机科学 2023-10-18 Bo Jiang , Zitian Wang , Xixi Wang , Ziyan Zhang , Lan Chen , Xiao Wang , Bin Luo

After their initial success in natural language processing, transformer architectures have rapidly gained traction in computer vision, providing state-of-the-art results for tasks such as image classification, detection, segmentation, and…

计算机视觉与模式识别 · 计算机科学 2022-03-21 Hugo Touvron , Matthieu Cord , Alaaeldin El-Nouby , Jakob Verbeek , Hervé Jégou

Image classification is one of the main drivers of the rapid developments in deep learning with convolutional neural networks for computer vision. So is the analogous task of scene classification in remote sensing. However, in contrast to…

计算机视觉与模式识别 · 计算机科学 2021-04-05 Michael Schmitt , Yu-Lun Wu

This research addresses the pressing challenge of enhancing processing times and detection capabilities in Unmanned Aerial Vehicle (UAV)/drone imagery for global wildfire detection, despite limited datasets. Proposing a Segmented Neural…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Aditya V. Jonnalagadda , Hashim A. Hashim

Recent advancements in Convolutional Neural Networks have yielded super-human levels of performance in image recognition tasks [13, 25]; however, with increasing volumes of parcels crossing UK borders each year, classification of threats…

计算机视觉与模式识别 · 计算机科学 2020-06-25 A. Williamson , P. Dickinson , T. Lambrou , J. C. Murray

Saliency Prediction aims to predict the attention distribution of human eyes given an RGB image. Most of the recent state-of-the-art methods are based on deep image feature representations from traditional CNNs. However, the traditional…

计算机视觉与模式识别 · 计算机科学 2023-01-27 Shuo Zhang

With the fast growth in the visual surveillance and security sectors, thermal infrared images have become increasingly necessary ina large variety of industrial applications. This is true even though IR sensors are still more expensive than…

机器学习 · 计算机科学 2018-12-24 Feras Almasri , Olivier Debeir

The Vision Transformer (ViT) leverages the Transformer's encoder to capture global information by dividing images into patches and achieves superior performance across various computer vision tasks. However, the self-attention mechanism of…

计算机视觉与模式识别 · 计算机科学 2025-01-17 Tianxiao Zhang , Wenju Xu , Bo Luo , Guanghui Wang

While previous CNN-based models have exhibited promising results for salient object detection (SOD), their ability to explore global long-range dependencies is restricted. Our previous work, the Visual Saliency Transformer (VST), addressed…

计算机视觉与模式识别 · 计算机科学 2024-04-12 Nian Liu , Ziyang Luo , Ni Zhang , Junwei Han

RGB-D saliency detection integrates information from both RGB images and depth maps to improve prediction of salient regions under challenging conditions. The key to RGB-D saliency detection is to fully mine and fuse information at multiple…

计算机视觉与模式识别 · 计算机科学 2021-12-02 Yue Wang , Xu Jia , Lu Zhang , Yuke Li , James Elder , Huchuan Lu

Road segmentation is a fundamental perception task for autonomous driving and intelligent robotic systems, requiring both high accuracy and real-time inference, especially for deployment on resource-constrained edge devices. Existing…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Daojie Peng , Bingtao Wang , Fulong Ma , Liang Zhang , Jun Ma

Transformers are very powerful tools for a variety of tasks across domains, from text generation to image captioning. However, transformers require substantial amounts of training data, which is often a challenge in biomedical settings,…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Andrew Kean Gao

There still remains an extreme performance gap between Vision Transformers (ViTs) and Convolutional Neural Networks (CNNs) when training from scratch on small datasets, which is concluded to the lack of inductive bias. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2023-01-02 Zhiying Lu , Hongtao Xie , Chuanbin Liu , Yongdong Zhang

Egocentric temporal action segmentation in videos is a crucial task in computer vision with applications in various fields such as mixed reality, human behavior analysis, and robotics. Although recent research has utilized advanced…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Sakib Reza , Balaji Sundareshan , Mohsen Moghaddam , Octavia Camps

Vision Transformers, ViTs, have emerged as a powerful alternative to convolutional neural networks, CNNs, in a variety of image-based tasks. While CNNs have previously been evaluated for their ability to perform graphical perception tasks,…

计算机视觉与模式识别 · 计算机科学 2026-02-23 Poonam Poonam , Pere-Pau Vázquez , Timo Ropinski