English
Related papers

Related papers: Visual Transformer for Object Detection

200 papers

Weakly supervised object localization is a challenging task in which the object of interest should be localized while learning its appearance. State-of-the-art methods recycle the architecture of a standard CNN by using the activation maps…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Akhil Meethal , Marco Pedersoli , Soufiane Belharbi , Eric Granger

Unconstrained video recognition and Deep Convolution Network (DCN) are two active topics in computer vision recently. In this work, we apply DCNs as frame-based recognizers for video recognition. Our preliminary studies, however, show that…

Computer Vision and Pattern Recognition · Computer Science 2015-06-16 Yu-Chuan Su , Tzu-Hsuan Chiu , Chun-Yen Yeh , Hsin-Fu Huang , Winston H. Hsu

Deep Convolutional Neural Networks (DCNNs) were originally inspired by principles of biological vision, have evolved into best current computational models of object recognition, and consequently indicate strong architectural and functional…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Leonard E. van Dyck , Sebastian J. Denzler , Walter R. Gruber

Person Re-Identification is an important problem in computer vision-based surveillance applications, in which the same person is attempted to be identified from surveillance photographs in a variety of nearby zones. At present, the majority…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Charu Sharma , Siddhant R. Kapil , David Chapman

Vision Transformers (ViTs) have shown competitive accuracy in image classification tasks compared with CNNs. Yet, they generally require much more data for model pre-training. Most of recent works thus are dedicated to designing more…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Daquan Zhou , Yujun Shi , Bingyi Kang , Weihao Yu , Zihang Jiang , Yuan Li , Xiaojie Jin , Qibin Hou , Jiashi Feng

Self-attention has the promise of improving computer vision systems due to parameter-independent scaling of receptive fields and content-dependent interactions, in contrast to parameter-dependent scaling and content-independent interactions…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ashish Vaswani , Prajit Ramachandran , Aravind Srinivas , Niki Parmar , Blake Hechtman , Jonathon Shlens

Vision Transformers (ViT) have recently emerged as a powerful alternative to convolutional networks (CNNs). Although hybrid models attempt to bridge the gap between these two architectures, the self-attention layers they rely on induce a…

Machine Learning · Computer Science 2021-06-11 Stéphane d'Ascoli , Levent Sagun , Giulio Biroli , Ari Morcos

Despite recent advances in object detection using deep learning neural networks, these neural networks still struggle to identify objects in art images such as paintings and drawings. This challenge is known as the cross depiction problem…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 David Kadish , Sebastian Risi , Anders Sundnes Løvlie

Detecting the objects in dense and rotated scenes is a challenging task. Recent works on this topic are mostly based on Faster RCNN or Retinanet. As they are highly dependent on the pre-set dense anchors and the NMS operation, the approach…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Zhu Yuke , Ruan Yumeng , Yang Lei , Guo Sheng

Since their emergence, Convolutional Neural Networks (CNNs) have made significant strides in medical image analysis. However, the local nature of the convolution operator may pose a limitation for capturing global and long-range…

Image and Video Processing · Electrical Eng. & Systems 2024-04-01 Abdul Rehman Khan , Asifullah Khan

Due to the success of Bidirectional Encoder Representations from Transformers (BERT) in natural language process (NLP), the multi-head attention transformer has been more and more prevalent in computer-vision researches (CV). However, it…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Weiqiang Jin , Hang Yu , Hang Yu

Extensive work has demonstrated the effectiveness of Vision Transformers. The plain Vision Transformer tends to obtain multi-scale features by selecting fixed layers, or the last layer of features aiming to achieve higher performance in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Fangjian Lin , Yizhe Ma , Shengwei Tian

Object detection is a challenging task in visual understanding domain, and even more so if the supervision is to be weak. Recently, few efforts to handle the task without expensive human annotations is established by promising deep neural…

Computer Vision and Pattern Recognition · Computer Science 2016-11-28 Ali Diba , Vivek Sharma , Ali Pazandeh , Hamed Pirsiavash , Luc Van Gool

Detection Transformers represent end-to-end object detection approaches based on a Transformer encoder-decoder architecture, exploiting the attention mechanism for global relation modeling. Although Detection Transformers deliver results on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Bastian Wittmann , Fernando Navarro , Suprosanna Shit , Bjoern Menze

We present BoTNet, a conceptually simple yet powerful backbone architecture that incorporates self-attention for multiple computer vision tasks including image classification, object detection and instance segmentation. By just replacing…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Aravind Srinivas , Tsung-Yi Lin , Niki Parmar , Jonathon Shlens , Pieter Abbeel , Ashish Vaswani

As a special type of transformer, Vision Transformers (ViTs) are used to various computer vision applications (CV), such as image recognition. There are several potential problems with convolutional neural networks (CNNs) that can be solved…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Sonain Jamil , Md. Jalil Piran , Oh-Jin Kwon

The ability to discover new transients via image differencing without direct human intervention is an important task in observational astronomy. For these kind of image classification problems, machine Learning techniques such as…

Instrumentation and Methods for Astrophysics · Physics 2022-09-09 Venkitesh Ayyar , Robert Knop , Autumn Awbrey , Alexis Andersen , Peter Nugent

Deploying deep learning models on embedded systems has been challenging due to limited computing resources. The majority of existing work focuses on accelerating image classification, while other fundamental vision problems, such as object…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Zhen Dong , Dequan Wang , Qijing Huang , Yizhao Gao , Yaohui Cai , Tian Li , Bichen Wu , Kurt Keutzer , John Wawrzynek

Self-supervised learning (SSL) methods such as masked language modeling have shown massive performance gains by pretraining transformer models for a variety of natural language processing tasks. The follow-up research adapted similar…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Gokul Karthik Kumar , Sahal Shaji Mullappilly , Abhishek Singh Gehlot

We provide a detailed analysis of convolutional neural networks which are pre-trained on the task of object detection. To this end, we train detectors on large datasets like OpenImagesV4, ImageNet Localization and COCO. We analyze how well…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Hengduo Li , Bharat Singh , Mahyar Najibi , Zuxuan Wu , Larry S. Davis