English
Related papers

Related papers: Benchmarking Detection Transfer Learning with Visi…

200 papers

The transformer models have shown promising effectiveness in dealing with various vision tasks. However, compared with training Convolutional Neural Network (CNN) models, training Vision Transformer (ViT) models is more difficult and relies…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Jiawang Bai , Li Yuan , Shu-Tao Xia , Shuicheng Yan , Zhifeng Li , Wei Liu

This work proposes a novel method for object co-segmentation, i.e. pixel-level localization of a common object in a set of images, that uses no pixel-level supervision for training. Two pre-trained Vision Transformer (ViT) models are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Nikolaos-Antonios Ypsilantis , Ondřej Chum

Most existing approaches to training object detectors rely on fully supervised learning, which requires the tedious manual annotation of object location in a training set. Recently there has been an increasing interest in developing weakly…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Zhiyuan Shi , Parthipan Siva , Tao Xiang

For specialized and dense downstream tasks such as object detection, labeling data requires expertise and can be very expensive, making few-shot and semi-supervised models much more attractive alternatives. While in the few-shot setup we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Quentin Bouniot , Angélique Loesch , Romaric Audigier , Amaury Habrard

Recently, plain vision Transformers (ViTs) have shown impressive performance on various computer vision tasks, thanks to their strong modeling capacity and large-scale pretraining. However, they have not yet conquered the problem of image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Jingfeng Yao , Xinggang Wang , Shusheng Yang , Baoyuan Wang

Object discovery -- separating objects from the background without manual labels -- is a fundamental open challenge in computer vision. Previous methods struggle to go beyond clustering of low-level cues, whether handcrafted (e.g., color,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Zhipeng Bao , Pavel Tokmakov , Yu-Xiong Wang , Adrien Gaidon , Martial Hebert

Vision Transformers (ViT) have recently demonstrated the significant potential of transformer architectures for computer vision. To what extent can image-based deep reinforcement learning also benefit from ViT architectures, as compared to…

Machine Learning · Computer Science 2022-05-17 Tianxin Tao , Daniele Reda , Michiel van de Panne

Vision Transformers (ViTs) have achieved comparable or superior performance than Convolutional Neural Networks (CNNs) in computer vision. This empirical breakthrough is even more remarkable since, in contrast to CNNs, ViTs do not embed any…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Samy Jelassi , Michael E. Sander , Yuanzhi Li

Contrastive learning methods for unsupervised visual representation learning have reached remarkable levels of transfer performance. We argue that the power of contrastive learning has yet to be fully unleashed, as current methods are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Zhenda Xie , Yutong Lin , Zheng Zhang , Yue Cao , Stephen Lin , Han Hu

Vision transformers (ViTs) process input images as sequences of patches via self-attention; a radically different architecture than convolutional neural networks (CNNs). This makes it interesting to study the adversarial feature space of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Muzammal Naseer , Kanchana Ranasinghe , Salman Khan , Fahad Shahbaz Khan , Fatih Porikli

Masked image modeling (MIM) pre-training for large-scale vision transformers (ViTs) has enabled promising downstream performance on top of the learned self-supervised ViT features. In this paper, we question if the \textit{extremely simple}…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Jin Gao , Shubo Lin , Shaoru Wang , Yutong Kou , Zeming Li , Liang Li , Congxuan Zhang , Xiaoqin Zhang , Yizheng Wang , Weiming Hu

Transformers, which are popular for language modeling, have been explored for solving vision tasks recently, e.g., the Vision Transformer (ViT) for image classification. The ViT model splits each image into a sequence of tokens with fixed…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Li Yuan , Yunpeng Chen , Tao Wang , Weihao Yu , Yujun Shi , Zihang Jiang , Francis EH Tay , Jiashi Feng , Shuicheng Yan

In several real-world scenarios like autonomous navigation and mobility, to obtain a better visual understanding of the surroundings, image captioning and object detection play a crucial role. This work introduces a novel multitask learning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Debolena Basak , P. K. Srijith , Maunendra Sankar Desarkar

Recent years have seen impressive progress in visual recognition on many benchmarks, however, generalization to the real-world in out-of-distribution setting remains a significant challenge. A state-of-the-art method for robust visual…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Sebastian Cygert , Andrzej Czyzewski

Model binarization can significantly compress model size, reduce energy consumption, and accelerate inference through efficient bit-wise operations. Although binarizing convolutional neural networks have been extensively studied, there is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Yefei He , Zhenyu Lou , Luoming Zhang , Jing Liu , Weijia Wu , Hong Zhou , Bohan Zhuang

Object detection models perform well at localizing and classifying objects that they are shown during training. However, due to the difficulty and cost associated with creating and annotating detection datasets, trained models detect a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Ayush Jaiswal , Yue Wu , Pradeep Natarajan , Premkumar Natarajan

Providing ground truth supervision to train visual models has been a bottleneck over the years, exacerbated by domain shifts which degenerate the performance of such models. This was the case when visual tasks relied on handcrafted features…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Gabriel Villalonga , Antonio M. Lopez

We present a new method that views object detection as a direct set prediction problem. Our approach streamlines the detection pipeline, effectively removing the need for many hand-designed components like a non-maximum suppression…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Nicolas Carion , Francisco Massa , Gabriel Synnaeve , Nicolas Usunier , Alexander Kirillov , Sergey Zagoruyko

In this paper, we propose an effective knowledge transfer framework to boost the weakly supervised object detection accuracy with the help of an external fully-annotated source dataset, whose categories may not overlap with the target…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Yuanyi Zhong , Jianfeng Wang , Jian Peng , Lei Zhang

Recently, Vision Transformers (ViTs) have achieved unprecedented effectiveness in the general domain of image classification. Nonetheless, these models remain underexplored in the field of deepfake detection, given their lower performance…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Dat Nguyen , Marcella Astrid , Enjie Ghorbel , Djamila Aouada