English
Related papers

Related papers: On the Surprising Effectiveness of Transformers in…

200 papers

Deep neural networks produce state-of-the-art results when trained on a large number of labeled examples but tend to overfit when small amounts of labeled examples are used for training. Creating a large number of labeled examples requires…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

Transformers have had a significant impact on natural language processing and have recently demonstrated their potential in computer vision. They have shown promising results over convolution neural networks in fundamental computer vision…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Rojina Kashefi , Leili Barekatain , Mohammad Sabokrou , Fatemeh Aghaeipoor

Convolutional Neural Networks (CNNs), architectures consisting of convolutional layers, have been the standard choice in vision tasks. Recent studies have shown that Vision Transformers (VTs), architectures based on self-attention modules,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Kishaan Jeeveswaran , Senthilkumar Kathiresan , Arnav Varma , Omar Magdy , Bahram Zonooz , Elahe Arani

Convolutional neural networks (CNNs) have shown great capability of solving various artificial intelligence tasks. However, the increasing model size has raised challenges in employing them in resource-limited applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Hongyang Gao , Zhengyang Wang , Shuiwang Ji

A Convolutional Neural Network (CNN) is sometimes confronted with objects of changing appearance ( new instances) that exceed its generalization capability. This requires the CNN to incorporate new knowledge, i.e., to learn incrementally.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Tobias Scheck , Ana Perez Grassi , Gangolf Hirtz

Object classification is a significant task in computer vision. It has become an effective research area as an important aspect of image processing and the building block of image localization, detection, and scene parsing. Object…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Md. Mohsin Kabir , Abu Quwsar Ohi , Md. Saifur Rahman , M. F. Mridha

The Transformer architecture has gained significant popularity in computer vision tasks due to its capacity to generalize and capture long-range dependencies. This characteristic makes it well-suited for generating spatiotemporal tokens…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Rachid Reda Dokkar , Faten Chaieb , Hassen Drira , Arezki Aberkane

We present a multiview pseudo-labeling approach to video learning, a novel framework that uses complementary views in the form of appearance and motion information for semi-supervised learning in video. The complementary views help obtain…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Bo Xiong , Haoqi Fan , Kristen Grauman , Christoph Feichtenhofer

For specialized and dense downstream tasks such as object detection, labeling data requires expertise and can be very expensive, making few-shot and semi-supervised models much more attractive alternatives. While in the few-shot setup we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Quentin Bouniot , Angélique Loesch , Romaric Audigier , Amaury Habrard

The video action segmentation task is regularly explored under weaker forms of supervision, such as transcript supervision, where a list of actions is easier to obtain than dense frame-wise labels. In this formulation, the task presents…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 John Ridley , Huseyin Coskun , David Joseph Tan , Nassir Navab , Federico Tombari

Vision Transformers (ViTs) have emerged as popular models in computer vision, demonstrating state-of-the-art performance across various tasks. This success typically follows a two-stage strategy involving pre-training on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Zijun Long , Zaiqiao Meng , Gerardo Aragon Camarasa , Richard McCreadie

Vision transformers have been successfully applied to image recognition tasks due to their ability to capture long-range dependencies within an image. However, there are still gaps in both performance and computational cost between…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Jianyuan Guo , Kai Han , Han Wu , Yehui Tang , Xinghao Chen , Yunhe Wang , Chang Xu

Transformers are popular neural network models that use layers of self-attention and fully-connected nodes with embedded tokens. Vision Transformers (ViT) adapt transformers for image recognition tasks. In order to do this, the images are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Brian Kenji Iwana , Akihiro Kusuda

Radiographs are a versatile diagnostic tool for the detection and assessment of pathologies, for treatment planning or for navigation and localization purposes in clinical interventions. However, their interpretation and assessment by…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Finn Behrendt , Debayan Bhattacharya , Julia Krüger , Roland Opfer , Alexander Schlaefer

Image segmentation, a key task in computer vision, has traditionally relied on convolutional neural networks (CNNs), yet these models struggle with capturing complex spatial dependencies, objects with varying scales, need for manually…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Deepjyoti Chetia , Debasish Dutta , Sanjib Kr Kalita

Large-scale multi-modal contrastive pre-training has demonstrated great utility to learn transferable features for a range of downstream tasks by mapping multiple modalities into a shared embedding space. Typically, this has employed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Haoxuan You , Luowei Zhou , Bin Xiao , Noel Codella , Yu Cheng , Ruochen Xu , Shih-Fu Chang , Lu Yuan

Convolutional Neural Networks (CNNs) are powerful models that achieve impressive results for image classification. In addition, pre-trained CNNs are also useful for other computer vision tasks as generic feature extractors. This paper aims…

Computer Vision and Pattern Recognition · Computer Science 2015-07-10 Ben Athiwaratkun , Keegan Kang

The vision community is witnessing a modeling shift from CNNs to Transformers, where pure Transformer architectures have attained top accuracy on the major video recognition benchmarks. These video models are all built on Transformer layers…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Ze Liu , Jia Ning , Yue Cao , Yixuan Wei , Zheng Zhang , Stephen Lin , Han Hu

This work addresses the task of multilabel image classification. Inspired by the great success from deep convolutional neural networks (CNNs) for single-label visual-semantic embedding, we exploit extending these models for multilabel…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Yi-Nan Li , Mei-Chen Yeh

Transferring knowledge from task-agnostic pre-trained deep models for downstream tasks is an important topic in computer vision research. Along with the growth of computational capacity, we now have open-source vision-language pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Wenhao Wu , Zhun Sun , Wanli Ouyang