中文
相关论文

相关论文: An Image is Worth 16x16 Words: Transformers for Im…

200 篇论文

Vision Transformers (ViTs) have demonstrated state-of-the-art performance on many Computer Vision Tasks. Unfortunately, deploying these large-scale ViTs is resource-consuming and impossible for many mobile devices. While most in the…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Nahid Alam , Steven Kolawole , Simardeep Sethi , Nishant Bansali , Karina Nguyen

This paper does not attempt to design a state-of-the-art method for visual recognition but investigates a more efficient way to make use of convolutions to encode spatial features. By comparing the design principles of the recent…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Qibin Hou , Cheng-Ze Lu , Ming-Ming Cheng , Jiashi Feng

Inspired by the great success achieved by CNN in image recognition, view-based methods applied CNNs to model the projected views for 3D object understanding and achieved excellent performance. Nevertheless, multi-view CNN models cannot…

计算机视觉与模式识别 · 计算机科学 2021-10-26 Shuo Chen , Tan Yu , Ping Li

In recent developments in the field of Computer Vision, a rise is seen in the use of transformer-based architectures. They are surpassing the state-of-the-art set by CNN architectures in accuracy but on the other hand, they are…

计算机视觉与模式识别 · 计算机科学 2021-10-12 Durvesh Malpure , Onkar Litake , Rajesh Ingle

Image segmentation, a key task in computer vision, has traditionally relied on convolutional neural networks (CNNs), yet these models struggle with capturing complex spatial dependencies, objects with varying scales, need for manually…

计算机视觉与模式识别 · 计算机科学 2025-01-17 Deepjyoti Chetia , Debasish Dutta , Sanjib Kr Kalita

Although convolutional networks have been the dominant architecture for vision tasks for many years, recent experiments have shown that Transformer-based models, most notably the Vision Transformer (ViT), may exceed their performance in…

计算机视觉与模式识别 · 计算机科学 2022-01-25 Asher Trockman , J. Zico Kolter

The recently developed vision transformer (ViT) has achieved promising results on image classification compared to convolutional neural networks. Inspired by this, in this paper, we study how to learn multi-scale feature representations in…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Chun-Fu Chen , Quanfu Fan , Rameswar Panda

Transformers have become one of the dominant architectures in deep learning, particularly as a powerful alternative to convolutional neural networks (CNNs) in computer vision. However, Transformer training and inference in previous works…

计算机视觉与模式识别 · 计算机科学 2021-12-24 Zizheng Pan , Bohan Zhuang , Haoyu He , Jing Liu , Jianfei Cai

We explore the application of Vision Transformer (ViT) for handwritten text recognition. The limited availability of labeled data in this domain poses challenges for achieving high performance solely relying on ViT. Previous…

计算机视觉与模式识别 · 计算机科学 2024-09-16 Yuting Li , Dexiong Chen , Tinglong Tang , Xi Shen

Transformer, first applied to the field of natural language processing, is a type of deep neural network mainly based on the self-attention mechanism. Thanks to its strong representation capabilities, researchers are looking at ways to…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Kai Han , Yunhe Wang , Hanting Chen , Xinghao Chen , Jianyuan Guo , Zhenhua Liu , Yehui Tang , An Xiao , Chunjing Xu , Yixing Xu , Zhaohui Yang , Yiman Zhang , Dacheng Tao

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

计算机视觉与模式识别 · 计算机科学 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

Transformers are very powerful tools for a variety of tasks across domains, from text generation to image captioning. However, transformers require substantial amounts of training data, which is often a challenge in biomedical settings,…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Andrew Kean Gao

With the achievements of Transformer in the field of natural language processing, the encoder-decoder and the attention mechanism in Transformer have been applied to computer vision. Recently, in multiple tasks of computer vision (image…

计算机视觉与模式识别 · 计算机科学 2022-03-03 Rui-Yang Ju , Ting-Yu Lin , Jen-Shiun Chiang , Jia-Hao Jian , Yu-Shian Lin , Liu-Rui-Yi Huang

Vision transformers (ViTs) have been successfully applied in image classification tasks recently. In this paper, we show that, unlike convolution neural networks (CNNs)that can be improved by stacking more convolutional layers, the…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Daquan Zhou , Bingyi Kang , Xiaojie Jin , Linjie Yang , Xiaochen Lian , Zihang Jiang , Qibin Hou , Jiashi Feng

Medical ultrasound (US) imaging has become a prominent modality for breast cancer imaging due to its ease-of-use, low-cost and safety. In the past decade, convolutional neural networks (CNNs) have emerged as the method of choice in vision…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Behnaz Gheflati , Hassan Rivaz

Texture, a significant visual attribute in images, has been extensively investigated across various image recognition applications. Convolutional Neural Networks (CNNs), which have been successful in many computer vision tasks, are…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Leonardo Scabini , Andre Sacilotti , Kallil M. Zielinski , Lucas C. Ribas , Bernard De Baets , Odemir M. Bruno

Although convolutional networks (ConvNets) have enjoyed great success in computer vision (CV), it suffers from capturing global information crucial to dense prediction tasks such as object detection and segmentation. In this work, we…

计算机视觉与模式识别 · 计算机科学 2021-05-12 Haotian Yan , Zhe Li , Weijian Li , Changhu Wang , Ming Wu , Chuang Zhang

The extension of convolutional neural networks (CNNs) to non-Euclidean geometries has led to multiple frameworks for studying manifolds. Many of those methods have shown design limitations resulting in poor modelling of long-range…

计算机视觉与模式识别 · 计算机科学 2022-06-01 Simon Dahan , Logan Z. J. Williams , Abdulah Fawaz , Daniel Rueckert , Emma C. Robinson

The groundbreaking performance of transformers in Natural Language Processing (NLP) tasks has led to their replacement of traditional Convolutional Neural Networks (CNNs), owing to the efficiency and accuracy achieved through the…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Gousia Habib , Damandeep Singh , Ishfaq Ahmad Malik , Brejesh Lall

Vision Transformer (ViT) architectures are becoming increasingly popular and widely employed to tackle computer vision applications. Their main feature is the capacity to extract global information through the self-attention mechanism,…

计算机视觉与模式识别 · 计算机科学 2024-05-06 Lorenzo Papa , Paolo Russo , Irene Amerini , Luping Zhou