English
Related papers

Related papers: Vision Transformers for Cosmological Fields: Appli…

200 papers

Vision Transformers (ViTs) outperforms convolutional neural networks (CNNs) in several vision tasks with its global modeling capabilities. However, ViT lacks the inductive bias inherent to convolution making it require a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Jiawei Mao , Honggu Zhou , Xuesong Yin , Yuanqi Chang. Binling Nie. Rui Xu

Vision Transformers (ViTs) have recently become the state-of-the-art across many computer vision tasks. In contrast to convolutional networks (CNNs), ViTs enable global information sharing even within shallow layers of a network, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jongwoo Park , Kumara Kahatapitiya , Donghyun Kim , Shivchander Sudalairaj , Quanfu Fan , Michael S. Ryoo

Vision Transformers (ViTs) have recently dominated a range of computer vision tasks, yet it suffers from low training data efficiency and inferior local semantic representation capability without appropriate inductive bias. Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Cong Wang , Hongmin Xu , Xiong Zhang , Li Wang , Zhitong Zheng , Haifeng Liu

Attention-based vision models, such as Vision Transformer (ViT) and its variants, have shown promising performance in various computer vision tasks. However, these emerging architectures suffer from large model sizes and high computational…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Jinqi Xiao , Miao Yin , Yu Gong , Xiao Zang , Jian Ren , Bo Yuan

It is well believed that Transformer performs better in semantic segmentation compared to convolutional neural networks. Nevertheless, the original Vision Transformer may lack of inductive biases of local neighborhoods and possess a high…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Wentao Shi , Jing Xu , Pan Gao

This study examines various feature extraction techniques in computer vision, the primary focus of which is on Vision Transformers (ViTs) and other approaches such as Generative Adversarial Networks (GANs), deep feature models, traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Venant Niyonkuru , Sylla Sekou , Jimmy Jackson Sinzinkayo

The Vision Transformer (ViT) leverages the Transformer's encoder to capture global information by dividing images into patches and achieves superior performance across various computer vision tasks. However, the self-attention mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Tianxiao Zhang , Wenju Xu , Bo Luo , Guanghui Wang

Transformers, composed of multiple self-attention layers, hold strong promises toward a generic learning primitive applicable to different data modalities, including the recent breakthroughs in computer vision achieving state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Sayak Paul , Pin-Yu Chen

Vision Transformer (ViT) attains state-of-the-art performance in visual recognition, and the variant, Local Vision Transformer, makes further improvements. The major component in Local Vision Transformer, local attention, performs the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Qi Han , Zejia Fan , Qi Dai , Lei Sun , Ming-Ming Cheng , Jiaying Liu , Jingdong Wang

Vision Transformers (VTs) are becoming a valuable alternative to Convolutional Neural Networks (CNNs) when it comes to problems involving high-dimensional and spatially organized inputs such as images. However, their Transfer Learning (TL)…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Vincent Tonkes , Matthia Sabatelli

This paper presents a new vision Transformer, called Swin Transformer, that capably serves as a general-purpose backbone for computer vision. Challenges in adapting Transformer from language to vision arise from differences between the two…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Ze Liu , Yutong Lin , Yue Cao , Han Hu , Yixuan Wei , Zheng Zhang , Stephen Lin , Baining Guo

The vision community is witnessing a modeling shift from CNNs to Transformers, where pure Transformer architectures have attained top accuracy on the major video recognition benchmarks. These video models are all built on Transformer layers…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Ze Liu , Jia Ning , Yue Cao , Yixuan Wei , Zheng Zhang , Stephen Lin , Han Hu

Vision Transformers (ViTs) have redefined image classification by leveraging self-attention to capture complex patterns and long-range dependencies between image patches. However, a key challenge for ViTs is efficiently incorporating…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Shravan Venkatraman , Jaskaran Singh Walia , Joe Dhanith P R

The proliferation of deepfake technology poses significant challenges to the authenticity and trustworthiness of digital media, necessitating the development of robust detection methods. This study explores the application of Swin…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Aprille J. Xi , Eason Chen

The training of vision transformer (ViT) networks on small-scale datasets poses a significant challenge. By contrast, convolutional neural networks (CNNs) have an architectural inductive bias enabling them to perform well on such problems.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jianqiao Zheng , Xueqian Li , Simon Lucey

Crop segmentation from satellite image time series (SITS) is a fundamental task for agricultural monitoring and land-use analysis. While convolutional neural networks (CNNs) have been widely used, transformer-based architectures offer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Mattia Gatti , Ignazio Gallo , Nicola Landro , Christian Loschiavo , Anwar Ur Rehman , Mirco Boschetti , Riccardo La Grassa

Deep Convolutional Neural Networks (CNNs) have long been the architecture of choice for computer vision tasks. Recently, Transformer-based architectures like Vision Transformer (ViT) have matched or even surpassed ResNets for image…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Srinadh Bhojanapalli , Ayan Chakrabarti , Daniel Glasner , Daliang Li , Thomas Unterthiner , Andreas Veit

Vision Transformer (ViT) architectures are becoming increasingly popular and widely employed to tackle computer vision applications. Their main feature is the capacity to extract global information through the self-attention mechanism,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Lorenzo Papa , Paolo Russo , Irene Amerini , Luping Zhou

Transformer has been very successful in various computer vision tasks and understanding the working mechanism of transformer is important. As touchstones, weakly-supervised semantic segmentation (WSSS) and class activation map (CAM) are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Lianghui Zhu , Yingyue Li , Jiemin Fang , Yan Liu , Hao Xin , Wenyu Liu , Xinggang Wang

Convolutional Neural Networks (CNNs) have reigned for a decade as the de facto approach to automated medical image diagnosis. Recently, vision transformers (ViTs) have appeared as a competitive alternative to CNNs, yielding similar levels…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Christos Matsoukas , Johan Fredin Haslum , Magnus Söderberg , Kevin Smith