English
Related papers

Related papers: Vision Transformers for Cosmological Fields: Appli…

200 papers

Semantic segmentation has a broad range of applications in a variety of domains including land coverage analysis, autonomous driving, and medical image analysis. Convolutional neural networks (CNN) and Vision Transformers (ViTs) provide the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Hans Thisanke , Chamli Deshan , Kavindu Chamith , Sachith Seneviratne , Rajith Vidanaarachchi , Damayanthi Herath

Recent studies indicate that hierarchical Vision Transformer with a macro architecture of interleaved non-overlapped window-based self-attention \& shifted-window operation is able to achieve state-of-the-art performance in various visual…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Yuxin Fang , Xinggang Wang , Rui Wu , Wenyu Liu

Convolutional neural networks (CNNs) have been shown to both extract more information than the traditional two-point statistics from cosmological fields, and marginalise over astrophysical effects extremely well. However, CNNs require large…

Instrumentation and Methods for Astrophysics · Physics 2023-07-28 Christian Pedersen , Michael Eickenberg , Shirley Ho

We demonstrate the potential of Deep Learning methods for measurements of cosmological parameters from density fields, focusing on the extraction of non-Gaussian information. We consider weak lensing mass maps as our dataset. We aim for our…

Cosmology and Nongalactic Astrophysics · Physics 2017-07-19 Jorit Schmelzle , Aurelien Lucchi , Tomasz Kacprzak , Adam Amara , Raphael Sgier , Alexandre Réfrégier , Thomas Hofmann

Vision transformer (ViT) and its variants have swept through visual learning leaderboards and offer state-of-the-art accuracy in tasks such as image classification, object detection, and semantic segmentation by attending to different parts…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Eric Youn , Sai Mitheran J , Sanjana Prabhu , Siyuan Chen

Vision Transformers (ViTs) and Swin Transformers (Swin) are currently state-of-the-art in computational pathology. However, domain experts are still reluctant to use these models due to their lack of interpretability. This is not…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Manuel Tran , Amal Lahiani , Yashin Dicente Cid , Melanie Boxberg , Peter Lienemann , Christian Matek , Sophia J. Wagner , Fabian J. Theis , Eldad Klaiman , Tingying Peng

Transformer models have shown great potential in computer vision, following their success in language tasks. Swin Transformer is one of them that outperforms convolution-based architectures in terms of accuracy, while improving efficiency…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Jinkyu Koo , John Yang , Le An , Gwenaelle Cunha Sergio , Su Inn Park

Weakly supervised semantic segmentation (WSSS), a fundamental computer vision task, which aims to segment out the object within only class-level labels. The traditional methods adopt the CNN-based network and utilize the class activation…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingliang Deng , Zonghan Li

With the popularity of Transformer architectures in computer vision, the research focus has shifted towards developing computationally efficient designs. Window-based local attention is one of the major techniques being adopted in recent…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ammarah Farooq , Muhammad Awais , Sara Ahmed , Josef Kittler

Vision transformers have attracted much attention from computer vision researchers as they are not restricted to the spatial inductive bias of ConvNets. However, although Transformer-based backbones have achieved much progress on ImageNet…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Hong-Yu Zhou , Chixiang Lu , Sibei Yang , Yizhou Yu

Neural networks have become the standard technique for medical diagnostics, especially in cancer detection and classification. This work evaluates the performance of Vision Transformers architectures, including Swin Transformer and MaxViT,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Óscar A. Martín , Javier Sánchez

Vision transformers (ViTs) have been successfully applied in image classification tasks recently. In this paper, we show that, unlike convolution neural networks (CNNs)that can be improved by stacking more convolutional layers, the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Daquan Zhou , Bingyi Kang , Xiaojie Jin , Linjie Yang , Xiaochen Lian , Zihang Jiang , Qibin Hou , Jiashi Feng

We present a novel approach for estimating cosmological parameters, $\Omega_m$, $\sigma_8$, $w_0$, and one derived parameter, $S_8$, from 3D lightcone data of dark matter halos in redshift space covering a sky area of $40^\circ \times…

Cosmology and Nongalactic Astrophysics · Physics 2023-11-03 Se Yeon Hwang , Cristiano G. Sabiu , Inkyu Park , Sungwook E. Hong

Tokens or patches within Vision Transformers (ViT) lack essential semantic information, unlike their counterparts in natural language processing (NLP). Typically, ViT tokens are associated with rectangular image patches that lack specific…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Young Kyung Kim , J. Matías Di Martino , Guillermo Sapiro

The emergence of Vision Transformers (ViTs) has revolutionized computer vision, yet their effectiveness compared to traditional Convolutional Neural Networks (CNNs) in medical imaging remains under-explored. This study presents a…

Image and Video Processing · Electrical Eng. & Systems 2025-07-30 Kunal Kawadkar

Vision Transformer (ViT), a radically different architecture than convolutional neural networks offers multiple advantages including design simplicity, robustness and state-of-the-art performance on many vision tasks. However, in contrast…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Hanan Gani , Muzammal Naseer , Mohammad Yaqub

Vision Transformers (ViT) have recently brought a new wave of research in the field of computer vision. These models have performed particularly well in image classification and segmentation. Research on semantic and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Ashim Dahal , Saydul Akbar Murad , Nick Rahimi

Vision Transformers (ViTs) have shown competitive accuracy in image classification tasks compared with CNNs. Yet, they generally require much more data for model pre-training. Most of recent works thus are dedicated to designing more…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Daquan Zhou , Yujun Shi , Bingyi Kang , Weihao Yu , Zihang Jiang , Yuan Li , Xiaojie Jin , Qibin Hou , Jiashi Feng

Can a lightweight Vision Transformer (ViT) match or exceed the performance of Convolutional Neural Networks (CNNs) like ResNet on small datasets with small image resolutions? This report demonstrates that a pure ViT can indeed achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Jen Hong Tan

As weak lensing surveys go deeper, there is an increasing need for reliable characterization of non-Gaussian structures at small angular scales. Here we present the first cosmological constraints with weak lensing scattering transform, a…

Cosmology and Nongalactic Astrophysics · Physics 2025-06-12 Sihao Cheng , Gabriela A. Marques , Daniela Grandón , Leander Thiele , Masato Shirasaki , Brice Ménard , Jia Liu