English
Related papers

Related papers: Spectro-ViT: A Vision Transformer Model for GABA-e…

200 papers

Accurate classification of brain tumors from magnetic resonance imaging (MRI) plays a critical role in early diagnosis and effective treatment planning. In this study, we propose a deep learning framework based on Vision Transformers (ViT)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Faisal Ahmed

We present a new technique of decontaminating Swift UVOT grism spectra for transient objects. We describe the template image requirements and image processing steps necessary to successfully implement the empirical decontamination…

Instrumentation and Methods for Astrophysics · Physics 2016-04-27 Michael T. Smitka , Peter J. Brown , Paul Kuin , Nicholas B. Suntzeff

Due to its deficiency in prior knowledge (inductive bias), Vision Transformer (ViT) requires pre-training on large-scale datasets to perform well. Moreover, the growing layers and parameters in ViT models impede their applicability to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Chenhao Xu , Chang-Tsun Li , Chee Peng Lim , Douglas Creighton

This paper introduces ViT4LPA, an innovative Vision Transformer (ViT) based approach for Load Profile Analysis (LPA). We transform time-series load profiles into load images. This allows us to leverage the ViT architecture, originally…

Systems and Control · Electrical Eng. & Systems 2024-04-15 Hyeonjin Kim , Yi Hu , Kai Ye , Ning Lu

Learning harmful shortcuts such as spurious correlations and biases prevents deep neural networks from learning the meaningful and useful representations, thus jeopardizing the generalizability and interpretability of the learned…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Chong Ma , Lin Zhao , Yuzhong Chen , Lu Zhang , Zhenxiang Xiao , Haixing Dai , David Liu , Zihao Wu , Zhengliang Liu , Sheng Wang , Jiaxing Gao , Changhe Li , Xi Jiang , Tuo Zhang , Qian Wang , Dinggang Shen , Dajiang Zhu , Tianming Liu

This work introduces a new approach to the Epileptic Spasms (ESES) detection based on the EEG signals using Vision Transformers (ViT). Classic ESES detection approaches have usually been performed with manual processing or conventional…

Neurons and Cognition · Quantitative Biology 2024-12-18 Wei Gong , Yaru Li

This paper introduces the Neural Transcoding Vision Transformer (\modelname), a generative model designed to estimate high-resolution functional Magnetic Resonance Imaging (fMRI) samples from simultaneous Electroencephalography (EEG) data.…

Image and Video Processing · Electrical Eng. & Systems 2024-09-19 Romeo Lanzino , Federico Fontana , Luigi Cinque , Francesco Scarcello , Atsuto Maki

Vision Transformer (ViT) has prevailed in computer vision tasks due to its strong long-range dependency modelling ability. \textcolor{blue}{However, its large model size and weak local feature modeling ability hinder its application in real…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Yi Zhang , Lingxiao Wei , Bowei Zhang , Ziwei Liu , Kai Yi , Shu Hu

Recently, Visual Transformer (ViT) has been widely used in various fields of computer vision due to applying self-attention mechanism in the spatial domain to modeling global knowledge. Especially in medical image segmentation (MIS), many…

Image and Video Processing · Electrical Eng. & Systems 2022-10-26 Jiacheng Ruan , Mingye Xie , Suncheng Xiang , Ting Liu , Yuzhuo Fu

Spatial transcriptomics reveals gene expression patterns within tissue context, enabling precision oncology applications such as treatment response prediction, but its high cost and technical complexity limit clinical adoption. Predicting…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Won June Cho , Hongjun Yoon , Daeky Jeong , Hyeongyeol Lim , Yosep Chong

In recent years, Transformers have achieved remarkable progress in computer vision tasks. However, their global modeling often comes with substantial computational overhead, in stark contrast to the human eye's efficient information…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Yuguang Zhang , Qihang Fan , Huaibo Huang

When it comes to clinical images, automatic segmentation has a wide variety of applications and a considerable diversity of input domains, such as different types of Magnetic Resonance Images (MRIs) and Computerized Tomography (CT) scans.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 Matteo Bastico , David Ryckelynck , Laurent Corté , Yannick Tillier , Etienne Decencière

Hyperspectral imaging empowers machine vision systems with the distinct capability of identifying materials through recording their spectral signatures. Recent efforts in data-driven spectral reconstruction aim at extracting spectral…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Qiang Fu , Matheus Souza , Eunsue Choi , Suhyun Shin , Seung-Hwan Baek , Wolfgang Heidrich

Vision transformers (ViTs) are emerging with significantly improved accuracy in computer vision tasks. However, their complex architecture and enormous computation/storage demand impose urgent needs for new hardware accelerator design…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Zhengang Li , Mengshu Sun , Alec Lu , Haoyu Ma , Geng Yuan , Yanyue Xie , Hao Tang , Yanyu Li , Miriam Leeser , Zhangyang Wang , Xue Lin , Zhenman Fang

Fast MRI aims to reconstruct a high fidelity image from partially observed measurements. Exuberant development in fast MRI using deep learning has been witnessed recently. Meanwhile, novel deep learning paradigms, e.g., Transformer based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Jiahao Huang , Xiaodan Xing , Zhifan Gao , Guang Yang

Casting semantic segmentation of outdoor LiDAR point clouds as a 2D problem, e.g., via range projection, is an effective and popular approach. These projection-based methods usually benefit from fast computations and, when combined with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Angelika Ando , Spyros Gidaris , Andrei Bursuc , Gilles Puy , Alexandre Boulch , Renaud Marlet

Traditional fault diagnosis methods using Convolutional Neural Networks (CNNs) often struggle with capturing the temporal dynamics of vibration signals. To overcome this, the application of Transformer-based Vision Transformer (ViT) methods…

Systems and Control · Electrical Eng. & Systems 2025-01-03 Shouhua Zhang , Jiehan Zhou , Xue Ma , Susanna Pirttikangas , Chunsheng Yang

Semantic segmentation has a broad range of applications in a variety of domains including land coverage analysis, autonomous driving, and medical image analysis. Convolutional neural networks (CNN) and Vision Transformers (ViTs) provide the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Hans Thisanke , Chamli Deshan , Kavindu Chamith , Sachith Seneviratne , Rajith Vidanaarachchi , Damayanthi Herath

Material decomposition for imaging multiple contrast agents in a single acquisition has been made possible by spectral CT: a modality which incorporates multiple photon energy spectral sensitivities into a single data collection. This work…

Medical Physics · Physics 2020-08-11 Matthew Tivnan , Steven Tilley , J. Webster Stayman

Reconstructing images seen by people from their fMRI brain recordings provides a non-invasive window into the human brain. Despite recent progress enabled by diffusion models, current methods often lack faithfulness to the actual seen…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Roman Beliy , Amit Zalcher , Jonathan Kogman , Navve Wasserman , Michal Irani