English
Related papers

Related papers: A New Perspective to Boost Vision Transformer for …

200 papers

Medical image classification plays an increasingly vital role in identifying various diseases by classifying medical images, such as X-rays, MRIs and CT scans, into different categories based on their features. In recent years, deep…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Zeeshan Ahmad , Shudi Bao , Meng Chen

We create a reusable Transformer, BrainBERT, for intracranial recordings bringing modern representation learning approaches to neuroscience. Much like in NLP and speech recognition, this Transformer enables classifying complex concepts,…

Machine Learning · Computer Science 2023-03-01 Christopher Wang , Vighnesh Subramaniam , Adam Uri Yaari , Gabriel Kreiman , Boris Katz , Ignacio Cases , Andrei Barbu

Finding effective representations for time series data is a useful but challenging task. Several works utilize self-supervised or unsupervised learning methods to address this. However, there still remains the open question of how to…

Machine Learning · Computer Science 2024-03-19 Yuansan Liu , Sudanthi Wijewickrema , Christofer Bester , Stephen O'Leary , James Bailey

Deep-learning models have enabled performance leaps in analysis of high-dimensional functional MRI (fMRI) data. Yet, many previous methods are suboptimally sensitive for contextual representations across diverse time scales. Here, we…

Signal Processing · Electrical Eng. & Systems 2023-02-21 Hasan Atakan Bedel , Irmak Şıvgın , Onat Dalmaz , Salman Ul Hassan Dar , Tolga Çukur

Recently, the Vision Transformer (ViT) model has replaced the classical Convolutional Neural Network (ConvNet) in various computer vision tasks due to its superior performance. Even in hyperspectral image (HSI) classification field,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Haizhao Jing , Liuwei Wan , Xizhe Xue , Haokui Zhang , Ying Li

Complicated image registration is a key issue in medical image analysis, and deep learning-based methods have achieved better results than traditional methods. The methods include ConvNet-based and Transformer-based methods. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Runshi Zhang , Hao Mo , Junchen Wang , Bimeng Jie , Yang He , Nenghao Jin , Liang Zhu

Transformer, benefiting from global (long-range) information modeling using self-attention mechanism, has been successful in natural language processing and computer vision recently. Convolutional Neural Networks, capable of capturing local…

Image and Video Processing · Electrical Eng. & Systems 2022-05-18 Jiangyun Li , Wenxuan Wang , Chen Chen , Tianxiang Zhang , Sen Zha , Jing Wang , Hong Yu

Over the past decade, convolutional neural networks (CNN) have shown very competitive performance in medical image analysis tasks, such as disease classification, tumor segmentation, and lesion detection. CNN has great advantages in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Yin Dai , Yifan Gao

Deep learning methods have advanced quickly in brain imaging analysis over the past few years, but they are usually restricted by the limited labeled data. Pre-trained model on unlabeled data has presented promising improvement in feature…

Neurons and Cognition · Quantitative Biology 2024-08-22 Jinlong Hu , Yangmin Huang , Nan Wang , Shoubin Dong

In the field of medical images, although various works find Swin Transformer has promising effectiveness on pixelwise dense prediction, whether pre-training these models without using extra dataset can further boost the performance for the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Xinrong Hu , Dewen Zeng , Yawen Wu , Xueyang Li , Yiyu Shi

Transformers have become the dominant model in natural language processing, owing to their ability to pretrain on massive amounts of data, then transfer to smaller, more specific tasks via fine-tuning. The Vision Transformer was the first…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Josh Beal , Eric Kim , Eric Tzeng , Dong Huk Park , Andrew Zhai , Dmitry Kislyuk

Although deep learning models have had great success in natural language processing and computer vision, we do not observe comparable improvements in the case of tabular data, which is still the most common data type used in biological,…

Machine Learning · Computer Science 2025-04-28 Witold Wydmański , Ulvi Movsum-zada , Jacek Tabor , Marek Śmieja

Medical image segmentation is a vital healthcare endeavor requiring precise and efficient models for appropriate diagnosis and treatment. Vision transformer (ViT)-based segmentation models have shown great performance in accomplishing this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Numan Saeed , Muhammad Ridzuan , Roba Al Majzoub , Mohammad Yaqub

Vision Transformer (ViT) has shown its advantages over the convolutional neural network (CNN) with its ability to capture global long-range dependencies for visual representation learning. Besides ViT, contrastive learning is another…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Hua-Bao Ling , Bowen Zhu , Dong Huang , Ding-Hua Chen , Chang-Dong Wang , Jian-Huang Lai

Vision Transformer (ViT) has shown great potential for various visual tasks due to its ability to model long-range dependency. However, ViT requires a large amount of computing resource to compute the global self-attention. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Gaojie Wu , Wei-Shi Zheng , Yutong Lu , Qi Tian

Recent research tries to extend image restoration capabilities from human perception to machine perception, thereby enhancing the performance of high-level vision tasks in degraded environments. These methods, primarily based on supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jiawei Wu , Zhi Jin

Transformer models are not only successful in natural language processing (NLP) but also demonstrate high potential in computer vision (CV). Despite great advance, most of works only focus on improvement of architectures but pay little…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Jiangtao Xie , Ruiren Zeng , Qilong Wang , Ziqi Zhou , Peihua Li

In recent years, the transformer architecture has become the de facto standard for machine learning algorithms applied to natural language processing and computer vision. Despite notable evidence of successful deployment of this…

Robotics · Computer Science 2024-08-13 Carmelo Sferrazza , Dun-Ming Huang , Fangchen Liu , Jongmin Lee , Pieter Abbeel

Transformer with self-attention has led to the revolutionizing of natural language processing field, and recently inspires the emergence of Transformer-style architecture design with competitive results in numerous computer vision tasks.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Yehao Li , Ting Yao , Yingwei Pan , Tao Mei

In the field of medical imaging, the advent of deep learning, especially the application of convolutional neural networks (CNNs) has revolutionized the analysis and interpretation of medical images. Nevertheless, deep learning methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Xin Li , Wenhui Zhu , Peijie Qiu , Oana M. Dumitrascu , Amal Youssef , Yalin Wang