中文
相关论文

相关论文: Transformers in Medical Imaging: A Survey

200 篇论文

The hybrid architecture of convolutional neural networks (CNNs) and Transformer are very popular for medical image segmentation. However, it suffers from two challenges. First, although a CNNs branch can capture the local image features…

图像与视频处理 · 电气工程与系统科学 2023-12-21 Tao Lei , Rui Sun , Xuan Wang , Yingbo Wang , Xi He , Asoke Nandi

The increasing popularity of attention mechanisms in deep learning algorithms for computer vision and natural language processing made these models attractive to other research domains. In healthcare, there is a strong need for tools that…

计算机视觉与模式识别 · 计算机科学 2022-04-27 Tiago Gonçalves , Isabel Rio-Torto , Luís F. Teixeira , Jaime S. Cardoso

This paper presents a comprehensive survey of research works on the topic of form understanding in the context of scanned documents. We delve into recent advancements and breakthroughs in the field, highlighting the significance of language…

计算与语言 · 计算机科学 2024-03-08 Abdelrahman Abdallah , Daniel Eberharter , Zoe Pfister , Adam Jatowt

Medical image segmentation - the prerequisite of numerous clinical needs - has been significantly prospered by recent advances in convolutional neural networks (CNNs). However, it exhibits general limitations on modeling explicit long-range…

计算机视觉与模式识别 · 计算机科学 2021-07-13 Yundong Zhang , Huiye Liu , Qiang Hu

Convolutional Neural Networks (CNNs) have reigned for a decade as the de facto approach to automated medical image diagnosis, pushing the state-of-the-art in classification, detection and segmentation tasks. Over the last years, vision…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Christos Matsoukas , Johan Fredin Haslum , Moein Sorkhei , Magnus Söderberg , Kevin Smith

Transformer, as one of the most advanced neural network models in Natural Language Processing (NLP), exhibits diverse applications in the field of anomaly detection. To inspire research on Transformer-based anomaly detection, this review…

机器学习 · 计算机科学 2024-02-15 Mingrui Ma , Lansheng Han , Chunjie Zhou

Deep neural networks such as convolutional neural networks (CNNs) and transformers have achieved many successes in image classification in recent years. It has been consistently demonstrated that best practice for image classification is…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Jo Plested , Musa Phiri , Tom Gedeon

Histopathology has played an essential role in cancer diagnosis. With the rapid advances in convolutional neural networks (CNN). Various CNN-based automated pathological image segmentation approaches have been developed in computer-assisted…

图像与视频处理 · 电气工程与系统科学 2021-09-23 Cam Nguyen , Zuhayr Asad , Yuankai Huo

Transformer architectures have brought about fundamental changes to computational linguistic field, which had been dominated by recurrent neural networks for many years. Its success also implies drastic changes in cross-modal tasks with…

计算机视觉与模式识别 · 计算机科学 2021-11-10 Andrew Shin , Masato Ishii , Takuya Narihira

Transformer model architectures have garnered immense interest lately due to their effectiveness across a range of domains like language, vision and reinforcement learning. In the field of natural language processing for example,…

机器学习 · 计算机科学 2022-03-15 Yi Tay , Mostafa Dehghani , Dara Bahri , Donald Metzler

The transformer is primarily used in the field of natural language processing. Recently, it has been adopted and shows promise in the computer vision (CV) field. Medical image analysis (MIA), as a critical branch of CV, also greatly…

图像与视频处理 · 电气工程与系统科学 2023-07-26 Zhaoshan Liu , Qiujie Lv , Ziduo Yang , Yifan Li , Chau Hung Lee , Lei Shen

Deep Learning has shown great success in reshaping medical imaging, yet it faces numerous challenges hindering widespread application. Issues like catastrophic forgetting and distribution shifts in the continuously evolving data stream…

计算机视觉与模式识别 · 计算机科学 2024-10-02 Mohammad Areeb Qazi , Anees Ur Rehman Hashmi , Santosh Sanjeev , Ibrahim Almakky , Numan Saeed , Camila Gonzalez , Mohammad Yaqub

Transformer architecture has widespread applications, particularly in Natural Language Processing and computer vision. Recently Transformers have been employed in various aspects of time-series analysis. This tutorial provides an overview…

机器学习 · 计算机科学 2023-07-27 Sabeen Ahmed , Ian E. Nielsen , Aakash Tripathi , Shamoon Siddiqui , Ghulam Rasool , Ravi P. Ramachandran

The introduction of Transformers architecture has brought about significant breakthroughs in Deep Learning (DL), particularly within Natural Language Processing (NLP). Since their inception, Transformers have outperformed many traditional…

机器人学 · 计算机科学 2024-12-17 Nikunj Sanghai , Nik Bear Brown

Graph transformers are a recent advancement in machine learning, offering a new class of neural network models for graph-structured data. The synergy between transformers and graph learning demonstrates strong performance and versatility…

机器学习 · 计算机科学 2025-12-23 Ahsan Shehzad , Feng Xia , Shagufta Abid , Ciyuan Peng , Shuo Yu , Dongyu Zhang , Karin Verspoor

Transformers gain huge attention since they are first introduced and have a wide range of applications. Transformers start to take over all areas of deep learning and the Vision transformers paper also proved that they can be used for…

计算机视觉与模式识别 · 计算机科学 2021-10-18 Yiğit Gündüç

Convolutional neural network (CNN) based methods have achieved great successes in medical image segmentation, but their capability to learn global representations is still limited due to using small effective receptive fields of convolution…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Pengfei Gu , Yejia Zhang , Chaoli Wang , Danny Z. Chen

As transformers have gained prominence in natural language processing, some researchers have investigated theoretically what problems they can and cannot solve, by treating problems as formal languages. Exploring such questions can help…

机器学习 · 计算机科学 2024-09-05 Lena Strobl , William Merrill , Gail Weiss , David Chiang , Dana Angluin

Automated medical image segmentation is becoming increasingly crucial to modern clinical practice, driven by the growing demand for precise diagnosis, the push towards personalized treatment plans, and the advancements in machine learning…

图像与视频处理 · 电气工程与系统科学 2023-11-13 Tan-Hanh Pham , Xianqi Li , Kim-Doang Nguyen

Transformer-based detectors have shown success in computer vision tasks with natural images. These models, exemplified by the Deformable DETR, are optimized through complex engineering strategies tailored to the typical characteristics of…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Yanqi Xu , Yiqiu Shen , Carlos Fernandez-Granda , Laura Heacock , Krzysztof J. Geras