中文
相关论文

相关论文: MultiCrossViT: Multimodal Vision Transformer for S…

200 篇论文

For medical image semantic segmentation (MISS), Vision Transformers have emerged as strong alternatives to convolutional neural networks thanks to their inherent ability to capture long-range correlations. However, existing research uses…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Qianying Liu , Chaitanya Kaul , Jun Wang , Christos Anagnostopoulos , Roderick Murray-Smith , Fani Deligianni

For computer vision, Vision Transformers (ViTs) have become one of the go-to deep net architectures. Despite being inspired by Convolutional Neural Networks (CNNs), ViTs' output remains sensitive to small spatial shifts in the input, i.e.,…

计算机视觉与模式识别 · 计算机科学 2023-11-30 Renan A. Rojas-Gomez , Teck-Yian Lim , Minh N. Do , Raymond A. Yeh

Accurate brain age estimation from structural MRI is a valuable biomarker for studying aging and neurodegeneration. Traditional regression and CNN-based methods face limitations such as manual feature engineering, limited receptive fields,…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Wasif Jalal , Md Nafiu Rahman , Atif Hasan Rahman , M. Sohel Rahman

Vision Transformers (ViTs) have emerged as the state-of-the-art architecture in representation learning, leveraging self-attention mechanisms to excel in various tasks. ViTs split images into fixed-size patches, constraining them to a…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Aswathi Varma , Suprosanna Shit , Chinmay Prabhakar , Daniel Scholz , Hongwei Bran Li , Bjoern Menze , Daniel Rueckert , Benedikt Wiestler

Vision Transformers (ViTs) have emerged with superior performance on computer vision tasks compared to convolutional neural network (CNN)-based models. However, ViTs are mainly designed for image classification that generate single-scale…

计算机视觉与模式识别 · 计算机科学 2021-11-24 Jiaqi Gu , Hyoukjun Kwon , Dilin Wang , Wei Ye , Meng Li , Yu-Hsin Chen , Liangzhen Lai , Vikas Chandra , David Z. Pan

Medical image segmentation plays a crucial role in various healthcare applications, enabling accurate diagnosis, treatment planning, and disease monitoring. Traditionally, convolutional neural networks (CNNs) dominated this domain,…

Transformers are state-of-the-art deep learning models that are composed of stacked attention and point-wise, fully connected layers designed for handling sequential data. Transformers are not only ubiquitous throughout Natural Language…

计算机视觉与模式识别 · 计算机科学 2021-12-01 Onur Kara , Arijit Sehanobish , Hector H Corzo

Operator learning, which aims to approximate maps between infinite-dimensional function spaces, is an important area in scientific machine learning with applications across various physical domains. Here we introduce the Continuous Vision…

机器学习 · 计算机科学 2025-02-18 Sifan Wang , Jacob H Seidman , Shyam Sankaran , Hanwen Wang , George J. Pappas , Paris Perdikaris

The detection and analysis of transient astronomical sources is of great importance to understand their time evolution. Traditional pipelines identify transient sources from difference (D) images derived by subtracting prior-observed…

天体物理仪器与方法 · 物理学 2023-09-19 Zhuoyang Chen , Wenjie Zhou , Guoyou Sun , Mi Zhang , Jiangao Ruan , Jingyuan Zhao

Vision Transformer (ViT), a radically different architecture than convolutional neural networks offers multiple advantages including design simplicity, robustness and state-of-the-art performance on many vision tasks. However, in contrast…

计算机视觉与模式识别 · 计算机科学 2022-10-14 Hanan Gani , Muzammal Naseer , Mohammad Yaqub

We present Multiscale Multiview Vision Transformers (MMViT), which introduces multiscale feature maps and multiview encodings to transformer models. Our model encodes different views of the input signal and builds several channel-resolution…

计算机视觉与模式识别 · 计算机科学 2023-05-02 Yuchen Liu , Natasha Ong , Kaiyan Peng , Bo Xiong , Qifan Wang , Rui Hou , Madian Khabsa , Kaiyue Yang , David Liu , Donald S. Williamson , Hanchao Yu

Deep learning applications in Magnetic Resonance Imaging (MRI) predominantly operate on reconstructed magnitude images, a process that discards phase information and requires computationally expensive transforms. Standard neural network…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Moritz Rempe , Lukas T. Rotkopf , Marco Schlimbach , Helmut Becker , Fabian Hörst , Johannes Haubold , Philipp Dammann , Kevin Kröninger , Jens Kleesiek

Vision transformers (ViTs) have been trending in image classification tasks due to their promising performance when compared to convolutional neural networks (CNNs). As a result, many researchers have tried to incorporate ViTs in…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Swalpa Kumar Roy , Ankur Deria , Danfeng Hong , Behnood Rasti , Antonio Plaza , Jocelyn Chanussot

Self-supervised monocular depth estimation is an attractive solution that does not require hard-to-source depth labels for training. Convolutional neural networks (CNNs) have recently achieved great success in this task. However, their…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Chaoqiang Zhao , Youmin Zhang , Matteo Poggi , Fabio Tosi , Xianda Guo , Zheng Zhu , Guan Huang , Yang Tang , Stefano Mattoccia

Vision Transformers (ViT)s have recently become popular due to their outstanding modeling capabilities, in particular for capturing long-range information, and scalability to dataset and model sizes which has led to state-of-the-art…

图像与视频处理 · 电气工程与系统科学 2022-04-06 Ali Hatamizadeh , Ziyue Xu , Dong Yang , Wenqi Li , Holger Roth , Daguang Xu

Despite its clinical utility, medical image segmentation (MIS) remains a daunting task due to images' inherent complexity and variability. Vision transformers (ViTs) have recently emerged as a promising solution to improve MIS; however,…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Siyi Du , Nourhan Bayasi , Ghassan Hamarneh , Rafeef Garbi

In the past decades, deep neural networks, particularly convolutional neural networks, have achieved state-of-the-art performance in a variety of medical image segmentation tasks. Recently, the introduction of the vision transformer (ViT)…

计算机视觉与模式识别 · 计算机科学 2024-09-18 Peijie Qiu , Jin Yang , Sayantan Kumar , Soumyendu Sekhar Ghosh , Aristeidis Sotiras

Pneumonia, particularly when induced by diseases like COVID-19, remains a critical global health challenge requiring rapid and accurate diagnosis. This study presents a comprehensive comparison of traditional machine learning and…

图像与视频处理 · 电气工程与系统科学 2025-07-16 Gaurav Singh

As deep learning models increasingly find applications in critical domains such as medical imaging, the need for transparent and trustworthy decision-making becomes paramount. Many explainability methods provide insights into how these…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Piotr Komorowski , Hubert Baniecki , Przemysław Biecek

Transformer neural networks, known for their ability to recognize complex patterns in high-dimensional data, offer a promising framework for capturing many-body correlations in quantum systems. We employ an adapted Vision Transformer (ViT)…

强关联电子 · 物理学 2024-08-26 Xiaodong Cao , Zhicheng Zhong , Yi Lu