中文
相关论文

相关论文: SDLFormer: A Sparse and Dense Locality-enhanced Tr…

200 篇论文

The Swin transformer has recently attracted attention in medical image analysis due to its computational efficiency and long-range modeling capability. Owing to these properties, the Swin Transformer is suitable for establishing more…

计算机视觉与模式识别 · 计算机科学 2024-08-21 Mingrui Ma , Tao Wang , Lei Song , Weijie Wang , Guixia Liu

The transformer-based semantic segmentation approaches, which divide the image into different regions by sliding windows and model the relation inside each window, have achieved outstanding success. However, since the relation modeling…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Zizhang Wu , Yuanzhu Gan , Tianhao Xu , Fan Wang

Transformer has shown promising results in many sequence to sequence transformation tasks recently. It utilizes a number of feed-forward self-attention layers to replace the recurrent neural networks (RNN) in attention-based encoder decoder…

计算与语言 · 计算机科学 2020-12-01 Pan Zhou , Ruchao Fan , Wei Chen , Jia Jia

Most existing methods for depth estimation from a focal stack of images employ convolutional neural networks (CNNs) using 2D or 3D convolutions over a fixed set of images. However, their effectiveness is constrained by the local properties…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Xueyang Kang , Fengze Han , Abdur R. Fayjie , Patrick Vandewalle , Kourosh Khoshelham , Dong Gong

Nonlocal self-similarity within images has become an increasingly popular prior in deep-learning models. Despite their successful image restoration performance, such models remain largely uninterpretable due to their black-box construction.…

图像与视频处理 · 电气工程与系统科学 2026-02-06 Nikola Janjusevic , Amirhossein Khalilian-Gourtani , Adeen Flinker , Li Feng , Yao Wang

Dynamic graph learning plays a pivotal role in modeling evolving relationships over time, especially for temporal link prediction tasks in domains such as traffic systems, social networks, and recommendation platforms. While…

机器学习 · 计算机科学 2025-11-18 Tao Zou , Chengfeng Wu , Tianxi Liao , Junchen Ye , Bowen Du

Accurate spatio-temporal prediction is crucial for the sustainable development of smart cities. However, current approaches often struggle to capture important spatio-temporal relationships, particularly overlooking global relations among…

机器学习 · 计算机科学 2024-11-12 Ashutosh Sao , Simon Gottschalk

Accurate volumetric image registration is highly relevant for clinical routines and computer-aided medical diagnosis. Recently, researchers have begun to use transformers in learning-based methods for medical image registration, and have…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Ahsan Raza Siyal , Astrid Ellen Grams , Markus Haltmeier

This paper studies 3D low-dose computed tomography (CT) imaging. Although various deep learning methods were developed in this context, typically they focus on 2D images and perform denoising due to low-dose and deblurring for…

图像与视频处理 · 电气工程与系统科学 2024-01-10 Zhihao Chen , Chuang Niu , Qi Gao , Ge Wang , Hongming Shan

Structured illumination microscopy (SIM) is an optical super-resolution technique that enables live-cell imaging beyond the diffraction limit. Reconstruction of SIM data is prone to artefacts, which becomes problematic when imaging highly…

图像与视频处理 · 电气工程与系统科学 2022-03-02 Charles N. Christensen , Meng Lu , Edward N. Ward , Pietro Lio , Clemens F. Kaminski

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

机器学习 · 计算机科学 2021-08-19 Radostin Cholakov , Todor Kolev

Recently, Transformers have shown promising performance in various vision tasks. A challenging issue in Transformer design is that global self-attention is very expensive to compute, especially for the high-resolution vision tasks. Local…

计算机视觉与模式识别 · 计算机科学 2022-11-15 Zhemin Zhang , Xun Gong

Magnetic resonance imaging (MRI) is an essential diagnostic tool that suffers from prolonged scan times. Reconstruction methods can alleviate this limitation by recovering clinically usable images from accelerated acquisitions. In…

图像与视频处理 · 电气工程与系统科学 2023-01-09 Salman UH Dar , Şaban Öztürk , Muzaffer Özbey , Tolga Çukur

With the popularity of Transformer architectures in computer vision, the research focus has shifted towards developing computationally efficient designs. Window-based local attention is one of the major techniques being adopted in recent…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Ammarah Farooq , Muhammad Awais , Sara Ahmed , Josef Kittler

Attention mechanisms have become a popular component in deep neural networks, yet there has been little examination of how different influencing factors and methods for computing attention from these factors affect performance. Toward a…

计算机视觉与模式识别 · 计算机科学 2019-04-15 Xizhou Zhu , Dazhi Cheng , Zheng Zhang , Stephen Lin , Jifeng Dai

Transformer architecture has been very successful long runner in the field of Deep Learning (DL) and Large Language Models (LLM) because of its powerful attention-based learning and parallel-natured architecture. As the models grow gigantic…

机器学习 · 计算机科学 2026-01-21 Phani Kumar , Nyshadham , Jyothendra Varma , Polisetty V R K , Aditya Rathore

Magnetic resonance imaging (MRI) is a valuable clinical tool for displaying anatomical structures and aiding in accurate diagnosis. Medical image super-resolution (SR) reconstruction using deep learning techniques can enhance lesion…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Xin Hua , Zhijiang Du , Hongjian Yu , Jixin Maa

Transformer is a deep neural network that employs a self-attention mechanism to comprehend the contextual relationships within sequential data. Unlike conventional neural networks or updated versions of Recurrent Neural Networks (RNNs) such…

机器学习 · 计算机科学 2023-06-14 Saidul Islam , Hanae Elmekki , Ahmed Elsebai , Jamal Bentahar , Najat Drawel , Gaith Rjoub , Witold Pedrycz

Despite the widespread adoption of transformers in medical applications, the exploration of multi-scale learning through transformers remains limited, while hierarchical representations are considered advantageous for computer-aided medical…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Xiaoya Tang , Bodong Zhang , Man Minh Ho , Beatrice S. Knudsen , Tolga Tasdizen

This work introduces a Transformer-based image compression system. It has the flexibility to switch between the standard image reconstruction and the denoising reconstruction from a single compressed bitstream. Instead of training separate…

图像与视频处理 · 电气工程与系统科学 2024-02-21 Yi-Hsin Chen , Kuan-Wei Ho , Shiau-Rung Tsai , Guan-Hsun Lin , Alessandro Gnutti , Wen-Hsiao Peng , Riccardo Leonardi