English
Related papers

Related papers: UPANets: Learning from the Universal Pixel Attenti…

200 papers

U-Net models with encoder, decoder, and skip-connections components have demonstrated effectiveness in a variety of vision tasks. The skip-connections transmit fine-grained information from the encoder to the decoder. It is necessary to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Lingxiao Yin , Wei Tao , Dongyue Zhao , Tadayuki Ito , Kinya Osa , Masami Kato , Tse-Wei Chen

Vision transformers are known to be more computationally and data-intensive than CNN models. These transformer models such as ViT, require all the input image tokens to learn the relationship among them. However, many of these tokens are…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Foozhan Ataiefard , Walid Ahmed , Habib Hajimolahoseini , Saina Asani , Farnoosh Javadi , Mohammad Hassanpour , Omar Mohamed Awad , Austin Wen , Kangling Liu , Yang Liu

The UNet architecture, based on Convolutional Neural Networks (CNN), has demonstrated its remarkable performance in medical image analysis. However, it faces challenges in capturing long-range dependencies due to the limited receptive…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Liang Xu , Mingxiao Chen , Yi Cheng , Pengfei Shao , Shuwei Shen , Peng Yao , Ronald X. Xu

Nowadays, pre-trained encoders are widely used in medical image segmentation due to their strong capability in extracting rich and generalized feature representations. However, existing methods often fail to fully leverage these features,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Xiaolin Gou , Chuanlin Liao , Jizhe Zhou , Fengshuo Ye , Yi Lin

Deep neural networks demonstrate to have a high performance on image classification tasks while being more difficult to train. Due to the complexity and vanishing gradient problem, it normally takes a lot of time and more computational…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Mohammad Sadegh Ebrahimi , Hossein Karkeh Abadi

Top-performing landmark estimation algorithms are based on exploiting the excellent ability of large convolutional neural networks (CNNs) to represent local appearance. However, it is well known that they can only learn weak spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Andrés Prados-Torreblanca , José M. Buenaposada , Luis Baumela

Transformer attention architectures, similar to those developed for natural language processing, have recently proved efficient also in vision, either in conjunction with or as a replacement for convolutional layers. Typically, visual…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Rufin VanRullen , Andrea Alamia

The space of task-agnostic feature upsampling has emerged as a promising area of research to efficiently create denser features from pre-trained visual backbones. These methods act as a shortcut to achieve dense features for a fraction of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Matthew Walmer , Saksham Suri , Anirud Aggarwal , Abhinav Shrivastava

The reliability of using fully convolutional networks (FCNs) has been successfully demonstrated by recent studies in many speech applications. One of the most popular variants of these FCNs is the `U-Net', which is an encoder-decoder…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-10 Vinay Kothapally , Wei Xia , Shahram Ghorbani , John H. L. Hansen , Wei Xue , Jing Huang

As the revolutionary improvement being made on the performance of smartphones over the last decade, mobile photography becomes one of the most common practices among the majority of smartphone users. However, due to the limited size of…

Image and Video Processing · Electrical Eng. & Systems 2020-09-15 Linhui Dai , Xiaohong Liu , Chengqi Li , Jun Chen

In recent years, significant progress has been made on the research of crowd counting. However, as the challenging scale variations and complex scenes existed in crowds, neither traditional convolution networks nor recent Transformer…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Xing Wei , Yuanrui Kang , Jihao Yang , Yunfeng Qiu , Dahu Shi , Wenming Tan , Yihong Gong

The increase of available large clinical and experimental datasets has contributed to a substantial amount of important contributions in the area of biomedical image analysis. Image segmentation, which is crucial for any quantitative…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Nikhil Kumar Tomar , Debesh Jha , Michael A. Riegler , Håvard D. Johansen , Dag Johansen , Jens Rittscher , Pål Halvorsen , Sharib Ali

Superpixels are higher-order perceptual groups of pixels in an image, often carrying much more information than the raw pixels. There is an inherent relational structure to the relationship among different superpixels of an image such as…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Gunjan Chhablani , Abheesht Sharma , Harshit Pandey , Tirtharaj Dash

The U-shaped encoder-decoder architecture with skip connections has become a prevailing paradigm in medical image segmentation due to its simplicity and effectiveness. While many recent works aim to improve this framework by designing more…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jing Huang , Yongkang Zhao , Yuhan Li , Zhitao Dai , Cheng Chen , Qiying Lai

The UNet model consists of fully convolutional network (FCN) layers arranged as contracting encoder and upsampling decoder maps. Nested arrangements of these encoder and decoder maps give rise to extensions of the UNet model, such as UNete…

Image and Video Processing · Electrical Eng. & Systems 2023-04-11 Yilong Yang , Srinandan Dasmahapatra , Sasan Mahmoodi

Benefiting from powerful convolutional neural networks (CNNs), learning-based image inpainting methods have made significant breakthroughs over the years. However, some nature of CNNs (e.g. local prior, spatially shared parameters) limit…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Ye Deng , Siqi Hui , Sanping Zhou , Deyu Meng , Jinjun Wang

Convolutional neural networks (CNNs) have been widely used for hyperspectral image classification. As a common process, small cubes are firstly cropped from the hyperspectral image and then fed into CNNs to extract spectral and spatial…

Image and Video Processing · Electrical Eng. & Systems 2020-06-15 Renlong Hang , Zhu Li , Qingshan Liu , Pedram Ghamisi , Shuvra S. Bhattacharyya

Since the beginning of this decade, CNN has been a very successful tool in the field of Computer Vision tasks.The invention of CNN was inspired from neuroscience and it shares a lot of anatomical similarities with our visual system.Inspired…

Image and Video Processing · Electrical Eng. & Systems 2020-10-12 Kaushik Das , Qianni Zhang

In recent years, transformer-based deep learning networks have gained popularity in Hyperspectral (HS) unmixing applications due to their superior performance. The attention mechanism within transformers facilitates input-dependent…

Automated histopathological image analysis plays a vital role in computer-aided diagnosis of various diseases. Among developed algorithms, deep learning-based approaches have demonstrated excellent performance in multiple tasks, including…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Nima Torbati , Anastasia Meshcheryakova , Ramona Woitek , Diana Mechtcheriakova , Amirreza Mahbod