English
Related papers

Related papers: A Multi-Head Convolutional Neural Network With Mul…

200 papers

Convolutional Neural Networks (CNNs) have been the standard for image classification tasks for a long time, but more recently attention-based mechanisms have gained traction. This project aims to compare traditional CNNs with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Nikhil Kapila , Julian Glattki , Tejas Rathi

Deep Convolutional Neural Networks (CNNs) have been successfully used in many low-level vision problems like image denoising. Although the conditional image generation techniques have led to large improvements in this task, there has been…

Image and Video Processing · Electrical Eng. & Systems 2020-03-10 Ioannis Marras , Grigorios G. Chrysos , Ioannis Alexiou , Gregory Slabaugh , Stefanos Zafeiriou

As one of the major branches of automatic speech recognition, attention-based models greatly improves the feature representation ability of the model. In particular, the multi-head mechanism is employed in the attention, hoping to learn…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-24 Kai Liu , Hailiang Xiong , Gangqiang Yang , Zhengfeng Du , Yewen Cao , Danyal Shah

Neural networks are highly effective tools for image reconstruction problems such as denoising and compressive sensing. To date, neural networks for image reconstruction are almost exclusively convolutional. The most popular architecture is…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Youssef Mansour , Kang Lin , Reinhard Heckel

In image classification task, feature extraction is always a big issue. Intra-class variability increases the difficulty in designing the extractors. Furthermore, hand-crafted feature extractor cannot simply adapt new situation. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Chieh-Ning Fang , Chin-Teng Lin

In recent years, deep convolutional neural networks (CNNs) have shown record-shattering performance in a variety of computer vision problems, such as visual object recognition, detection and segmentation. These methods have also been…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Jose Bernal , Kaisar Kushibar , Daniel S. Asfaw , Sergi Valverde , Arnau Oliver , Robert Martí , Xavier Lladó

While deep convolutional neural networks (CNNs) have shown a great success in single-label image classification, it is important to note that real world images generally contain multiple labels, which could correspond to different objects,…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Jiang Wang , Yi Yang , Junhua Mao , Zhiheng Huang , Chang Huang , Wei Xu

With the powerfulness of convolution neural networks (CNN), CNN based face reconstruction has recently shown promising performance in reconstructing detailed face shape from 2D face images. The success of CNN-based methods relies on a large…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 Yudong Guo , Juyong Zhang , Jianfei Cai , Boyi Jiang , Jianmin Zheng

Efficiently capturing multi-scale information and building long-range dependencies among pixels are essential for medical image segmentation because of the various sizes and shapes of the lesion regions or organs. In this paper, we present…

Image and Video Processing · Electrical Eng. & Systems 2025-04-18 Hao Shao , Quansheng Zeng , Qibin Hou , Jufeng Yang

We explore an innovative strategy for image denoising by using convolutional neural networks (CNN) to learn similar pixel-distribution features from noisy images. Many types of image noise follow a certain pixel-distribution in common, such…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Peng Liu , Ruogu Fang

Neural networks equipped with self-attention have parallelizable computation, light-weight structure, and the ability to capture both long-range and local dependencies. Further, their expressive power and performance can be boosted by using…

Computation and Language · Computer Science 2019-03-27 Tao Shen , Tianyi Zhou , Guodong Long , Jing Jiang , Chengqi Zhang

A convolutional layer in a Convolutional Neural Network (CNN) consists of many filters which apply convolution operation to the input, capture some special patterns and pass the result to the next layer. If the same patterns also occur at…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Okan Köpüklü , Maryam Babaee , Stefan Hörmann , Gerhard Rigoll

More and more evidence has shown that strengthening layer interactions can enhance the representation power of a deep neural network, while self-attention excels at learning interdependencies by retrieving query-activated information.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Yanwen Fang , Yuxi Cai , Jintai Chen , Jingyu Zhao , Guangjian Tian , Guodong Li

Previous works have shown that convolutional neural networks can achieve good performance in image denoising tasks. However, limited by the local rigid convolutional operation, these methods lead to oversmoothing artifacts. A deeper network…

Image and Video Processing · Electrical Eng. & Systems 2020-07-15 Meng Chang , Qi Li , Huajun Feng , Zhihai Xu

Since the beginning of this decade, CNN has been a very successful tool in the field of Computer Vision tasks.The invention of CNN was inspired from neuroscience and it shares a lot of anatomical similarities with our visual system.Inspired…

Image and Video Processing · Electrical Eng. & Systems 2020-10-12 Kaushik Das , Qianni Zhang

Despite the growing success of Convolution neural networks (CNN) in the recent past in the task of scene segmentation, the standard models lack some of the important features that might result in sub-optimal segmentation outputs. The widely…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Soham Chattopadhyay , Hritam Basak

Object detection, one of the three main tasks of computer vision, has been used in various applications. The main process is to use deep neural networks to extract the features of an image and then use the features to identify the class and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Wenshuo Li

Deep neural networks are representation learning techniques. During training, a deep net is capable of generating a descriptive language of unprecedented size and detail in machine learning. Extracting the descriptive language coded within…

Neural and Evolutionary Computing · Computer Science 2018-01-30 Dario Garcia-Gasulla , Ferran Parés , Armand Vilalta , Jonatan Moreno , Eduard Ayguadé , Jesús Labarta , Ulises Cortés , Toyotaro Suzumura

Convolutional Neural Networks demonstrate high performance on ImageNet Large-Scale Visual Recognition Challenges contest. Nevertheless, the published results only show the overall performance for all image classes. There is no further…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Mingming Wang

Real-world blind denoising poses a unique image restoration challenge due to the non-deterministic nature of the underlying noise distribution. Prevalent discriminative networks trained on synthetic noise models have been shown to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Junaid Malik , Serkan Kiranyaz , Mehmet Yamac , Esin Guldogan , Moncef Gabbouj