English
Related papers

Related papers: ImageNet pre-trained models with batch normalizati…

200 papers

The success of deep neural networks (DNN) in machine perception applications such as image classification and speech recognition comes at the cost of high computation and storage complexity. Inference of uncompressed large scale DNN models…

Machine Learning · Computer Science 2020-07-06 Yihao Fang , Shervin Manzuri Shalmani , Rong Zheng

Deep Neural Networks (DNN) and especially Convolutional Neural Networks (CNN) are a de-facto standard for the analysis of large volumes of signals and images. Yet, their development and underlying principles have been largely performed in…

Information Theory · Computer Science 2022-03-24 Ljubisa Stankovic , Danilo Mandic

This paper revives Densely Connected Convolutional Networks (DenseNets) and reveals the underrated effectiveness over predominant ResNet-style architectures. We believe DenseNets' potential was overlooked due to untouched training methods…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Donghyun Kim , Byeongho Heo , Dongyoon Han

In this paper, we show that ImageNet-Pretrained standard deep CNN models can be used as strong baseline networks for audio classification. Even though there is a significant difference between audio Spectrogram and standard ImageNet image…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Kamalesh Palanisamy , Dipika Singhania , Angela Yao

Though recent advanced convolutional neural networks (CNNs) have been improving the image recognition accuracy, the models are getting more complex and time-consuming. For real-world applications in industrial and commercial scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-05 Kaiming He , Jian Sun

Automated design methods for convolutional neural networks (CNNs) have recently been developed in order to increase the design productivity. We propose a neuroevolution method capable of evolving and optimizing CNNs with respect to the…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Filip Badan , Lukas Sekanina

Convolutional Neural Networks have become state of the art methods for image classification over the last couple of years. By now they perform better than human subjects on many of the image classification datasets. Most of these datasets…

Computer Vision and Pattern Recognition · Computer Science 2017-08-28 Sebastian Stabinger , Antonio Rodriguez-Sanchez

This article surveys convolution-based models including convolutional neural networks (CNNs), Conformers, ResNets, and CRNNs-as speech signal processing models and provide their statistical backgrounds and speech recognition, speaker…

Sound · Computer Science 2024-12-02 Nirmal Joshua Kapu , Raghav Karan

Automatic analysis of scanned historical documents comprises a wide range of image analysis tasks, which are often challenging for machine learning due to a lack of human-annotated learning samples. With the advent of deep neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Linda Studer , Michele Alberti , Vinaychandran Pondenkandath , Pinar Goktepe , Thomas Kolonko , Andreas Fischer , Marcus Liwicki , Rolf Ingold

ImageNet serves as the primary dataset for evaluating the quality of computer-vision models. The common practice today is training each architecture with a tailor-made scheme, designed and tuned by an expert. In this paper, we present a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Tal Ridnik , Hussam Lawen , Emanuel Ben-Baruch , Asaf Noy

We propose a new model for unsupervised document embedding. Leading existing approaches either require complex inference or use recurrent neural networks (RNN) that are difficult to parallelize. We take a different route and develop a…

Computation and Language · Computer Science 2018-02-21 Chundi Liu , Shunan Zhao , Maksims Volkovs

In this paper, we benchmark several existing graph neural network (GNN) models on different datasets for link predictions. In particular, the graph convolutional network (GCN), GraphSAGE, graph attention network (GAT) as well as variational…

Machine Learning · Computer Science 2021-02-26 Xing Wang , Alexander Vinel

Learned inverse problem solvers exhibit remarkable performance in applications like image reconstruction tasks. These data-driven reconstruction methods often follow a two-step scheme. First, one trains the often neural network-based…

A Capsule Network (CapsNet) is a relatively new classifier and one of the possible successors of Convolutional Neural Networks (CNNs). CapsNet maintains the spatial hierarchies between the features and outperforms CNNs at classifying images…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Pouya Shiri , Amirali Baniasadi

In recent years, the biggest advances in major Computer Vision tasks, such as object recognition, handwritten-digit identification, facial recognition, and many others., have all come through the use of Convolutional Neural Networks (CNNs).…

Computation and Language · Computer Science 2019-07-05 Elaina Tan , Lakshay Sharma

In this paper, we present a general framework for low-level vision tasks including image compression artifacts reduction and image denoising. Under this framework, a novel concatenated attention neural network (CANet) is specifically…

Image and Video Processing · Electrical Eng. & Systems 2020-06-22 Tian YingJie , Wang YiQi , Yang LinRui , Qi ZhiQuan

Learning image representations with ConvNets by pre-training on ImageNet has proven useful across many visual understanding tasks including object detection, semantic segmentation, and image captioning. Although any image representation can…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Du Tran , Jamie Ray , Zheng Shou , Shih-Fu Chang , Manohar Paluri

To understand the real world using various types of data, Artificial Intelligence (AI) is the most used technique nowadays. While finding the pattern within the analyzed data represents the main task. This is performed by extracting…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Omar Elharrouss , Younes Akbari , Noor Almaadeed , Somaya Al-Maadeed

The convolutional neural network (CNN) has become a basic model for solving many computer vision problems. In recent years, a new class of CNNs, recurrent convolution neural network (RCNN), inspired by abundant recurrent connections in the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Jianfeng Wang , Xiaolin Hu

Deep Convolutional Neural Networks (CNNs) have significantly advanced deep learning, driving breakthroughs in computer vision, natural language processing, medical diagnosis, object detection, and speech recognition. Architectural…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Saddam Hussain Khan , Rashid Iqbal