English
Related papers

Related papers: Examining and Mitigating Kernel Saturation in Conv…

200 papers

Prior work has shown Convolutional Neural Networks (CNNs) trained on surrogate Computer Aided Design (CAD) models are able to detect and classify real-world artefacts from photographs. The applications of which support twinning of digital…

Machine Learning · Computer Science 2021-06-07 Ric Real , James Gopsill , David Jones , Chris Snider , Ben Hicks

Though recent advanced convolutional neural networks (CNNs) have been improving the image recognition accuracy, the models are getting more complex and time-consuming. For real-world applications in industrial and commercial scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-05 Kaiming He , Jian Sun

Noise injection is a fundamental tool for data augmentation, and yet there is no widely accepted procedure to incorporate it with learning frameworks. This study analyzes the effects of adding or applying different noise models of varying…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 M. Eren Akbiyik

Nowadays, deep learning methods, especially the convolutional neural networks (CNNs), have shown impressive performance on extracting abstract and high-level features from the hyperspectral image. However, general training process of CNNs…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Zhiqiang Gong , Ping Zhong , Weidong Hu

Quantized CNN inference on ultra-low-power MCUs incurs unnecessary computations in neurons that produce saturated output values. These values are too extreme and are eventually clamped to the boundaries allowed by the neuron. Often times,…

Systems and Control · Electrical Eng. & Systems 2026-02-27 Shiming Li , Luca Mottola , Yuan Yao , Stefanos Kaxiras

Convolutional Neural Networks (CNNs) are state-of-the-art models for document image classification tasks. However, many of these approaches rely on parameters and architectures designed for classifying natural images, which differ from…

Computer Vision and Pattern Recognition · Computer Science 2017-08-11 Chris Tensmeyer , Tony Martinez

Scaling machine learning methods to very large datasets has attracted considerable attention in recent years, thanks to easy access to ubiquitous sensing and data from the web. We study face recognition and show that three distinct…

Computer Vision and Pattern Recognition · Computer Science 2015-04-21 Yaniv Taigman , Ming Yang , Marc'Aurelio Ranzato , Lior Wolf

It has been observed that Convolutional Neural Networks (CNNs) suffer from redundancy in feature maps, leading to inefficient capacity utilization. Efforts to address this issue have largely focused on kernel orthogonality method. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Zakariae Belmekki , Jun Li , Patrick Reuter , David Antonio Gómez Jáuregui , Karl Jenkins

Large CNNs have delivered impressive performance in various computer vision applications. But the storage and computation requirements make it problematic for deploying these models on mobile devices. Recently, tensor decompositions have…

Machine Learning · Computer Science 2016-02-16 Cheng Tai , Tong Xiao , Yi Zhang , Xiaogang Wang , Weinan E

Convolutional neural networks (CNNs) are the cutting edge model for supervised machine learning in computer vision. In recent years CNNs have outperformed traditional approaches in many computer vision tasks such as object detection, image…

Neural and Evolutionary Computing · Computer Science 2016-03-01 Nitzan Guberman

Deep neural networks are representation learning techniques. During training, a deep net is capable of generating a descriptive language of unprecedented size and detail in machine learning. Extracting the descriptive language coded within…

Neural and Evolutionary Computing · Computer Science 2018-01-30 Dario Garcia-Gasulla , Ferran Parés , Armand Vilalta , Jonatan Moreno , Eduard Ayguadé , Jesús Labarta , Ulises Cortés , Toyotaro Suzumura

Given a degraded input image, image restoration aims to recover the missing high-quality image content. Numerous applications demand effective image restoration, e.g., computational photography, surveillance, autonomous vehicles, and remote…

Image and Video Processing · Electrical Eng. & Systems 2022-05-04 Syed Waqas Zamir , Aditya Arora , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Ming-Hsuan Yang , Ling Shao

Convolutional Neural Networks (CNNs) are powerful models that achieve impressive results for image classification. In addition, pre-trained CNNs are also useful for other computer vision tasks as generic feature extractors. This paper aims…

Computer Vision and Pattern Recognition · Computer Science 2015-07-10 Ben Athiwaratkun , Keegan Kang

Modern neural networks are usually highly over-parameterized. Behind the wide usage of over-parameterized networks is the belief that, if the data are simple, then the trained network will be automatically equivalent to a simple predictor.…

Machine Learning · Statistics 2025-04-14 Chenyang Zhang , Peifeng Gao , Difan Zou , Yuan Cao

We propose a local modelling approach using deep convolutional neural networks (CNNs) for fine-grained image classification. Recently, deep CNNs trained from large datasets have considerably improved the performance of object recognition.…

Computer Vision and Pattern Recognition · Computer Science 2015-03-02 ZongYuan Ge , Chris McCool , Conrad Sanderson , Peter Corke

Semantic labeling (or pixel-level land-cover classification) in ultra-high resolution imagery (< 10cm) requires statistical models able to learn high level concepts from spatial data, with large appearance variations. Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2017-03-08 Michele Volpi , Devis Tuia

Toward a deeper understanding on the inner work of deep neural networks, we investigate CNN (convolutional neural network) using DCN (deconvolutional network) and randomization technique, and gain new insights for the intrinsic property of…

Computer Vision and Pattern Recognition · Computer Science 2018-02-21 Kun He , Jingbo Wang , Haochuan Li , Yao Shu , Mengxiao Zhang , Man Zhu , Liwei Wang , John E. Hopcroft

This paper presents a deep learning approach for the classification of Engineering (CAD) models using Convolutional Neural Networks (CNNs). Owing to the availability of large annotated datasets and also enough computational power in the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Bharadwaj Manda , Pranjal Bhaskare , Ramanathan Muthuganapathy

Convolutional Networks have dominated the field of computer vision for the last ten years, exhibiting extremely powerful feature extraction capabilities and outstanding classification performance. The main strategy to prolong this trend…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Javier Huertas-Tato , Alejandro Martín , Julián Fierrez , David Camacho

Deep Neural Networks (DNNs) and Convolutional Neural Networks (CNNs) are useful for many practical tasks in machine learning. Synaptic weights, as well as neuron activation functions within the deep network are typically stored with…

Machine Learning · Computer Science 2017-11-15 Moritz B. Milde , Daniel Neil , Alessandro Aimar , Tobi Delbruck , Giacomo Indiveri