English
Related papers

Related papers: Reusing Convolutional Neural Network Models throug…

200 papers

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

Machine Learning · Computer Science 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright

Building large models with parameter sharing accounts for most of the success of deep convolutional neural networks (CNNs). In this paper, we propose doubly convolutional neural networks (DCNNs), which significantly improve the performance…

Machine Learning · Computer Science 2016-11-01 Shuangfei Zhai , Yu Cheng , Weining Lu , Zhongfei Zhang

Deep artificial neural networks have made remarkable progress in different tasks in the field of computer vision. However, the empirical analysis of these models and investigation of their failure cases has received attention recently. In…

Computer Vision and Pattern Recognition · Computer Science 2016-02-10 Babak Saleh , Ahmed Elgammal , Jacob Feldman

Recently, deep convolutional neural networks (CNNs) have achieved many eye-catching results. However, deploying CNNs on resource-constrained edge devices is constrained by limited memory bandwidth for transmitting large intermediated data…

Image and Video Processing · Electrical Eng. & Systems 2022-07-20 Yu-Shan Tai , Cheng-Yang Chang , Chieh-Fang Teng , AnYeu , Wu

This paper proposes a straightforward and cost-effective approach to assess whether a deep neural network (DNN) relies on the primary concepts of training samples or simply learns discriminative, yet simple and irrelevant features that can…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Mohammad Mahdi Mehmanchi , Mahbod Nouri , Mohammad Sabokrou

Classification and clustering have been studied separately in machine learning and computer vision. Inspired by the recent success of deep learning models in solving various vision problems (e.g., object recognition, semantic segmentation)…

Machine Learning · Computer Science 2017-12-13 Ali Borji , Aysegul Dundar

Convolutional Neural Networks (CNNs) are the state-of-the-art algorithms for the processing of images. However the configuration and training of these networks is a complex task requiring deep domain knowledge, experience and much trial and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Yaron Strauch , Jo Grundy

Image restoration from a single image degradation type, such as blurring, hazing, random noise, and compression has been investigated for decades. However, image degradations in practice are often a mixture of several types of degradation.…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Kazutaka Uchida , Masayuki Tanaka , Masatoshi Okutomi

Deformable part models (DPMs) and convolutional neural networks (CNNs) are two widely used tools for visual recognition. They are typically viewed as distinct approaches: DPMs are graphical models (Markov random fields), while CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2014-10-02 Ross Girshick , Forrest Iandola , Trevor Darrell , Jitendra Malik

Deep neural network (DNN) models have become increasingly crucial components in intelligent software systems. However, training a DNN model is typically expensive in terms of both time and money. To address this issue, researchers have…

Machine Learning · Computer Science 2023-10-06 Binhang Qi , Hailong Sun , Hongyu Zhang , Ruobing Zhao , Xiang Gao

Neural networks are very powerful learning systems, but they do not readily generalize from one task to the other. This is partly due to the fact that they do not learn in a compositional way, that is, by discovering skills that are shared…

Artificial Intelligence · Computer Science 2018-07-27 Adam Liška , Germán Kruszewski , Marco Baroni

Waste recycling is an important way of saving energy and materials in the production process. In general cases recyclable objects are mixed with unrecyclable objects, which raises a need for identification and classification. This paper…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Yuheng Wang , Wen Jie Zhao , Jiahui Xu , Raymond Hong

With the growing incorporation of deep neural network (DNN) models into modern software systems, the prohibitive construction costs have become a significant challenge. Model reuse has been widely applied to reduce training costs, but…

Machine Learning · Computer Science 2025-08-18 Xiaohan Bi , Binhang Qi , Hailong Sun , Xiang Gao , Yue Yu , Xiaojun Liang

Recent years have witnessed the great success of convolutional neural network (CNN) based models in the field of computer vision. CNN is able to learn hierarchically abstracted features from images in an end-to-end training manner. However,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Xin Li , Zequn Jie , Jiashi Feng , Changsong Liu , Shuicheng Yan

The advancement of deep convolutional neural networks (DCNNs) has driven significant improvement in the accuracy of recognition systems for many computer vision tasks. However, their practical applications are often restricted in…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiaxin Gu , Ce Li , Baochang Zhang , Jungong Han , Xianbin Cao , Jianzhuang Liu , David Doermann

While some convolutional neural networks (CNNs) have surpassed human visual abilities in object classification, they often struggle to recognize objects in images corrupted with different types of common noise patterns, highlighting a major…

Image and Video Processing · Electrical Eng. & Systems 2021-12-09 Avinash Baidya , Joel Dapello , James J. DiCarlo , Tiago Marques

Deep neural networks (DNNs) are successful in many computer vision tasks. However, the most accurate DNNs require millions of parameters and operations, making them energy, computation and memory intensive. This impedes the deployment of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Abhinav Goel , Caleb Tung , Yung-Hsiang Lu , George K. Thiruvathukal

Large capacity deep learning models are often prone to a high generalization gap when trained with a limited amount of labeled training data. A recent class of methods to address this problem uses various ways to construct a new training…

Machine Learning · Computer Science 2023-01-10 Mojtaba Faramarzi , Mohammad Amini , Akilesh Badrinaaraayanan , Vikas Verma , Sarath Chandar

Recently convolutional neural networks (CNNs) achieve great accuracy in visual recognition tasks. DenseNet becomes one of the most popular CNN models due to its effectiveness in feature-reuse. However, like other CNN models, DenseNets also…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Kun Wan , Boyuan Feng , Lingwei Xie , Yufei Ding

Deep convolutional neural networks (CNNs) with a large number of parameters require intensive computational resources, and thus are hard to be deployed in resource-constrained platforms. Decomposition-based methods, therefore, have been…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Shaowu Chen , Jiahao Zhou , Weize Sun , Lei Huang