English
Related papers

Related papers: Combining Deep Learning with Good Old-Fashioned Ma…

200 papers

In this work we propose a framework for improving the performance of any deep neural network that may suffer from vanishing gradients. To address the vanishing gradient issue, we study a framework, where we insert an intermediate output…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Yi Zhou , Yue Bai , Shuvra S. Bhattacharyya , Heikki Huttunen

Very deep convolutional networks with hundreds of layers have led to significant reductions in error on competitive benchmarks. Although the unmatched expressiveness of the many layers can be highly desirable at test time, training very…

Machine Learning · Computer Science 2016-08-01 Gao Huang , Yu Sun , Zhuang Liu , Daniel Sedra , Kilian Weinberger

A generative Bayesian model is developed for deep (multi-layer) convolutional dictionary learning. A novel probabilistic pooling operation is integrated into the deep model, yielding efficient bottom-up and top-down probabilistic learning.…

Machine Learning · Statistics 2015-02-24 Yunchen Pu , Xin Yuan , Lawrence Carin

Deep neural networks have achieved increasingly accurate results on a wide variety of complex tasks. However, much of this improvement is due to the growing use and availability of computational resources (e.g use of GPUs, more layers, more…

Machine Learning · Computer Science 2018-08-03 Ini Oguntola , Subby Olubeko , Christopher Sweeney

In this article, we take one step toward understanding the learning behavior of deep residual networks, and supporting the observation that deep residual networks behave like ensembles. We propose a new convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Masoud Abdi , Saeid Nahavandi

Deep clustering which adopts deep neural networks to obtain optimal representations for clustering has been widely studied recently. In this paper, we propose a novel deep image clustering framework to learn a category-style latent…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Junjie Zhao , Donghuan Lu , Kai Ma , Yu Zhang , Yefeng Zheng

In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap…

Machine Learning · Computer Science 2019-05-20 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Various architectures (such as GoogLeNets, ResNets, and DenseNets) have been proposed. However, the existing networks usually suffer from either redundancy of convolutional layers or insufficient utilization of parameters. To handle these…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Zhiyu Zhu , Zhen-Peng Bian , Junhui Hou , Yi Wang , Lap-Pui Chau

Deep metric learning maps visually similar images onto nearby locations and visually dissimilar images apart from each other in an embedding manifold. The learning process is mainly based on the supplied image negative and positive training…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Chang-Hui Liang , Wan-Lei Zhao , Run-Qing Chen

Deep learning has arguably achieved tremendous success in recent years. In simple words, deep learning uses the composition of many nonlinear functions to model the complex dependency between input features and labels. While neural networks…

Machine Learning · Statistics 2019-04-16 Jianqing Fan , Cong Ma , Yiqiao Zhong

Intermediate features at different layers of a deep neural network are known to be discriminative for visual patterns of different complexities. However, most existing works ignore such cross-layer heterogeneities when classifying samples…

Computer Vision and Pattern Recognition · Computer Science 2016-07-20 Xiaojie Jin , Yunpeng Chen , Jian Dong , Jiashi Feng , Shuicheng Yan

Image denoising is a classical problem in low level computer vision. Model-based optimization methods and deep learning approaches have been the two main strategies for solving the problem. Model-based optimization methods are flexible for…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Chang Liu , Zhaowei Shang , Anyong Qin

Deep learning architectures are showing great promise in various computer vision domains including image classification, object detection, event detection and action recognition. In this study, we investigate various aspects of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-08 Hilal Ergun , Mustafa Sert

In the space of only a few years, deep generative modeling has revolutionized how we think of artificial creativity, yielding autonomous systems which produce original images, music, and text. Inspired by these successes, researchers are…

Machine Learning · Computer Science 2019-05-24 Daniel C. Elton , Zois Boukouvalas , Mark D. Fuge , Peter W. Chung

Machine learning is making substantial progress in diverse applications. The success is mostly due to advances in deep learning. However, deep learning can make mistakes and its generalization abilities to new tasks are questionable. We ask…

Deep learning models have been very successful in computer vision and image processing applications. Since its inception, Many top-performing methods for image segmentation are based on deep CNN models. However, deep CNN models fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Ranju Mandal , Basim Azam , Brijesh Verma , Mengjie Zhang

Deep Convolutional Neural Networks (CNNs) are capable of learning unprecedentedly effective features from images. Some researchers have struggled to enhance the parameters' efficiency using grouped convolution. However, the relation between…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Yujia Chen , Ce Li

The effectiveness of machine learning algorithms arises from being able to extract useful features from large amounts of data. As model and dataset sizes increase, dataset distillation methods that compress large datasets into significantly…

Machine Learning · Computer Science 2022-01-19 Timothy Nguyen , Roman Novak , Lechao Xiao , Jaehoon Lee

Automated Machine Learning with ensembling (or AutoML with ensembling) seeks to automatically build ensembles of Deep Neural Networks (DNNs) to achieve qualitative predictions. Ensemble of DNNs are well known to avoid over-fitting but they…

Machine Learning · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

Machine unlearning (MU) aims to remove the influence of particular data points from the learnable parameters of a trained machine learning model. This is a crucial capability in light of data privacy requirements, trustworthiness, and…

Machine Learning · Computer Science 2025-07-01 Xavier F. Cadet , Anastasia Borovykh , Mohammad Malekzadeh , Sara Ahmadi-Abhari , Hamed Haddadi