English
Related papers

Related papers: The mechanism underlying successful deep learning

200 papers

Deep learning relies on a very specific kind of neural networks: those superposing several neural layers. In the last few years, deep learning achieved major breakthroughs in many tasks such as image analysis, speech recognition, natural…

Artificial Intelligence · Computer Science 2018-02-01 Lê Nguyên Hoang , Rachid Guerraoui

Deep Learning (DL) has been widely adopted in diverse industrial domains, including autonomous driving, intelligent healthcare, and aided programming. Like traditional software, DL systems are also prone to faults, whose malfunctioning may…

Machine Learning · Computer Science 2026-01-01 Hanmo You , Zan Wang , Zishuo Dong , Luanqi Mo , Jianjun Zhao , Junjie Chen

Deep convolutional neural networks (CNNs) have been actively adopted in the field of music information retrieval, e.g. genre classification, mood detection, and chord recognition. However, the process of learning and prediction is little…

Machine Learning · Computer Science 2016-07-11 Keunwoo Choi , George Fazekas , Mark Sandler

Deep learning models have been efficient lately on image parsing tasks. However, deep learning models are not fully capable of exploiting visual and contextual information simultaneously. The proposed three-layer context-based deep…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Ranju Mandal , Basim Azam , Brijesh Verma

The goal of our research is to develop methods advancing automatic visual recognition. In order to predict the unique or multiple labels associated to an image, we study different kind of Deep Neural Networks architectures and methods for…

Computer Vision and Pattern Recognition · Computer Science 2016-10-19 Rémi Cadène , Nicolas Thome , Matthieu Cord

Deep learning (DL) allows computer models to learn, visualize, optimize, refine, and predict data. To understand its present state, examining the most recent advancements and applications of deep learning across various domains is…

The task of labeling data for training deep neural networks is daunting and tedious, requiring millions of labels to achieve the current state-of-the-art results. Such reliance on large amounts of labeled data can be relaxed by exploiting…

Machine Learning · Computer Science 2016-02-17 Aysegul Dundar , Jonghoon Jin , Eugenio Culurciello

Place classification is a fundamental ability that a robot should possess to carry out effective human-robot interactions. It is a nontrivial classification problem which has attracted many research. In recent years, there is a high…

Robotics · Computer Science 2015-06-15 Yiyi Liao , Sarath Kodagoda , Yue Wang , Lei Shi , Yong Liu

To adapt to real-world data streams, continual learning (CL) systems must rapidly learn new concepts while preserving and utilizing prior knowledge. When it comes to adding new information to continually-trained deep neural networks (DNNs),…

Machine Learning · Computer Science 2025-07-02 Md Yousuf Harun , Christopher Kanan

Deep learning (DL) has proven to be a highly effective approach for developing models in diverse contexts, including visual perception, speech recognition, and machine translation. However, the end-to-end process for applying DL is not…

Machine Learning · Computer Science 2022-05-18 Xuanyi Dong , David Jacob Kedziora , Katarzyna Musial , Bogdan Gabrys

This paper presents a comparison of several Convolutional Neural Network (CNN) models for extracting target signals in highly noisy measurement conditions. Four CNN architectures were investigated. The first comprises six consecutive…

Signal Processing · Electrical Eng. & Systems 2024-10-11 Andrea Faúndez Quezada , Salvatore La Cavera , Sidahmed A Abayzeed

Traditionally, deep convolutional neural networks consist of a series of convolutional and pooling layers followed by one or more fully connected (FC) layers to perform the final classification. While this design has been successful, for…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Zhongchao Qian , Tyler L. Hayes , Kushal Kafle , Christopher Kanan

Unlike areas such as computer vision and speech recognition where convolutional and recurrent neural networks-based approaches have proven effective to the nature of the respective areas of application, deep learning (DL) still lacks a…

Signal Processing · Electrical Eng. & Systems 2021-05-14 Khalid Youssef , Greg Schuette , Yubin Cai , Daisong Zhang , Yikun Huang , Yahya Rahmat-Samii , Louis-S. Bouchard

Deep Learning (DL) has had an immense success in the recent past, leading to state-of-the-art results in various domains such as image recognition and natural language processing. One of the reasons for this success is the increasing size…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-26 Ruben Mayer , Hans-Arno Jacobsen

The great success of deep learning has stimulated avid research activities in verifying the power of depth in theory, a common consensus of which is that deep net are versatile in approximating and learning numerous functions. Such a…

Machine Learning · Computer Science 2025-03-25 Feilong Cao , Shao-Bo Lin

Self-explaining models are models that reveal decision making parameters in an interpretable manner so that the model reasoning process can be directly understood by human beings. General Linear Models (GLMs) are self-explaining because the…

Machine Learning · Computer Science 2019-05-31 Yingjing Lu , Runde Yang

In this work, we investigate the value of employing deep learning for the task of wireless signal modulation recognition. Recently in [1], a framework has been introduced by generating a dataset using GNU radio that mimics the imperfections…

Machine Learning · Computer Science 2018-01-08 Xiaoyu Liu , Diyu Yang , Aly El Gamal

Current learning algorithms face many difficulties in learning simple patterns and using them to learn more complex ones. They also require more examples than humans do to learn the same pattern, assuming no prior knowledge. In this paper,…

Artificial Intelligence · Computer Science 2016-05-03 Basem G. El-Barashy

Sequence labeling (SL) is a fundamental research problem encompassing a variety of tasks, e.g., part-of-speech (POS) tagging, named entity recognition (NER), text chunking, etc. Though prevalent and effective in many downstream applications…

Computation and Language · Computer Science 2020-11-16 Zhiyong He , Zanbo Wang , Wei Wei , Shanshan Feng , Xianling Mao , Sheng Jiang

Deep-learning (DL) has emerged as a powerful machine-learning technique for several classic problems encountered in generic wireless communications. Specifically, random Fourier Features (RFF) based deep-learning has emerged as an…

Information Theory · Computer Science 2021-01-14 Rangeet Mitra , Georges Kaddoum