English
Related papers

Related papers: Neither hype nor gloom do DNNs justice

200 papers

In the field of pattern recognition research, the method of using deep neural networks based on improved computing hardware recently attracted attention because of their superior accuracy compared to conventional methods. Deep neural…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Kyongsik Yun , Alexander Huyen , Thomas Lu

Fisher Vector classifiers and Deep Neural Networks (DNNs) are popular and successful algorithms for solving image classification problems. However, both are generally considered `black box' predictors as the non-linear transformations…

Computer Vision and Pattern Recognition · Computer Science 2015-12-02 Sebastian Bach , Alexander Binder , Grégoire Montavon , Klaus-Robert Müller , Wojciech Samek

Deep Neural Networks (DNNs) achieve state-of-the-art performance on numerous applications. However, it is difficult to tell beforehand if a DNN receiving an input will deliver the correct output since their decision criteria are usually…

Machine Learning · Computer Science 2021-09-07 Julia Lust , Alexandru Paul Condurache

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by additionally making use of graph structure based on the relational inductive bias (edge bias), rather than treating the nodes as collections of independent and identically…

Machine Learning · Computer Science 2023-11-07 Sitao Luan , Chenqing Hua , Qincheng Lu , Jiaqi Zhu , Xiao-Wen Chang , Doina Precup

Convolutional neural networks (CNNs) were inspired by early findings in the study of biological vision. They have since become successful tools in computer vision and state-of-the-art models of both neural activity and behavior on visual…

Neurons and Cognition · Quantitative Biology 2020-02-11 Grace W. Lindsay

This paper serves as a survey of recent advances in large margin training and its theoretical foundations, mostly for (nonlinear) deep neural networks (DNNs) that are probably the most prominent machine learning models for large-scale data…

Machine Learning · Computer Science 2021-06-22 Yiwen Guo , Changshui Zhang

Deep neural networks (NNs) are powerful black box predictors that have recently achieved impressive performance on a wide spectrum of tasks. Quantifying predictive uncertainty in NNs is a challenging and yet unsolved problem. Bayesian NNs,…

Machine Learning · Statistics 2017-11-07 Balaji Lakshminarayanan , Alexander Pritzel , Charles Blundell

Feedforward neural networks (FNNs) are typically viewed as pure prediction algorithms, and their strong predictive performance has led to their use in many machine-learning applications. However, their flexibility comes with an…

Methodology · Statistics 2023-11-15 Andrew McInerney , Kevin Burke

Deep neural networks are highly expressive models that have recently achieved state of the art performance on speech and visual recognition tasks. While their expressiveness is the reason they succeed, it also causes them to learn…

Computer Vision and Pattern Recognition · Computer Science 2014-02-20 Christian Szegedy , Wojciech Zaremba , Ilya Sutskever , Joan Bruna , Dumitru Erhan , Ian Goodfellow , Rob Fergus

Deep neural networks (DNNs) achieve state-of-the-art performance in many areas, including computer vision, system configuration, and question-answering. However, DNNs are expensive to develop, both in intellectual effort (e.g., devising new…

Software Engineering · Computer Science 2024-04-26 James C. Davis , Purvish Jajal , Wenxin Jiang , Taylor R. Schorlemmer , Nicholas Synovic , George K. Thiruvathukal

The currently dominating artificial intelligence and machine learning technology, neural networks, builds on inductive statistical learning. Neural networks of today are information processing systems void of understanding and reasoning…

Artificial Intelligence · Computer Science 2022-08-26 Lars Holmberg

One of the most impactful findings in computational neuroscience over the past decade is that the object recognition accuracy of deep neural networks (DNNs) correlates with their ability to predict neural responses to natural images in the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Drew Linsley , Ivan F. Rodriguez , Thomas Fel , Michael Arcaro , Saloni Sharma , Margaret Livingstone , Thomas Serre

Understanding of the evolved biological function of sleep has advanced considerably in the past decade. However, no equivalent understanding of dreams has emerged. Contemporary neuroscientific theories generally view dreams as epiphenomena,…

Neurons and Cognition · Quantitative Biology 2020-09-25 Erik Hoel

Recent progress in artificial intelligence (AI) has renewed interest in building systems that learn and think like people. Many advances have come from using deep neural networks trained end-to-end in tasks such as object recognition, video…

Artificial Intelligence · Computer Science 2016-11-03 Brenden M. Lake , Tomer D. Ullman , Joshua B. Tenenbaum , Samuel J. Gershman

Deep neural networks (DNNs) have been shown to outperform traditional machine learning algorithms in a broad variety of application domains due to their effectiveness in modeling complex problems and handling high-dimensional datasets. Many…

Neural network models can now recognise images, understand text, translate languages, and play many human games at human or superhuman levels. These systems are highly abstracted, but are inspired by biological brains and use only…

Neurons and Cognition · Quantitative Biology 2019-03-06 Katherine R. Storrs , Nikolaus Kriegeskorte

Binary Neural Networks (BNNs) show promising progress in reducing computational and memory costs but suffer from substantial accuracy degradation compared to their real-valued counterparts on large-scale datasets, e.g., ImageNet. Previous…

Machine Learning · Computer Science 2019-06-21 Joseph Bethge , Haojin Yang , Marvin Bornstein , Christoph Meinel

Deep neural networks (DNNs) are currently widely used for many artificial intelligence (AI) applications including computer vision, speech recognition, and robotics. While DNNs deliver state-of-the-art accuracy on many AI tasks, it comes at…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Vivienne Sze , Yu-Hsin Chen , Tien-Ju Yang , Joel Emer

Graph neural networks (GNNs) are effective machine learning models for various graph learning problems. Despite their empirical successes, the theoretical limitations of GNNs have been revealed recently. Consequently, many GNN models have…

Machine Learning · Computer Science 2020-10-19 Ryoma Sato

The development of quantum neural networks (QNNs) has attracted considerable attention due to their potential to surpass classical models in certain machine learning tasks. Nonetheless, it remains unclear under which conditions QNNs provide…