English
Related papers

Related papers: Neurogenesis Deep Learning

200 papers

While deep learning has led to remarkable advances across diverse applications, it struggles in domains where the data distribution changes over the course of learning. In stark contrast, biological neural networks continually adapt to…

Machine Learning · Computer Science 2017-06-14 Friedemann Zenke , Ben Poole , Surya Ganguli

Deep learning is a subset of a broader family of machine learning methods based on learning data representations. These models are inspired by human biological nervous systems, even if there are various differences pertaining to the…

Neural and Evolutionary Computing · Computer Science 2019-05-22 Adriano Baldeschi , Raffaella Margutti , Adam Miller

Deciphering the underpinnings of the dynamical processes leading to information transmission, processing, and storing in the brain is a crucial challenge in neuroscience. An inspiring but speculative theoretical idea is that such dynamics…

Statistical Mechanics · Physics 2023-07-21 Guillermo B. Morales , Serena Di Santo , Miguel A. Muñoz

Deep neural networks (DNNs) have achieved unprecedented success in the field of artificial intelligence (AI), including computer vision, natural language processing and speech recognition. However, their superior performance comes at the…

Machine Learning · Computer Science 2022-04-26 Han Cai , Ji Lin , Yujun Lin , Zhijian Liu , Haotian Tang , Hanrui Wang , Ligeng Zhu , Song Han

Deep learning has demonstrated tremendous success in variety of application domains in the past few years. This new field of machine learning has been growing rapidly and applied in most of the application domains with some new modalities…

Neurons in real brains are enormously complex computational units. Among other things, they're responsible for transforming inbound electro-chemical vectors into outbound action potentials, updating the strengths of intermediate synapses,…

Artificial Intelligence · Computer Science 2020-11-16 Blake Camp , Jaya Krishna Mandivarapu , Rolando Estrada

Recent advances in image data processing through machine learning and especially deep neural networks (DNNs) allow for new optimization and performance-enhancement schemes for radiation detectors and imaging hardware through data-endowed…

Instrumentation and Detectors · Physics 2024-02-23 S. Lin , S. Ning , H. Zhu , T. Zhou , C. L. Morris , S. Clayton , M. Cherukara , R. T. Chen , Z. Wang

Deep neural networks (DNNs) have recently achieved impressive success across a wide range of real-world vision and language processing tasks, spanning from image classification to many other downstream vision tasks, such as object…

Machine Learning · Computer Science 2025-12-23 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Guochu Xiong , Weichen Liu

Neuroscience research is undergoing a minor revolution. Recent advances in machine learning and artificial intelligence (AI) research have opened up new ways of thinking about neural computation. Many researchers are excited by the…

Neurons and Cognition · Quantitative Biology 2020-04-20 Andrew Saxe , Stephanie Nelli , Christopher Summerfield

Dendrites are crucial structures for computation of an individual neuron. It has been shown that the dynamics of a biological neuron with dendrites can be approximated by artificial neural networks (ANN) with deep structure. However, it…

Neurons and Cognition · Quantitative Biology 2023-05-23 Jingyang Ma , Songting Li , Douglas Zhou

Deep neural networks (DNNs) are known for extracting useful information from large amounts of data. However, the representations learned in DNNs are typically hard to interpret, especially in dense layers. One crucial issue of the classical…

Neural and Evolutionary Computing · Computer Science 2021-05-06 Yuyang Gao , Giorgio A. Ascoli , Liang Zhao

Deep neural networks (DNNs) have become ubiquitous thanks to their remarkable ability to model complex patterns across various domains such as computer vision, speech recognition, robotics, etc. While large DNN models are often more…

Machine Learning · Computer Science 2025-11-18 Omkar Shende , Gayathri Ananthanarayanan , Marcello Traiola

Developing Intelligent Systems involves artificial intelligence approaches including artificial neural networks. Here, we present a tutorial of Deep Neural Networks (DNNs), and some insights about the origin of the term "deep"; references…

Neural and Evolutionary Computing · Computer Science 2016-03-24 Juan C. Cuevas-Tello , Manuel Valenzuela-Rendon , Juan A. Nolazco-Flores

Despite the promise of brain-inspired machine learning, deep neural networks (DNN) have frustratingly failed to bridge the deceptively large gap between learning and memory. Here, we introduce a Perpetual Learning Machine; a new type of DNN…

Machine Learning · Computer Science 2015-09-30 Andrew J. R. Simpson

Recent research has seen many behavioral comparisons between humans and deep neural networks (DNNs) in the domain of image classification. Often, comparison studies focus on the end-result of the learning process by measuring and comparing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Lukas S. Huber , Fred W. Mast , Felix A. Wichmann

Although deep neural networks (DNNs) have demonstrated impressive results during the last decade, they remain highly specialized tools, which are trained -- often from scratch -- to solve each particular task. The human brain, in contrast,…

Neural and Evolutionary Computing · Computer Science 2019-08-22 Alexander V. Terekhov , Guglielmo Montone , J. Kevin O'Regan

Deep neural networks (DNNs) have recently achieved a great success in computer vision and several related fields. Despite such progress, current neural architectures still suffer from catastrophic interference (a.k.a. forgetting) which…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Hichem Sahbi , Haoming Zhan

Spiking neural networks (SNNs) have captured apparent interest over the recent years, stemming from neuroscience and reaching the field of artificial intelligence. However, due to their nature SNNs remain far behind in achieving the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Katerina Maria Oikonomou , Vasiliki Balaska , Konstantinos A. Tsintotas , Christos N. Mavridis , Ioannis Kansizoglou , Antonios Gasteratos

Deep neural networks (DNNs) may outperform human brains in complex tasks, but the lack of transparency in their decision-making processes makes us question whether we could fully trust DNNs with high stakes problems. As DNNs' operations…

Machine Learning · Computer Science 2020-03-19 Jung Hoon Lee

Neural Memory Networks (NMNs) have received increased attention in recent years compared to deep architectures that use a constrained memory. Despite their new appeal, the success of NMNs hinges on the ability of the gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes