English
Related papers

Related papers: Deep Oscillatory Neural Network

200 papers

Many industrial and real life problems exhibit highly nonlinear periodic behaviors and the conventional methods may fall short of finding their analytical or closed form solutions. Such problems demand some cutting edge computational tools…

Machine Learning · Computer Science 2023-04-20 Jamshaid Ul Rahman , Faiza Makhdoom , Dianchen Lu

Many neural networks exhibit stability in their activation patterns over time in response to inputs from sensors operating under real-world conditions. By capitalizing on this property of natural signals, we propose a Recurrent Neural…

Neural and Evolutionary Computing · Computer Science 2016-12-19 Daniel Neil , Jun Haeng Lee , Tobi Delbruck , Shih-Chii Liu

Optical neural network (ONN) is emerging as an attractive proposal for machine-learning applications, enabling high-speed computation with low-energy consumption. However, there are several challenges in applying ONN for industrial…

Optics · Physics 2019-05-21 Xiao-Ming Zhang , Man-Hong Yung

We propose a new method to probe the learning mechanism of Deep Neural Networks (DNN) by perturbing the system using Noise Injection Nodes (NINs). These nodes inject uncorrelated noise via additional optimizable weights to existing…

Machine Learning · Computer Science 2023-05-03 Noam Levi , Itay Bloch , Marat Freytsis , Tomer Volansky

Deep convolutional neural networks (DCNNs) are powerful models that yield impressive results at object classification. However, recent work has shown that they do not generalize well to partially occluded objects and to mask attacks. In…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Adam Kortylewski , Qing Liu , Huiyu Wang , Zhishuai Zhang , Alan Yuille

Graph Neural Networks (GNNs) excel at learning from pairwise interactions but often overlook multi-way and hierarchical relationships. Topological Deep Learning (TDL) addresses this limitation by leveraging combinatorial topological spaces.…

Purpose: We propose a novel method for continual learning based on the increasing depth of neural networks. This work explores whether extending neural network depth may be beneficial in a life-long learning setting. Methods: We propose a…

Machine Learning · Computer Science 2023-05-09 Jędrzej Kozal , Michał Woźniak

The success of deep learning has inspired recent interests in applying neural networks in statistical inference. In this paper, we investigate the use of deep neural networks for nonparametric regression with measurement errors. We propose…

Machine Learning · Statistics 2020-07-16 Zhirui Hu , Zheng Tracy Ke , Jun S Liu

Medical imaging is nowadays a pillar in diagnostics and therapeutic follow-up. Current research tries to integrate established - but ionizing - tomographic techniques with technologies offering reduced radiation exposure. Diffuse Optical…

Numerical Analysis · Mathematics 2024-02-15 Alessandro Benfenati , Paola Causin , Martina Quinteri

Large machine learning models based on Convolutional Neural Networks (CNNs) with rapidly increasing number of parameters, trained with massive amounts of data, are being deployed in a wide array of computer vision tasks from self-driving…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Rishab Parthasarathy , Rohan Bhowmik

One of the methods used in image recognition is the Deep Convolutional Neural Network (DCNN). DCNN is a model in which the expressive power of features is greatly improved by deepening the hidden layer of CNN. The architecture of CNNs is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Genta Kobayashi , Hayaru Shouno

Background/Introduction: In this paper, the neural network class of Self-Organising Maps (SOMs) is investigated in terms of its theoretical and applied validity for cognitive modelling, particularly of neurodevelopmental disorders. Methods:…

Neurons and Cognition · Quantitative Biology 2025-07-18 Spyridon Revithis , Nadine Marcus

The brain is the perfect place to look for inspiration to develop more efficient neural networks. The inner workings of our synapses and neurons provide a glimpse at what the future of deep learning might look like. This paper serves as a…

Neural and Evolutionary Computing · Computer Science 2023-08-15 Jason K. Eshraghian , Max Ward , Emre Neftci , Xinxin Wang , Gregor Lenz , Girish Dwivedi , Mohammed Bennamoun , Doo Seok Jeong , Wei D. Lu

This paper introduces a new generative deep learning network for human motion synthesis and control. Our key idea is to combine recurrent neural networks (RNNs) and adversarial training for human motion modeling. We first describe an…

Graphics · Computer Science 2018-06-25 Zhiyong Wang , Jinxiang Chai , Shihong Xia

Deep Neural Networks (DNN) have been successfully used to perform classification and regression tasks, particularly in computer vision based applications. Recently, owing to the widespread deployment of Internet of Things (IoT), we identify…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Arijit Ukil , Antonio Jara , Leandro Marin

Taking inspiration from biological evolution, we explore the idea of "Can deep neural networks evolve naturally over successive generations into highly efficient deep neural networks?" by introducing the notion of synthesizing new highly…

Computer Vision and Pattern Recognition · Computer Science 2017-02-08 Mohammad Javad Shafiee , Akshaya Mishra , Alexander Wong

Learning dynamics governed by differential equations is crucial for predicting and controlling the systems in science and engineering. Neural Ordinary Differential Equation (NODE), a deep learning model integrated with differential…

Machine Learning · Computer Science 2021-11-09 Shiqi Gong , Qi Meng , Yue Wang , Lijun Wu , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

Deep convolutional neural networks (DCNN) have enjoyed great successes in many signal processing applications because they can learn complex, non-linear causal relationships from input to output. In this light, DCNNs are well suited for the…

Image and Video Processing · Electrical Eng. & Systems 2018-10-31 Xi Zhang , Xiaolin Wu

We propose doubly nested network(DNNet) where all neurons represent their own sub-models that solve the same task. Every sub-model is nested both layer-wise and channel-wise. While nesting sub-models layer-wise is straight-forward with…

Machine Learning · Computer Science 2018-06-21 Jaehong Kim , Sungeun Hong , Yongseok Choi , Jiwon Kim

Deep neural networks (DNN) are increasingly being used to perform algorithm-selection in combinatorial optimisation domains, particularly as they accommodate input representations which avoid designing and calculating features. Mounting…

Neural and Evolutionary Computing · Computer Science 2024-06-25 Emma Hart , Quentin Renau , Kevin Sim , Mohamad Alissa