English
Related papers

Related papers: Mixed Delay/Nondelay Embeddings Based Neuromorphic…

200 papers

Reservoir Computing (RC) is a bio-inspired machine learning framework, and various models have been proposed. RC is a well-suited model for time series data processing, but there is a trade-off between memory capacity and nonlinearity. In…

Machine Learning · Computer Science 2025-02-26 Atsuki Yokota , Ichiro Kawashima , Yohei Saito , Hakaru Tamukoh , Osamu Nomura , Takashi Morie

The prediction of time series is a challenging task relevant in such diverse applications as analyzing financial data, forecasting flow dynamics or understanding biological processes. Especially chaotic time series that depend on a long…

Machine Learning · Computer Science 2024-12-06 Johannes Viehweg , Dominik Walther , Patrick Mäder

Complex nonlinear dynamics are ubiquitous in many fields. Moreover, we rarely have access to all of the relevant state variables governing the dynamics. Delay embedding allows us, in principle, to account for unobserved state variables.…

Machine Learning · Computer Science 2022-04-27 Uttam Bhat , Stephan B. Munch

The significant computational cost of multiplications hinders the deployment of deep neural networks (DNNs) on edge devices. While multiplication-free models offer enhanced hardware efficiency, they typically sacrifice accuracy. As a…

Machine Learning · Computer Science 2024-09-10 Yang Xu , Huihong Shi , Zhongfeng Wang

Empirically observed time series in physics, biology, or medicine, are commonly generated by some underlying dynamical system (DS) which is the target of scientific interest. There is an increasing interest to harvest machine learning…

Machine Learning · Computer Science 2022-07-07 Daniel Kramer , Philine Lou Bommer , Carlo Tombolini , Georgia Koppe , Daniel Durstewitz

Nanowire networks (NWNs) represent a unique hardware platform for neuromorphic information processing. In addition to exhibiting synapse-like resistive switching memory at their cross-point junctions, their self-assembly confers a neural…

Disordered Systems and Neural Networks · Physics 2021-06-24 Ruomin Zhu , Joel Hochstetter , Alon Loeffler , Adrian Diaz-Alvarez , Adam Stieg , James Gimzewski , Tomonobu Nakayama , Zdenka Kuncic

Reservoir computing is a recently introduced brain-inspired machine learning paradigm capable of excellent performances in the processing of empirical data. We focus in a particular kind of time-delay based reservoir computers that have…

Dynamical Systems · Mathematics 2014-11-11 Lyudmila Grigoryeva , Julie Henriques , Laurent Larger , Juan-Pablo Ortega

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

Neural and Evolutionary Computing · Computer Science 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

A hybrid approach, incorporating concepts of nonlinear dynamics in artificial neural networks (ANN), is proposed to model time series generated by complex dynamic systems. We introduce well known features used in the study of dynamic…

comp-gas · Physics 2008-02-03 D. R. Kulkarni , A. S. Pandya , J. C. Parikh

Deep neural networks (DNNs) based automatic speech recognition (ASR) systems are often designed using expert knowledge and empirical evaluation. In this paper, a range of neural architecture search (NAS) techniques are used to automatically…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Shoukang Hu , Xurong Xie , Shansong Liu , Mingyu Cui , Mengzhe Geng , Xunying Liu , Helen Meng

Nonlinear photonic sources including semiconductor lasers have recently been utilized as ideal computation elements for information processing. They supply energy-efficient way and rich dynamics for classification and recognition tasks. In…

Optics · Physics 2023-06-27 T. Wang , C. Jiang , Q. Fang , X. Guo , Y. Zhang , C. Jin , S. Xiang

Multiplication is arguably the most cost-dominant operation in modern deep neural networks (DNNs), limiting their achievable efficiency and thus more extensive deployment in resource-constrained applications. To tackle this limitation,…

Hardware Architecture · Computer Science 2022-12-20 Huihong Shi , Haoran You , Yang Zhao , Zhongfeng Wang , Yingyan Lin

Forecasting nonlinear time series with multi-scale temporal structures remains a central challenge in complex systems modeling. We present a novel reservoir computing framework that combines delay embedding with random Fourier feature (RFF)…

Neural and Evolutionary Computing · Computer Science 2025-11-20 S. K. Laha

Time-delay mappings constructed using neural networks have proven successful in performing nonlinear system identification; however, because of their discrete nature, their use in bifurcation analysis of continuous-time systems is limited.…

With the recent exponential growth of applications using artificial intelligence (AI), the development of efficient and ultrafast brain-like (neuromorphic) systems is crucial for future information and communication technologies. While the…

Pattern Formation and Solitons · Physics 2018-01-30 B. Romeira , J. M. L. Figueiredo , J. Javaloyes

Modern deep learning enabled artificial neural networks, such as Deep Neural Network (DNN) and Convolutional Neural Network (CNN), have achieved a series of breaking records on a broad spectrum of recognition applications. However, the…

Neural and Evolutionary Computing · Computer Science 2018-03-15 Tao Liu , Zihao Liu , Fuhong Lin , Yier Jin , Gang Quan , Wujie Wen

Networks of nanowires are currently being explored for a range of applications in brain-like (or neuromorphic) computing, and especially in reservoir computing (RC). Fabrication of real-world computing devices requires that the nanowires…

Computational Physics · Physics 2022-07-08 R. K. Daniels , J. B. Mallinson , Z. E. Heywood , P. J. Bones , M. D. Arnold , S. A. Brown

The reservoir computing based on the thin film embedded with magnetic impurities in the presence of the long-range (the dipole-dipole) interaction is numerically investigated. We simulated the magnetization dynamics by taking into account…

Disordered Systems and Neural Networks · Physics 2026-05-05 Shuto Kamakura , Tomi Ohtsuki , Jun-ichiro Ohe

Deep neural network (DNN) latency characterization is a time-consuming process and adds significant cost to Neural Architecture Search (NAS) processes when searching for efficient convolutional neural networks for embedded vision…

Machine Learning · Computer Science 2022-05-26 Saad Abbasi , Alexander Wong , Mohammad Javad Shafiee

High-dimensional chaos displayed by multi-component systems with a single time-delayed feedback is shown to be accessible to time series analysis of a scalar variable only. The mapping of the original dynamics onto scalar time-delay systems…