English
Related papers

Related papers: Neural networks with non-smooth and impact activat…

200 papers

Physics Informed Neural Networks is a numerical method which uses neural networks to approximate solutions of partial differential equations. It has received a lot of attention and is currently used in numerous physical and engineering…

Numerical Analysis · Mathematics 2025-07-10 Dimitrios Gazoulis , Ioannis Gkanis , Charalambos G. Makridakis

A lecture notes style review of the non-equilibrium statistical mechanics of recurrent neural networks with discrete and continuous neurons (e.g. Ising, graded-response, coupled-oscillators). To be published in the Handbook of Biological…

Disordered Systems and Neural Networks · Physics 2007-05-23 A. C. C. Coolen

The elapsed time model has been widely studied in the context of mathematical neuroscience with many open questions left. The model consists of an age-structured equation that describes the dynamics of interacting neurons structured by the…

Analysis of PDEs · Mathematics 2021-03-22 Maria Caceres , Benoît Perthame , Delphine Salort , Nicolas Torres

We investigate the predictive power of recurrent neural networks for oscillatory systems not only on the attractor, but in its vicinity as well. For this we consider systems perturbed by an external force. This allows us to not merely…

Adaptation and Self-Organizing Systems · Physics 2019-07-02 Rok Cestnik , Markus Abel

Stability of recurrent models is closely linked with trainability, generalizability and in some applications, safety. Methods that train stable recurrent neural networks, however, do so at a significant cost to expressibility. We propose an…

Machine Learning · Computer Science 2019-12-24 Max Revay , Ian R. Manchester

Here we numerically study a model of excitable media, namely, a network with occasionally quiet nodes and connection weights that vary with activity on a short-time scale. Even in the absence of stimuli, this exhibits unstable dynamics,…

Disordered Systems and Neural Networks · Physics 2015-05-19 S. de Franciscis , J. J. Torres , J. Marro

We study convergence in networks of piecewise-smooth (PWS) systems that commonly arise in applications to model dynamical systems whose evolution is affected by macroscopic events such as switches and impacts. Existing approaches were…

Systems and Control · Electrical Eng. & Systems 2021-11-16 Marco Coraggio , Pietro DeLellis , S. John Hogan , Mario di Bernardo

Complex nonlinear dynamics are ubiquitous in many fields. Moreover, we rarely have access to all of the relevant state variables governing the dynamics. Delay embedding allows us, in principle, to account for unobserved state variables.…

Machine Learning · Computer Science 2022-04-27 Uttam Bhat , Stephan B. Munch

The notion of asymptotic unpredictability was recently introduced in (Commun. Nonlinear Sci. Numer. Simul. 134, 108029, 2024) for semiflows. Likewise unpredictable trajectories, asymptotically unpredictable ones are also capable of…

Dynamical Systems · Mathematics 2024-10-08 Mehmet Onur Fen , Fatma Tokmak Fen

The analysis of the long-term behavior of the mathematical model of a neural network constitutes a suitable framework to develop new tools for the dynamical description of nonautonomous state-dependent delay equations (SDDEs). The concept…

Dynamical Systems · Mathematics 2019-07-24 Cinzia Elia , Ismael Maroto , Carmen Núñez , Rafael Obaya

We analyze networked heterogeneous nonlinear systems, with diffusive coupling and interconnected over a generic static directed graph. Due to the network's hetereogeneity, complete synchronization is impossible, in general, but an emergent…

Optimization and Control · Mathematics 2022-06-01 Mohamed Maghenem , Elena Panteley , Antonio Loria

The paper discusses linear fractional representations of parameter-dependent nonlinear systems with dynamics defined by real rational nonlinearities and a finite set of point delays. The global asymptotic stability is investigated via…

Dynamical Systems · Mathematics 2008-03-27 M. De la Sen

This thesis addresses the question of stability of systems defined by differential equations which contain nonlinearity and delay. In particular, we analyze the stability of a well-known delayed nonlinear implementation of a certain…

Dynamical Systems · Mathematics 2007-05-23 Matthew M. Peet

This work investigates the exponential stability of neural networks (NNs) systems with time delays. By considering orthogonal polynomials with weighted terms, a new weighted integral inequality is presented. This inequality extend several…

Functional Analysis · Mathematics 2024-12-12 Yuanyuan Zhang , Han Xue , Kachong Lao , Chonkit Chan , Chenyang Shi , Seakweng Vong

This paper presents a method that learns a regionally stable recurrent neural network model from a set of input-output data generated by an unknown dynamical system. Relying on generalized sector conditions on the deadzone activation…

Systems and Control · Electrical Eng. & Systems 2026-05-19 Daniel Frank , Fahim Shakib , Steffen Staab

We examine the dynamical properties of a single-layer convolutional recurrent network with a smooth sigmoidal activation function, for small values of the inputs and when the convolution kernel is unitary, so all eigenvalues lie exactly at…

Statistical Mechanics · Physics 2024-05-24 Aditi Chandra , Marcelo O. Magnasco

Recurrent networks of dynamic elements frequently exhibit emergent collective oscillations, which can display substantial regularity even when the individual elements are considerably noisy. How noise-induced dynamics at the local level…

Adaptation and Self-Organizing Systems · Physics 2017-01-04 Belen Sancristobal , Beatriz Rebollo , Pol Boada , Maria V. Sanchez-Vives , Jordi Garcia-Ojalvo

Complex networks are a successful framework to describe collective behaviour in many applications, but a notable gap remains in the current literature, that of proving asymptotic convergence in networks of piecewise-smooth systems. Indeed,…

Systems and Control · Computer Science 2020-12-03 Marco Coraggio , Pietro DeLellis , Mario di Bernardo

The elapsed-time model describes the behavior of interconnected neurons through the time since their last spike. It is an age-structured non-linear equation in which age corresponds to the elapsed time since the last discharge, and models…

Dynamical Systems · Mathematics 2025-04-28 María J. Cáceres , José A Cañizo , Nicolas Torres

In this paper, we investigate the asymptotic behaviors of the solutions of nonlinear dynamic systems nearby an equilibrium point, when the nominal parts are subject to non necessarily small perturbations. We show that, under some estimates…

Dynamical Systems · Mathematics 2020-08-07 Mondher Benjemaa , Wided Gouadri , Mohamed Ali Hammami