English
Related papers

Related papers: Structured Neural Network Dynamics for Model-based…

200 papers

Many types of data from fields including natural language processing, computer vision, and bioinformatics, are well represented by discrete, compositional structures such as trees, sequences, or matchings. Latent structure models are a…

Machine Learning · Computer Science 2026-02-04 Vlad Niculae , Caio F. Corro , Nikita Nangia , Tsvetomila Mihaylova , André F. T. Martins

Biological neural networks are characterized by their high degree of plasticity, a core property that enables the remarkable adaptability of natural organisms. Importantly, this ability affects both the synaptic strength and the topology of…

Neural and Evolutionary Computing · Computer Science 2024-06-17 Erwan Plantec , Joachin W. Pedersen , Milton L. Montero , Eleni Nisioti , Sebastian Risi

Artificial neural networks which are inspired from the learning mechanism of brain have achieved great successes in many problems, especially those with deep layers. In this paper, we propose a nucleus neural network (NNN) and corresponding…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Jia Liu , Maoguo Gong , Haibo He

The understanding of neural activity patterns is fundamentally linked to an understanding of how the brain's network architecture shapes dynamical processes. Established approaches rely mostly on deviations of a given network from certain…

Neurons and Cognition · Quantitative Biology 2014-09-19 Marc-Thorsten Huett , Marcus Kaiser , Claus C. Hilgetag

In this paper, we propose the Deep Structured self-Driving Network (DSDNet), which performs object detection, motion prediction, and motion planning with a single neural network. Towards this goal, we develop a deep structured energy based…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Wenyuan Zeng , Shenlong Wang , Renjie Liao , Yun Chen , Bin Yang , Raquel Urtasun

The classical notions of structural controllability and structural observability are receiving increasing attention in Network Science, since they provide a mathematical basis to answer how the network structure of a dynamic system affects…

Systems and Control · Computer Science 2018-12-13 Marco Tulio Angulo , Andrea Aparicio , Claude H. Moog

Adaptive methods are popular within the control literature due to the flexibility and forgiveness they offer in the area of modelling. Neural network adaptive control is favorable specifically for the powerful nature of the machine learning…

Systems and Control · Electrical Eng. & Systems 2021-07-23 Nathan Lutes , K. Krishnamurthy , Venkata Sriram Siddhardh Nadendla , S. N. Balakrishnan

Systematic generalization aims to evaluate reasoning about novel combinations from known components, an intrinsic property of human cognition. In this work, we study systematic generalization of NNs in forecasting future time series of…

Machine Learning · Computer Science 2021-03-09 Hritik Bansal , Gantavya Bhatt , Pankaj Malhotra , Prathosh A. P

This paper focuses on the identification of dynamical systems with tailor-made model structures, where neural networks are used to approximate uncertain components and domain knowledge is retained, if available. These model structures are…

Machine Learning · Computer Science 2021-10-29 Marco Forgione , Dario Piga

Neural networks are powerful function estimators, leading to their status as a paradigm of choice for modeling structured data. However, unlike other structured representations that emphasize the modularity of the problem -- e.g., factor…

Machine Learning · Computer Science 2022-06-20 Tsvetomila Mihaylova , Vlad Niculae , André F. T. Martins

Motivated by the development and deployment of large-scale dynamical systems, often composed of geographically distributed smaller subsystems, we address the problem of verifying their controllability in a distributed manner. In this work…

Optimization and Control · Mathematics 2015-06-19 Joao Carvalho , Sergio Pequito , A. Pedro Aguiar , Soummya Kar , Karl H. Johansson

Neural network modules conditioned by known priors can be effectively trained and combined to represent systems with nonlinear dynamics. This work explores a novel formulation for data-efficient learning of deep control-oriented nonlinear…

Dynamical Systems · Mathematics 2021-01-07 Elliott Skomski , Soumya Vasisht , Colby Wight , Aaron Tuor , Jan Drgona , Draguna Vrabie

We introduce bio-inspired artificial neural networks consisting of neurons that are additionally characterized by spatial positions. To simulate properties of biological systems we add the costs penalizing long connections and the proximity…

Neural and Evolutionary Computing · Computer Science 2019-10-08 Maciej Wołczyk , Jacek Tabor , Marek Śmieja , Szymon Maszke

In this work we present a novel recurrent neural network architecture designed to model systems characterized by multiple characteristic timescales in their dynamics. The proposed network is composed by several recurrent groups of neurons…

Neural and Evolutionary Computing · Computer Science 2017-01-19 Filippo Maria Bianchi , Michael Kampffmeyer , Enrico Maiorino , Robert Jenssen

A graphical model is a statistical model that is associated to a graph whose nodes correspond to variables of interest. The edges of the graph reflect allowed conditional dependencies among the variables. Graphical models admit…

Methodology · Statistics 2016-06-09 Mathias Drton , Marloes H. Maathuis

The control of high-dimensional systems, such as soft robots, requires models that faithfully capture complex dynamics while remaining computationally tractable. This work presents a framework that integrates Graph Neural Network…

Discrete-time modeling of acoustic, mechanical and electrical systems is a prominent topic in the musical signal processing literature. Such models are mostly derived by discretizing a mathematical model, given in terms of ordinary or…

The concept of structured occurrence nets is an extension of that of occurrence nets which are directed acyclic graphs that represent causality and concurrency information concerning a single execution of a distributed system. The formalism…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-17 Mohammed Alahmadi , Salma Alharbi , Talal Alharbi , Nadiyah Almutairi , Tuwailaa Alshammari , Anirban Bhattacharyya , Maciej Koutny , Bowen Li , Brian Randell

A profound challenge for A-Life is to construct agents whose behavior is 'life-like' in a deep way. We propose an architecture and approach to constructing networks driving artificial agents, using processes analogous to the processes that…

Neural and Evolutionary Computing · Computer Science 2022-02-01 Addison Wood , Jory Schossau , Nick Sabaj , Richard Liu , Mark Reimers

Precise timing of spikes and temporal locking are key elements of neural computation. Here we demonstrate how even strongly heterogeneous, deterministic neural networks with delayed interactions and complex topology can exhibit periodic…

Neurons and Cognition · Quantitative Biology 2009-11-13 Raoul-Martin Memmesheimer , Marc Timme