English
Related papers

Related papers: Predictability Enables Parallelization of Nonlinea…

200 papers

We define {\em predictive information} $I_{\rm pred} (T)$ as the mutual information between the past and the future of a time series. Three qualitatively different behaviors are found in the limit of large observation times $T$: $I_{\rm…

Data Analysis, Statistics and Probability · Physics 2011-11-10 William Bialek , Ilya Nemenman , Naftali Tishby

In nonlinear dynamical systems, tipping refers to a critical transition from one steady state to another, typically catastrophic, steady state, often resulting from a saddle-node bifurcation. Recently, the machine-learning framework of…

Chaotic Dynamics · Physics 2026-04-09 Smita Deb , Zheng-Meng Zhai , Mulugeta Haile , Ying-Cheng Lai

A parallel computer system is a collection of processing elements that communicate and cooperate to solve large computational problems efficiently. To achieve this, at first the large computational problem is partitioned into several tasks…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-09-09 Ardhendu Mandal , Subhas Chandra Pal

Empirical modelling often aims for the simplest model consistent with the data. A new technique is presented which quantifies the consistency of the model dynamics as a function of location in state space. As is well-known, traditional…

Chaotic Dynamics · Physics 2009-11-10 Patrick E. McSharry , Leonard A. Smith

To predict the future evolution of dynamical systems purely from observations of the past data is of great potential application. In this work, a new formulated paradigm of reservoir computing is proposed for achieving model-free…

Neural and Evolutionary Computing · Computer Science 2021-10-27 Zhuo Liu , Leisheng Jin

This paper is concerned with the study of scalability in nonlinear heterogeneous networks affected by communication delays and disturbances. After formalizing the notion of scalability, we give two sufficient conditions to assess this…

Systems and Control · Electrical Eng. & Systems 2022-07-15 Shihao Xie , Giovanni Russo , Richard Middleton

Echo-state networks are simple models of discrete dynamical systems driven by a time series. By selecting network parameters such that the dynamics of the network is contractive, characterized by a negative maximal Lyapunov exponent, the…

Machine Learning · Computer Science 2022-12-06 L. Storm , K. Gustavsson , B. Mehlig

Stochastic programming models can lead to very large-scale optimization problems for which it may be impossible to enumerate all possible scenarios. In such cases, one adopts a sampling-based solution methodology in which case the…

Optimization and Control · Mathematics 2024-05-20 Shuotao Diao , Suvrajeet Sen

Calibration of expensive simulation models involves an emulator based on simulation outputs generated across various parameter settings to replace the actual model. Noisy outputs of stochastic simulation models require many simulation…

Methodology · Statistics 2025-05-08 Özge Sürer

Partially-observable problems pose a trade-off between reducing costs and gathering information. They can be solved optimally by planning in belief space, but that is often prohibitively expensive. Model-predictive control (MPC) takes the…

Machine Learning · Computer Science 2023-04-21 Baris Kayalibay , Atanas Mirchev , Ahmed Agha , Patrick van der Smagt , Justin Bayer

Scientific analysis often relies on the ability to make accurate predictions of a system's dynamics. Mechanistic models, parameterized by a number of unknown parameters, are often used for this purpose. Accurate estimation of the model…

Dynamical Systems · Mathematics 2017-11-01 Franz Hamilton , Alun Lloyd , Kevin Flores

We investigate the problem of stochastic network optimization in the presence of imperfect state prediction and non-stationarity. Based on a novel distribution-accuracy curve prediction model, we develop the predictive learning-aided…

Optimization and Control · Mathematics 2018-07-09 Longbo Huang , Minghua Chen , Yunxin Liu

Temporal planning often involves numeric effects that are directly proportional to their action's duration. These include continuous effects, where a numeric variable is subjected to a rate of change while the action is being executed, and…

Artificial Intelligence · Computer Science 2022-02-01 Josef Bajada , Maria Fox , Derek Long

We introduce the concept of structured synthesis for Markov decision processes where the structure is induced from finitely many pre-specified options for a system configuration. The resulting synthesis problem is in general a nonlinear…

Software Engineering · Computer Science 2018-07-18 Nils Jansen , Laura Humphrey , Jana Tumova , Ufuk Topcu

Chaos and unpredictability are traditionally synonymous, yet large-scale machine learning methods recently have demonstrated a surprising ability to forecast chaotic systems well beyond typical predictability horizons. However, recent works…

Machine Learning · Computer Science 2023-11-27 William Gilpin

Time-distributed Optimization (TDO) is an approach for reducing the computational burden of Model Predictive Control (MPC). When using TDO, optimization iterations are distributed over time by maintaining a running solution estimate and…

Optimization and Control · Mathematics 2021-02-25 Dominic Liao-McPherson , Terrence Skibik , Jordan Leung , Ilya Kolmanovsky , Marco M. Nicotra

Model Predictive Control is an extremely effective control method for systems with input and state constraints. Model Predictive Control performance heavily depends on the accuracy of the open-loop prediction. For systems with uncertainty…

Optimization and Control · Mathematics 2022-07-27 Francesco Micheli , John Lygeros

Harnessing parallelism in seemingly sequential models is a central challenge for modern machine learning. Several approaches have been proposed for evaluating sequential processes in parallel using iterative fixed-point methods, like…

In parallel iterative applications, computational efficiency is essential for addressing large problems. Load imbalance is one of the major performance degradation factors of parallel applications. Therefore, distributing, cleverly, and as…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-18 Anthony Boulmier , Franck Raynaud , Nabil Abdennadher , Bastien Chopard

To safely and efficiently solve motion planning problems in multi-agent settings, most approaches attempt to solve a joint optimization that explicitly accounts for the responses triggered in other agents. This often results in solutions…

Robotics · Computer Science 2025-06-11 Roman Chiva Gil , Daniel Jarne Ornia , Khaled A. Mustafa , Javier Alonso Mora