English
Related papers

Related papers: A matlab toolbox for continuous state transition a…

200 papers

Transformer-based architectures have achieved remarkable success in natural language processing and computer vision. However, their performance in multivariate long-term forecasting often falls short compared to simpler linear baselines.…

Machine Learning · Computer Science 2025-07-09 Dizhen Liang

It is known that state-dependent, multi-step Lyapunov bounds lead to greatly simplified verification theorems for stability for large classes of Markov chain models. This is one component of the "fluid model" approach to stability of…

Optimization and Control · Mathematics 2012-05-18 Serdar Yüksel , Sean P. Meyn

Continual learning systems are increasingly deployed in environments where retraining or reset is infeasible, yet many approaches emphasize task performance rather than the evolution of internal representations over time. In this work, we…

Machine Learning · Computer Science 2026-02-24 Vishnu Subramanian

Determining the kinetic bottlenecks that make transitions between metastable states difficult is key to understanding important physical problems like crystallization, chemical reactions, or protein folding. In all these phenomena, the…

Computational Physics · Physics 2026-03-03 Peilin Kang , Enrico Trizio , Michele Parrinello

Simultaneous perturbation stochastic approximation (SPSA) is widely used in stochastic optimization due to its high efficiency, asymptotic stability, and reduced number of required loss function measurements. However, the standard SPSA…

Optimization and Control · Mathematics 2023-02-07 Zhichao Jia , Ziyi Wei , James C. Spall

Goal-conditioned planning benefits from learned low-dimensional representations of rich observations. While compact latent representations typically learned from variational autoencoders or inverse dynamics enable goal-conditioned decision…

Stable dynamical systems are a flexible tool to plan robotic motions in real-time. In the robotic literature, dynamical system motions are typically planned without considering possible limitations in the robot's workspace. This work…

Robotics · Computer Science 2020-03-26 Matteo Saveriano , Dongheui Lee

When a system has more than one stable state, how can the stability of these states be compared? This deceptively simple question has important consequences for ecosystems, because systems with alternative stable states can undergo dramatic…

Populations and Evolution · Quantitative Biology 2015-10-26 Ben C. Nolting , Karen C. Abbott

Stochastic optimization methods have been hugely successful in making large-scale optimization problems feasible when computing the full gradient is computationally prohibitive. Using the theory of modified equations for numerical…

Optimization and Control · Mathematics 2023-09-06 Stefano Di Giovacchino , Desmond J. Higham , Konstantinos Zygalakis

An algorithm is proposed for solving stochastic and finite sum minimization problems. Based on a trust region methodology, the algorithm employs normalized steps, at least as long as the norms of the stochastic gradient estimates are within…

Optimization and Control · Mathematics 2018-06-27 Frank E. Curtis , Katya Scheinberg , Rui Shi

As computational challenges in optimization and statistical inference grow ever harder, algorithms that utilize derivatives are becoming increasingly more important. The implementation of the derivatives that make these algorithms so…

Mathematical Software · Computer Science 2015-09-25 Bob Carpenter , Matthew D. Hoffman , Marcus Brubaker , Daniel Lee , Peter Li , Michael Betancourt

In this work, we present methods for state estimation in continuous-discrete nonlinear systems involving stochastic differential equations. We present the extended Kalman filter, the unscented Kalman filter, the ensemble Kalman filter, and…

Stochastic simulators are an indispensable tool in many branches of science. Often based on first principles, they deliver a series of samples whose distribution implicitly defines a probability measure to describe the phenomena of…

Data Analysis, Statistics and Probability · Physics 2022-01-19 Chris Pollard , Philipp Windischhofer

There are multiple ways in which a stochastic system can be out of statistical equilibrium. It might be subject to time-varying forcing; or be in a transient phase on its way towards equilibrium; it might even be in equilibrium without us…

Dynamical Systems · Mathematics 2019-07-08 Péter Koltai , Hao Wu , Frank Noé , Christof Schütte

This paper announces the availability of a fixed point toolbox for the Matlab compatible software package Octave. This toolbox is released under the GNU Public License, and can be used to model the losses in algorithms implemented in…

Mathematical Software · Computer Science 2007-05-23 David Bateman , Laurent Mazet , Veronique Buzenac-Settineri , Markus Muck

In this paper, we propose a stochastic cellular automaton model of traffic flow extending two exactly solvable stochastic models, i.e., the asymmetric simple exclusion process and the zero range process. Moreover it is regarded as a…

Statistical Mechanics · Physics 2009-05-26 Masahiro Kanai , Katsuhiro Nishinari , Tetsuji Tokihiro

Continuous Time Markov Chain (CMTC) is widely used to describe and analyze systems in several knowledge areas. Steady state availability is one important analysis that can be made through Markov chain formalism that allows researchers…

Performance · Computer Science 2017-01-24 Eduardo M. Vasconcelos

We present SEBOOST, a technique for boosting the performance of existing stochastic optimization methods. SEBOOST applies a secondary optimization process in the subspace spanned by the last steps and descent directions. The method was…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Elad Richardson , Rom Herskovitz , Boris Ginsburg , Michael Zibulevsky

In this paper, we present Stratified Topological Autonomy for Long-Range Coordination (STALC), a hierarchical planning approach for multi-robot coordination in real-world environments with significant inter-robot spatial and temporal…

In an era where data-driven decision-making and computational efficiency are paramount, optimization plays a foundational role in advancing fields such as mathematics, computer science, operations research, machine learning, and beyond.…

Numerical Analysis · Mathematics 2025-03-11 Jun Lu