English
Related papers

Related papers: Learning and Concentration for High Dimensional Li…

200 papers

Deep reinforcement learning systems often suffer from unstable training dynamics due to non-stationarity, where learning objectives and data distributions evolve over time. We show that under non-stationary targets, isotropic Gaussian…

Machine Learning · Computer Science 2026-03-20 Ali Saheb Pasand , Johan Obando-Ceron , Aaron Courville , Pouya Bashivan , Pablo Samuel Castro

Reinforcement learning has been successful across several applications in which agents have to learn to act in environments with sparse feedback. However, despite this empirical success there is still a lack of theoretical understanding of…

Machine Learning · Statistics 2023-11-08 Blake Bordelon , Paul Masset , Henry Kuo , Cengiz Pehlevan

We investigate the stabilization of unstable multidimensional partially observed single-sensor and multi-sensor linear systems driven by unbounded noise and controlled over discrete noiseless channels under fixed-rate information…

Optimization and Control · Mathematics 2012-09-21 Andrew P. Johnston , Serdar Yüksel

We study the following question in the context of imitation learning for continuous control: how are the underlying stability properties of an expert policy reflected in the sample-complexity of an imitation learning task? We provide the…

Machine Learning · Computer Science 2023-01-18 Stephen Tu , Alexander Robey , Tingnan Zhang , Nikolai Matni

This work proposes a general framework for capturing noise-driven transitions in spatially extended non-equilibrium systems and explains the emergence of coherent patterns beyond the instability onset. The framework relies on stochastic…

Dynamical Systems · Mathematics 2024-12-16 Mickaël D. Chekroun , Honghu Liu , James C. McWilliams

We consider the problem of adaptive stabilization for discrete-time, multi-dimensional linear systems with bounded control input constraints and unbounded stochastic disturbances, where the parameters of the true system are unknown. To…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Seth Siriya , Jingge Zhu , Dragan Nešić , Ye Pu

Learning dynamics from dissipative chaotic systems is notoriously difficult due to their inherent instability, as formalized by their positive Lyapunov exponents, which exponentially amplify errors in the learned dynamics. However, many of…

Machine Learning · Computer Science 2024-06-07 Yair Schiff , Zhong Yi Wan , Jeffrey B. Parker , Stephan Hoyer , Volodymyr Kuleshov , Fei Sha , Leonardo Zepeda-Núñez

Deep learning systems achieve remarkable empirical performance, yet the stability of the training process itself remains poorly understood. Training unfolds as a high-dimensional dynamical system in which small perturbations to…

Machine Learning · Computer Science 2026-01-21 Zhipeng Zhang , Zhenjie Yao , Kai Li , Lei Yang

We consider the problem of subspace estimation in situations where the number of available snapshots and the observation dimension are comparable in magnitude. In this context, traditional subspace methods tend to fail because the…

Information Theory · Computer Science 2016-11-15 Pascal Vallet , Philippe Loubaton , Xavier Mestre

Recent work has shown that Transformers can perform in-context learning for linear regression under restrictive assumptions, including i.i.d. data, Gaussian noise, and Gaussian regression coefficients. However, real-world data often violate…

Machine Learning · Computer Science 2026-03-20 Hoang T. H. Cao , Hai D. V. Trinh , Tho Quan , Lan V. Truong

Learning stable dynamics from observed time-series data is an essential problem in robotics, physical modeling, and systems biology. Many of these dynamics are represented as an inputs-output system to communicate with the external…

Dynamical Systems · Mathematics 2023-01-18 Yuji Okamoto , Ryosuke Kojima

This article proposes a novel methodology to learn a stable robot control law driven by dynamical systems. The methodology requires a single demonstration and can deduce a stable dynamics in arbitrary high dimensions. The method relies on…

Robotics · Computer Science 2022-07-19 Sthithpragya Gupta , Aradhana Nayak , Aude Billard

We present a dynamic subspace approach for efficiently approximating large-scale systems by learning time-continuous trajectories on the Grassmannian manifold. By parameterizing a low-dimensional basis as a geodesic path, the method allows…

Numerical Analysis · Mathematics 2026-05-26 Jack DeChant , Rudy Geelen , Shane A. McQuarrie , Johann Guilleminot

We investigate the incremental stability properties of It\^o stochastic dynamical systems. Specifically, we derive a stochastic version of nonlinear contraction theory that provides a bound on the mean square distance between any two…

Optimization and Control · Mathematics 2011-11-09 Q. -C. Pham , N. Tabareau , J. -J. Slotine

By learning the gradient of smoothed data distributions, diffusion models can iteratively generate samples from complex distributions. The learned score function enables their generalization capabilities, but how the learned score relates…

Machine Learning · Computer Science 2024-12-16 Binxu Wang , John J. Vastola

Learned representations in deep reinforcement learning (DRL) have to extract task-relevant information from complex observations, balancing between robustness to distraction and informativeness to the policy. Such stable and rich…

Machine Learning · Computer Science 2021-10-28 Mete Kemertas , Tristan Aumentado-Armstrong

We consider the Reinforcement Learning problem of controlling an unknown dynamical system to maximise the long-term average reward along a single trajectory. Most of the literature considers system interactions that occur in discrete time…

Artificial Intelligence · Computer Science 2023-09-07 Lorenzo Croissant , Marc Abeille , Bruno Bouchard

Stochastic Gumbel graph networks are proposed to learn high-dimensional time series, where the observed dimensions are often spatially correlated. To that end, the observed randomness and spatial-correlations are captured by learning the…

Machine Learning · Computer Science 2023-07-13 Jin Guo , Ting Gao , Yufu Lan , Peng Zhang , Sikun Yang , Jinqiao Duan

We study the problem of system identification for stochastic continuous-time dynamics, based on a single finite-length state trajectory. We present a method for estimating the possibly unstable open-loop matrix by employing properly…

Machine Learning · Statistics 2025-09-30 Reza Sadeghi Hafshejani , Mohamad Kazem Shirani Fradonbeh

This paper studies the rich dynamics of one-dimensional granular media equations with attractive quadratic interactions. Building on the monotone dynamical systems framework developed in an earlier work, we allow for multiplicative noise,…

Probability · Mathematics 2026-01-08 Baoyou Qu , Jinxiang Yao , Yanpeng Zhi
‹ Prev 1 2 3 10 Next ›