English
Related papers

Related papers: Efficient PAC Learnability of Dynamical Systems Ov…

200 papers

Accurately modeling robot dynamics is crucial to safe and efficient motion control. In this paper, we develop and apply an iterative learning semi-parametric model, with a neural network, to the task of autonomous racing with a Model…

Robotics · Computer Science 2020-11-18 Ignat Georgiev , Christoforos Chatzikomis , Timo Völkl , Joshua Smith , Michael Mistry

Effective inclusion of physics-based knowledge into deep neural network models of dynamical systems can greatly improve data efficiency and generalization. Such a-priori knowledge might arise from physical principles (e.g., conservation…

Machine Learning · Computer Science 2022-12-13 Franck Djeumou , Cyrus Neary , Eric Goubault , Sylvie Putot , Ufuk Topcu

Bayesian networks represent relations between variables using a directed acyclic graph (DAG). Learning the DAG is an NP-hard problem and exact learning algorithms are feasible only for small sets of variables. We propose two scalable…

Machine Learning · Computer Science 2021-07-02 Pierre Gillot , Pekka Parviainen

Understanding the inductive bias and generalization properties of large overparametrized machine learning models requires to characterize the dynamics of the training algorithm. We study the learning dynamics of large two-layer neural…

Machine Learning · Statistics 2025-10-30 Andrea Montanari , Pierfrancesco Urbani

Modeling dynamical systems is important in many disciplines, e.g., control, robotics, or neurotechnology. Commonly the state of these systems is not directly observed, but only available through noisy and potentially high-dimensional…

Machine Learning · Statistics 2014-10-29 Niklas Wahlström , Thomas B. Schön , Marc Peter Deisenroth

Kernel-based methods exhibit well-documented performance in various nonlinear learning tasks. Most of them rely on a preselected kernel, whose prudent choice presumes task-specific prior information. Especially when the latter is not…

Machine Learning · Statistics 2018-12-31 Yanning Shen , Tianyi Chen , Georgios B. Giannakis

Planning has been very successful for control tasks with known environment dynamics. To leverage planning in unknown environments, the agent needs to learn the dynamics from interactions with the world. However, learning dynamics models…

Machine Learning · Computer Science 2019-06-06 Danijar Hafner , Timothy Lillicrap , Ian Fischer , Ruben Villegas , David Ha , Honglak Lee , James Davidson

Deep neural networks come in many sizes and architectures. The choice of architecture, in conjunction with the dataset and learning algorithm, is commonly understood to affect the learned neural representations. Yet, recent results have…

Machine Learning · Computer Science 2024-07-08 Loek van Rossem , Andrew M. Saxe

Bayesian networks are probabilistic graphical models widely employed to understand dependencies in high dimensional data, and even to facilitate causal discovery. Learning the underlying network structure, which is encoded as a directed…

Machine Learning · Statistics 2022-02-03 Jack Kuipers , Polina Suter , Giusi Moffa

Dynamic Bayesian networks provide a compact and natural representation for complex dynamic systems. However, in many cases, there is no expert available from whom a model can be elicited. Learning provides an alternative approach for…

Artificial Intelligence · Computer Science 2013-01-30 Xavier Boyen , Nir Friedman , Daphne Koller

Phase-amplitude coupling (PAC), a form of cross-frequency interaction, has been implicated in various cognitive functions and, by extension, in neural communication and information integration. Accurately detecting and characterising PAC is…

Neurons and Cognition · Quantitative Biology 2026-03-11 Rajintha Gunawardena , Fei He

Subspace learning is a critical endeavor in contemporary machine learning, particularly given the vast dimensions of modern datasets. In this study, we delve into the training dynamics of a single-layer GAN model from the perspective of…

Machine Learning · Computer Science 2024-11-04 Andrew Bond , Zafer Dogan

Estimating the relative importance of each sample in a training set has important practical and theoretical value, such as in importance sampling or curriculum learning. This kind of focus on individual samples invokes the concept of…

Machine Learning · Computer Science 2019-01-09 Seung-Geon Lee , Jaedeok Kim , Hyun-Joo Jung , Yoonsuck Choe

Understanding and interacting with everyday physical scenes requires rich knowledge about the structure of the world, represented either implicitly in a value or policy function, or explicitly in a transition model. Here we introduce a new…

A fundamental challenge in multiagent reinforcement learning is to learn beneficial behaviors in a shared environment with other simultaneously learning agents. In particular, each agent perceives the environment as effectively…

Safe deployment of autonomous robots in diverse scenarios requires agents that are capable of efficiently adapting to new environments while satisfying constraints. In this work, we propose a practical and theoretically-justified approach…

Robotics · Computer Science 2022-02-17 Thomas Lew , Apoorva Sharma , James Harrison , Andrew Bylard , Marco Pavone

We present a novel approach for learning nonlinear dynamic models, which leads to a new set of tools capable of solving problems that are otherwise difficult. We provide theory showing this new approach is consistent for models with long…

Artificial Intelligence · Computer Science 2009-06-03 John Langford , Ruslan Salakhutdinov , Tong Zhang

The modeling and simulation of high-dimensional multiscale systems is a critical challenge across all areas of science and engineering. It is broadly believed that even with today's computer advances resolving all spatiotemporal scales…

Machine Learning · Statistics 2023-09-13 Emmanuel Menier , Sebastian Kaltenbach , Mouadh Yagoubi , Marc Schoenauer , Petros Koumoutsakos

Dynamical systems provide a comprehensive way to study complex and changing behaviors across various sciences. Many modern systems are too complicated to analyze directly or we do not have access to models, driving significant interest in…

Dynamical Systems · Mathematics 2024-07-10 Matthew J. Colbrook , Igor Mezić , Alexei Stepanenko

Multiclass neural networks are a common tool in modern unsupervised domain adaptation, yet an appropriate theoretical description for their non-uniform sample complexity is lacking in the adaptation literature. To fill this gap, we propose…

Machine Learning · Computer Science 2022-07-13 Anthony Sicilia , Katherine Atwell , Malihe Alikhani , Seong Jae Hwang