English
Related papers

Related papers: A statistical physics framework for optimal learni…

200 papers

Emerging applications of machine learning in numerous areas involve continuous gathering of and learning from streams of data. Real-time incorporation of streaming data into the learned models is essential for improved inference in these…

Machine Learning · Computer Science 2020-12-01 Matthew Nokleby , Haroon Raja , Waheed U. Bajwa

Dynamic treatment regimes are of growing interest across the clinical sciences as these regimes provide one way to operationalize and thus inform sequential personalized clinical decision making. A dynamic treatment regime is a sequence of…

Methodology · Statistics 2013-11-27 Eric B. Laber , Min Qian , Dan J. Lizotte , William E. Pelham , Susan A. Murphy

We introduce the framework of performative reinforcement learning where the policy chosen by the learner affects the underlying reward and transition dynamics of the environment. Following the recent literature on performative…

Machine Learning · Computer Science 2023-06-08 Debmalya Mandal , Stelios Triantafyllou , Goran Radanovic

Reinforcement learning has been established over the past decade as an effective tool to find optimal control policies for dynamical systems, with recent focus on approaches that guarantee safety during the learning and/or execution phases.…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

This tutorial paper focuses on safe physics-informed machine learning in the context of dynamics and control, providing a comprehensive overview of how to integrate physical models and safety guarantees. As machine learning techniques…

Systems and Control · Electrical Eng. & Systems 2025-06-16 Jan Drgona , Truong X. Nghiem , Thomas Beckers , Mahyar Fazlyab , Enrique Mallada , Colin Jones , Draguna Vrabie , Steven L. Brunton , Rolf Findeisen

Physical learning is an emerging paradigm in science and engineering whereby (meta)materials acquire desired macroscopic behaviors by exposure to examples. So far, it has been applied to static properties such as elastic moduli and…

Dynamic environments pose great challenges for expensive optimization problems, as the objective functions of these problems change over time and thus require remarkable computational resources to track the optimal solutions. Although…

Neural and Evolutionary Computing · Computer Science 2024-08-14 Huan Zhang , Jinliang Ding , Liang Feng , Kay Chen Tan , Ke Li

Learning-based control algorithms require data collection with abundant supervision for training. Safe exploration algorithms ensure the safety of this data collection process even when only partial knowledge is available. We present a new…

Robotics · Computer Science 2020-10-29 Yashwanth Kumar Nakka , Anqi Liu , Guanya Shi , Anima Anandkumar , Yisong Yue , Soon-Jo Chung

Offline reinforcement learning enables agents to leverage large pre-collected datasets of environment transitions to learn control policies, circumventing the need for potentially expensive or unsafe online data collection. Significant…

Machine Learning · Computer Science 2022-03-17 Cong Lu , Philip J. Ball , Jack Parker-Holder , Michael A. Osborne , Stephen J. Roberts

Applications that generate huge amounts of data in the form of fast streams are becoming increasingly prevalent, being therefore necessary to learn in an online manner. These conditions usually impose memory and processing time…

Neural and Evolutionary Computing · Computer Science 2019-08-22 Jesus L. Lobo , Javier Del Ser , Albert Bifet , Nikola Kasabov

Human movement prediction is difficult as humans naturally exhibit complex behaviors that can change drastically from one environment to the next. In order to alleviate this issue, we propose a prediction framework that decouples short-term…

Robotics · Computer Science 2020-03-19 Philipp Kratzer , Marc Toussaint , Jim Mainprice

Machine learning models have become indispensable tools in applications across the physical sciences. Their training is often time-consuming, vastly exceeding the inference timescales. Several protocols have been developed to perturb the…

Machine Learning · Computer Science 2025-06-25 Sagi Meir , Tommer D. Keidar , Shlomi Reuveni , Barak Hirshberg

In this work, we devise a new, general-purpose reinforcement learning strategy for the optimal control of parametric dynamical systems. Such problems frequently arise in applied sciences and engineering and entail a significant complexity…

Machine Learning · Computer Science 2026-02-12 Nicolò Botteghi , Stefania Fresca , Mengwu Guo , Andrea Manzoni

Understanding the learning dynamics of neural networks is one of the key issues for the improvement of optimization algorithms as well as for the theoretical comprehension of why deep neural nets work so well today. In this paper, we…

Machine Learning · Statistics 2021-03-18 Zhenyu Liao , Romain Couillet

Social science studies dealing with control in networks typically resort to heuristics or describing the static control distribution. Optimal policies, however, require interventions that optimize control over a socioeconomic network…

Social and Information Networks · Computer Science 2021-08-24 Jannes Nys , Milan van den Heuvel , Koen Schoors , Bruno Merlevede

A growing body of research indicates that structural plasticity mechanisms are crucial for learning and memory consolidation. Starting from a simple phenomenological model, we exploit a mean-field approach to develop a theoretical framework…

Neurons and Cognition · Quantitative Biology 2024-06-19 Gianmarco Tiddia , Luca Sergi , Bruno Golosio

Dynamic nonlinear systems exhibit distortions arising from coupled static and dynamic effects. Their intertwined nature poses major challenges for data-driven modeling. This paper presents a theoretical framework grounded in structured…

Machine Learning · Computer Science 2025-09-23 Sri Satish Krishna Chaitanya Bulusu , Mikko Sillanpää

Machine learning assumes a pivotal role in our data-driven world. The increasing scale of models and datasets necessitates quick and reliable algorithms for model training. This dissertation investigates adaptivity in machine learning…

Machine Learning · Computer Science 2023-11-20 Slavomír Hanzely

In this paper, we address the problem of reference tracking for uncertain nonlinear systems. Since collecting data from the target system (i.e., the system of interest) is often challenging, our objective is to design optimal controllers…

Artificial Intelligence · Computer Science 2026-05-22 Jiaqi Yan , Ankush Chakrabarty , Niklas Schmid , John Lygeros , Alisa Rupenyan

Many machine learning algorithms can be interpreted as procedures for estimating functions defined on the data distribution. In this paper we present a conceptual framework that formulates a wide range of learning problems as variational…

Machine Learning · Computer Science 2026-03-17 K. Lakshmanan