English
Related papers

Related papers: Convergence of machine learning methods for feedba…

200 papers

This work shows that value-aware model learning, known for its numerous theoretical benefits, is also practically viable for solving challenging continuous control tasks in prevalent model-based reinforcement learning algorithms. First, we…

Machine Learning · Computer Science 2022-01-31 Nirbhay Modhe , Harish Kamath , Dhruv Batra , Ashwin Kalyan

This paper analyzes reinforcement learning (RL) algorithms for Markov decision processes (MDPs) under the average-reward criterion. We focus on Q-learning algorithms based on relative value iteration (RVI), which are model-free stochastic…

Machine Learning · Computer Science 2024-08-30 Yi Wan , Huizhen Yu , Richard S. Sutton

In this era of "big" data, not only the large amount of data keeps motivating distributed computing, but concerns on data privacy also put forward the emphasis on distributed learning. To conduct feature selection and to control the false…

Methodology · Statistics 2020-08-11 Yu Gui

Autonomous agents must often deal with conflicting requirements, such as completing tasks using the least amount of time/energy, learning multiple tasks, or dealing with multiple opponents. In the context of reinforcement learning~(RL),…

Machine Learning · Computer Science 2019-10-30 Santiago Paternain , Luiz F. O. Chamon , Miguel Calvo-Fullana , Alejandro Ribeiro

We propose a general strategy for feedback control design of complex dynamical systems exploiting the nonlinear mechanisms in a systematic unsupervised manner. These dynamical systems can have a state space of arbitrary dimension with…

Chaotic Dynamics · Physics 2013-11-22 Thomas Duriez , Vladimir Parezanovic , Bernd R. Noack , Laurent Cordier , Marc Segond , Markus Abel

Generating droplets from a continuous stream of fluid requires precise tuning of a device to find optimized control parameter conditions. It is analytically intractable to compute the necessary control parameter values of a…

Machine Learning · Computer Science 2022-01-19 Alexander E. Siemenn , Evyatar Shaulsky , Matthew Beveridge , Tonio Buonassisi , Sara M. Hashmi , Iddo Drori

The paper considers independent reinforcement learning (IRL) for multi-agent decision-making process in the paradigm of federated learning (FL). We show that FL can clearly improve the policy performance of IRL in terms of training…

Machine Learning · Computer Science 2022-02-01 Xing Xu , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

Federated learning paradigm to utilize datasets across multiple data providers. In FL, cross-silo data providers often hesitate to share their high-quality dataset unless their data value can be fairly assessed. Shapley value (SV) has been…

Machine Learning · Computer Science 2025-04-24 Shuyue Wei , Yongxin Tong , Zimu Zhou , Tianran He , Yi Xu

Synchronous federated learning (FL) scales poorly with the number of clients due to the straggler effect. Algorithms like FedAsync and GeneralizedFedAsync address this limitation by enabling asynchronous communication between clients and…

Machine Learning · Computer Science 2025-10-23 Abdelkrim Alahyane , Céline Comte , Matthieu Jonckheere , Éric Moulines

Detecting abnormal driving behavior is critical for road traffic safety and the evaluation of drivers' behavior. With the advancement of machine learning (ML) algorithms and the accumulation of naturalistic driving data, many ML models have…

Machine Learning · Computer Science 2025-03-19 Yongqi Dong , Lanxin Zhang , Haneen Farah , Arkady Zgonnikov , Bart van Arem

Breaking safety constraints in control systems can lead to potential risks, resulting in unexpected costs or catastrophic damage. Nevertheless, uncertainty is ubiquitous, even among similar tasks. In this paper, we develop a novel adaptive…

Systems and Control · Electrical Eng. & Systems 2023-07-17 Shengbo Wang , Ke Li , Yin Yang , Yuting Cao , Tingwen Huang , Shiping Wen

We investigate reinforcement learning in the setting of Markov decision processes for a large number of exchangeable agents interacting in a mean field manner. Applications include, for example, the control of a large number of robots…

Optimization and Control · Mathematics 2025-04-30 René Carmona , Mathieu Laurière , Zongjun Tan

In this work we present a general machine learning based scheme to optimize experimental control. The method utilizes the neural network to learn the relation between the control parameters and the control goal, with which the optimal…

Quantum Gases · Physics 2020-11-03 Yadong Wu , Zengming Meng , Kai Wen , Chengdong Mi , Jing Zhang , Hui Zhai

Autonomous driving has gained significant advancements in recent years. However, obtaining a robust control policy for driving remains challenging as it requires training data from a variety of scenarios, including rare situations (e.g.,…

Robotics · Computer Science 2019-07-23 Weizi Li , David Wolinski , Ming C. Lin

The beneficial effects of treatments vary across individuals in most studies. Treatment heterogeneity motivates practitioners to search for the optimal policy based on personal characteristics. A long-standing common practice in policy…

Statistics Theory · Mathematics 2025-01-06 Xuqiao Li , Ying Yan

The stable combination of optimal feedback policies with online learning is studied in a new control-theoretic framework for uncertain nonlinear systems. The framework can be systematically used in transfer learning and sim-to-real…

Systems and Control · Electrical Eng. & Systems 2022-04-13 Brett T. Lopez , Jean-Jacques E. Slotine

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

This paper proposes an off-policy risk-sensitive reinforcement learning based control framework for stabilization of a continuous-time nonlinear system that subjects to additive disturbances, input saturation, and state constraints. By…

Systems and Control · Electrical Eng. & Systems 2022-04-21 Cong Li , Qingchen Liu , Zhehua Zhou , Martin Buss , Fangzhou Liu

Ensuring safety in the sense of constraint satisfaction for learning-based control is a critical challenge, especially in the model-free case. While safety filters address this challenge in the model-based setting by modifying unsafe…

Systems and Control · Electrical Eng. & Systems 2026-01-15 Kanghui He , Shengling Shi , Ton van den Boom , Bart De Schutter

A learning approach for optimal feedback gains for nonlinear continuous time control systems is proposed and analysed. The goal is to establish a rigorous framework for computing approximating optimal feedback gains using neural networks.…

Optimization and Control · Mathematics 2020-08-27 Karl Kunisch , Daniel Walter