English
Related papers

Related papers: Balancing Expressivity and Robustness: Constrained…

200 papers

Signal temporal logic (STL) is a powerful tool for describing complex behaviors for dynamical systems. Among many approaches, the control problem for systems under STL task constraints is well suited for learning-based solutions, because…

Systems and Control · Electrical Eng. & Systems 2020-03-16 Peter Varnai , Dimos V. Dimarogonas

While most AI alignment research focuses on preventing models from generating explicitly harmful content, a more subtle risk is emerging: capability-oriented training induced exploitation. We investigate whether language models, when…

Machine Learning · Computer Science 2026-02-13 Yujun Zhou , Yue Huang , Han Bao , Kehan Guo , Zhenwen Liang , Pin-Yu Chen , Tian Gao , Werner Geyer , Nuno Moniz , Nitesh V Chawla , Xiangliang Zhang

Deep learning systems achieve remarkable empirical performance, yet the stability of the training process itself remains poorly understood. Training unfolds as a high-dimensional dynamical system in which small perturbations to…

Machine Learning · Computer Science 2026-01-21 Zhipeng Zhang , Zhenjie Yao , Kai Li , Lei Yang

We study a class of reinforcement learning problems where the reward signals for policy learning are generated by an internal reward model that is dependent on and jointly optimized with the policy. This interdependence between the policy…

Machine Learning · Computer Science 2023-08-28 Mengdi Li , Xufeng Zhao , Jae Hee Lee , Cornelius Weber , Stefan Wermter

The objective of a reinforcement learning agent is to discover better actions through exploration. However, typical exploration techniques aim to maximize rewards, often incurring high costs in both exploration and learning processes. We…

Machine Learning · Computer Science 2024-12-24 Akane Tsuboya , Yu Kono , Tatsuji Takahashi

Large reasoning models (LRMs) extend large language models by generating explicit chain-of-thought (CoT) reasoning, significantly improving mathematical and logical problem solving. However, this explicit reasoning process also introduces…

Computation and Language · Computer Science 2025-12-02 Jinghan Jia , Nathalie Baracaldo , Sijia Liu

Effectively scaling up deep reinforcement learning models has proven notoriously difficult due to network pathologies during training, motivating various targeted interventions such as periodic reset and architectural advances such as layer…

Machine Learning · Computer Science 2025-06-23 Guozheng Ma , Lu Li , Zilin Wang , Li Shen , Pierre-Luc Bacon , Dacheng Tao

Reinforcement learning (RL) post-training is a critical stage in modern language model development, playing a key role in improving alignment and reasoning ability. However, several phenomena remain poorly understood, including the…

Machine Learning · Computer Science 2026-01-09 Akiyoshi Tomihari

We investigate the important problem of certifying stability of reinforcement learning policies when interconnected with nonlinear dynamical systems. We show that by regulating the input-output gradients of policies, strong guarantees of…

Systems and Control · Computer Science 2018-10-30 Ming Jin , Javad Lavaei

This paper proposes a new design method for a stochastic control policy using a normalizing flow (NF). In reinforcement learning (RL), the policy is usually modeled as a distribution model with trainable parameters. When this…

Robotics · Computer Science 2024-12-18 Taisuke Kobayashi , Takumi Aotani

Vision-Language-Action (VLA) models have shown strong performance on embodied manipulation, yet they remain brittle under visual observation changes, paraphrased language instructions, and compounded perturbations. This limitation suggests…

Robotics · Computer Science 2026-05-20 Jingzhou Luo , Yifan Wen , Yongjie Bai , Xinshuai Song , Yang Liu , Liang Lin

Reinforcement learning (RL) has been widely applied to sequential decision making, where interpretability and performance are both critical for practical adoption. Current approaches typically focus on performance and rely on post hoc…

Machine Learning · Computer Science 2025-10-07 Qianxin Yi , Shao-Bo Lin , Jun Fan , Yao Wang

It is difficult to create robust, reusable, and reactive behaviors for robots that can be easily extended and combined. Frameworks such as Behavior Trees are flexible but difficult to characterize, especially when designing reactions and…

Robotics · Computer Science 2019-08-07 Chris Paxton , Nathan Ratliff , Clemens Eppner , Dieter Fox

Lack of reliability is a well-known issue for reinforcement learning (RL) algorithms. This problem has gained increasing attention in recent years, and efforts to improve it have grown substantially. To aid RL researchers and production…

Machine Learning · Statistics 2020-02-14 Stephanie C. Y. Chan , Samuel Fishman , John Canny , Anoop Korattikara , Sergio Guadarrama

Random feature (RF) method is a powerful kernel approximation technique, but is typically equipped with fixed activation functions, limiting its adaptability across diverse tasks. To overcome this limitation, we introduce the Random Feature…

Machine Learning · Computer Science 2025-11-06 Zailin Ma , Jiansheng Yang , Yaodong Yang

Elastic metamaterials are often designed for a single permanent function. We explore the possibility of altering a material's function repeatedly through a self-organization, "training" process, controlled by applied strains. We show that…

Soft Condensed Matter · Physics 2021-03-16 Daniel Hexner

Human learning is a complex phenomenon requiring flexibility to adapt existing brain function and precision in selecting new neurophysiological activities to drive desired behavior. These two attributes -- flexibility and selection -- must…

Neurons and Cognition · Quantitative Biology 2013-06-28 Danielle S. Bassett , Nicholas F. Wymbs , Mason A. Porter , Peter J. Mucha , Jean M. Carlson , Scott T. Grafton

We study the problem of training and fine-tuning expressive policies with online reinforcement learning (RL) given an offline dataset. Training expressive policy classes with online RL present a unique challenge of stable value…

Machine Learning · Computer Science 2026-05-01 Perry Dong , Qiyang Li , Dorsa Sadigh , Chelsea Finn

Solving real-world manipulation tasks requires robots to have a repertoire of skills applicable to a wide range of circumstances. When using learning-based methods to acquire such skills, the key challenge is to obtain training data that…

Robotics · Computer Science 2023-04-19 Kuan Fang , Toki Migimatsu , Ajay Mandlekar , Li Fei-Fei , Jeannette Bohg

This research focuses on enhancing reinforcement learning (RL) algorithms by integrating penalty functions to guide agents in avoiding unwanted actions while optimizing rewards. The goal is to improve the learning process by ensuring that…

Machine Learning · Computer Science 2025-04-07 Sai Gana Sandeep Pula , Sathish A. P. Kumar , Sumit Jha , Arvind Ramanathan