English
Related papers

Related papers: Automaton Constrained Q-Learning

200 papers

Offline multi-agent reinforcement learning is challenging due to the coupling effect of both distribution shift issue common in offline setting and the high dimension issue common in multi-agent setting, making the action…

Artificial Intelligence · Computer Science 2023-09-25 Jianzhun Shao , Yun Qu , Chen Chen , Hongchang Zhang , Xiangyang Ji

Reinforcement learning (RL) has been successfully applied to a variety of robotics applications, where it outperforms classical methods. However, the safety aspect of RL and the transfer to the real world remain an open challenge. A…

Robotics · Computer Science 2025-04-21 Murad Dawood , Ahmed Shokry , Maren Bennewitz

Time-optimal path tracking, as a significant tool for industrial robots, has attracted the attention of numerous researchers. In most time-optimal path tracking problems, the actuator torque constraints are assumed to be conservative, which…

Robotics · Computer Science 2019-07-11 Jiadong Xiao , Lin Li , Yanbiao Zou , Tie Zhang

Deep reinforcement learning continues to show tremendous potential in achieving task-level autonomy, however, its computational and energy demands remain prohibitively high. In this paper, we tackle this problem by applying quantization to…

Recent advancements in large language models (LLMs) have enabled a new research domain, LLM agents, for solving robotics and planning tasks by leveraging the world knowledge and general reasoning abilities of LLMs obtained during…

Robotics · Computer Science 2023-11-29 Ziyi Yang , Shreyas S. Raman , Ankit Shah , Stefanie Tellex

Work-Related Musculoskeletal Disorders continue to be a major challenge in industrial environments, leading to reduced workforce participation, increased healthcare costs, and long-term disability. This study introduces a human-sensitive…

Robotics · Computer Science 2025-04-15 Vitor Martins , Sara M. Cerqueira , Mercedes Balcells , Elazer R Edelman , Cristina P. Santos

Standard approaches to goal-conditioned reinforcement learning (GCRL) that rely on temporal-difference learning can be unstable and sample-inefficient due to bootstrapping. While recent work has explored contrastive and supervised…

Machine Learning · Computer Science 2026-04-21 Franki Nguimatsia Tiofack , Fabian Schramm , Théotime Le Hellard , Justin Carpentier

Automated Machine Learning (AutoML) offers a promising approach to streamline the training of machine learning models. However, existing AutoML frameworks are often limited to unimodal scenarios and require extensive manual configuration.…

Machine Learning · Computer Science 2024-08-02 Daqin Luo , Chengjian Feng , Yuxuan Nong , Yiqing Shen

Constrained reinforcement learning (CRL) has gained significant interest recently, since safety constraints satisfaction is critical for real-world problems. However, existing CRL methods constraining discounted cumulative costs generally…

Machine Learning · Computer Science 2022-06-08 Dongjie Yu , Haitong Ma , Shengbo Eben Li , Jianyu Chen

Mechanical ventilation (MV) is a life-saving intervention for patients with acute respiratory failure (ARF) in the ICU. However, inappropriate ventilator settings could cause ventilator-induced lung injury (VILI). Also, clinicians workload…

Machine Learning · Computer Science 2026-03-13 Hang Yu , Huidong Liu , Qingchen Zhang , William Joy , Kateryna Nikulina , Andreas A. Schuppert , Sina Saffaran , Declan Bates

High-dimensional reinforcement learning(RL) faces challenges with complex calculations and low sample efficiency in large state-action spaces. Q-learning algorithms struggle particularly with the curse of dimensionality, where the number of…

Machine Learning · Computer Science 2026-04-09 Junyi Wu , Dan Li

We present LARL-RM (Large language model-generated Automaton for Reinforcement Learning with Reward Machine) algorithm in order to encode high-level knowledge into reinforcement learning using automaton to expedite the reinforcement…

Machine Learning · Computer Science 2024-02-13 Shayan Meshkat Alsadat , Jean-Raphael Gaglione , Daniel Neider , Ufuk Topcu , Zhe Xu

Deep Reinforcement Learning (RL) has considerably advanced over the past decade. At the same time, state-of-the-art RL algorithms require a large computational budget in terms of training time to converge. Recent work has started to…

Offline Reinforcement learning (RL) has shown potent in many safe-critical tasks in robotics where exploration is risky and expensive. However, it still struggles to acquire skills in temporally extended tasks. In this paper, we study the…

Robotics · Computer Science 2022-05-25 Jinning Li , Chen Tang , Masayoshi Tomizuka , Wei Zhan

Despite the fact that deep reinforcement learning (RL) has surpassed human-level performances in various tasks, it still has several fundamental challenges. First, most RL methods require intensive data from the exploration of the…

Machine Learning · Computer Science 2021-07-06 Zhe Xu , Bo Wu , Aditya Ojha , Daniel Neider , Ufuk Topcu

Converting high-level tasks described by natural language into formal specifications like Linear Temporal Logic (LTL) is a key step towards providing formal safety guarantees over cyber-physical systems (CPS). While the compliance of the…

Logic in Computer Science · Computer Science 2026-04-28 Junle Li , Siqi Chen , Jiakai Li , Meiqi Tian , Bingzhuo Zhong

Reinforcement learning (RL) has demonstrated considerable potential for enhancing reasoning in large language models (LLMs). However, existing methods suffer from Gradient Starvation and Policy Degradation when training directly on samples…

Machine Learning · Computer Science 2025-11-13 Renda Li , Hailang Huang , Fei Wei , Feng Xiong , Yong Wang , Xiangxiang Chu

Constrained reinforcement learning has achieved promising progress in safety-critical fields where both rewards and constraints are considered. However, constrained reinforcement learning methods face challenges in striking the right…

Machine Learning · Computer Science 2024-10-29 Jianmina Ma , Jingtian Ji , Yue Gao

Recent advancements in quantum computing (QC) and machine learning (ML) have sparked considerable interest in the integration of these two cutting-edge fields. Among the various ML techniques, reinforcement learning (RL) stands out for its…

Quantum Physics · Physics 2024-09-10 Samuel Yen-Chi Chen

Curriculum learning is a training mechanism in reinforcement learning (RL) that facilitates the achievement of complex policies by progressively increasing the task difficulty during training. However, designing effective curricula for a…

Robotics · Computer Science 2025-04-16 Kanghyun Ryu , Qiayuan Liao , Zhongyu Li , Payam Delgosha , Koushil Sreenath , Negar Mehr