English
Related papers

Related papers: Fulfilling Formal Specifications ASAP by Model-fre…

200 papers

In many real-world scenarios, reward signal for agents are exceedingly sparse, making it challenging to learn an effective reward function for reward shaping. To address this issue, the proposed approach in this paper performs reward…

Machine Learning · Computer Science 2026-05-18 Wenyun Li , Wenjie Huang , Chen Sun

Many policy-based reinforcement learning (RL) algorithms can be viewed as instantiations of approximate policy iteration (PI), i.e., where policy improvement and policy evaluation are both performed approximately. In applications where the…

Machine Learning · Computer Science 2023-06-29 Yashaswini Murthy , Mehrdad Moharrami , R. Srikant

Learning-based methods have enabled robots to acquire bio-inspired movements with increasing levels of naturalness and adaptability. Among these, Imitation Learning (IL) has proven effective in transferring complex motion patterns from…

Robotics · Computer Science 2025-09-30 Nayari Marie Lessa , Melya Boukheddimi , Frank Kirchner

In continuing tasks, average-reward reinforcement learning may be a more appropriate problem formulation than the more common discounted reward formulation. As usual, learning an optimal policy in this setting typically requires a large…

Artificial Intelligence · Computer Science 2023-01-18 Yuqian Jiang , Sudarshanan Bharadwaj , Bo Wu , Rishi Shah , Ufuk Topcu , Peter Stone

The average-reward formulation of reinforcement learning (RL) has drawn increased interest in recent years for its ability to solve temporally-extended problems without relying on discounting. Meanwhile, in the discounted setting,…

Machine Learning · Computer Science 2025-08-06 Jacob Adamczyk , Volodymyr Makarenko , Stas Tiomkin , Rahul V. Kulkarni

The recent success of reinforcement learning's (RL) in solving complex tasks is most often attributed to its capacity to explore and exploit an environment where it has been trained. Sample efficiency is usually not an issue since cheap…

Computation and Language · Computer Science 2023-03-16 Govardana Sachithanandam Ramachandran , Kazuma Hashimoto , Caiming Xiong

Deep research systems, agentic AI that solve complex, multi-step tasks by coordinating reasoning, search across the open web and user files, and tool use, are moving toward hierarchical deployments with a Planner, Coordinator, and…

Artificial Intelligence · Computer Science 2025-11-06 Wenjun Li , Zhi Chen , Jingru Lin , Hannan Cao , Wei Han , Sheng Liang , Zhi Zhang , Kuicai Dong , Dexun Li , Chen Zhang , Yong Liu

We propose an actor-critic, model-free, and online Reinforcement Learning (RL) framework for continuous-state continuous-action Markov Decision Processes (MDPs) when the reward is highly sparse but encompasses a high-level temporal…

Machine Learning · Computer Science 2019-11-26 Lim Zun Yuan , Mohammadhosein Hasanbeig , Alessandro Abate , Daniel Kroening

Reinforcement learning based adaptive/approximate dynamic programming (ADP) is a powerful technique to determine an approximate optimal controller for a dynamical system. These methods bypass the need to analytically solve the nonlinear…

Optimization and Control · Mathematics 2018-05-24 Xuefeng Bao , Zhi-Hong Mao , Nitin Sharma

Sparse-reward reinforcement learning (RL) remains fundamentally hard: without structure, any agent needs $\Omega(|\mathcal{S}||\mathcal{A}|/p)$ samples to recover rewards. We introduce Policy-Aware Matrix Completion (PAMC) as a first…

Machine Learning · Computer Science 2025-09-10 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

We develop an inductive proof-technique to generate imperative programs for pointer data structures from behavioural specifications expressed in the Answer Set Programming (ASP) formalism. ASP is a non-monotonic logic based formalism that…

Logic in Computer Science · Computer Science 2020-08-14 Sarat Chandra Varanasi , Neeraj Mittal , Gopal Gupta

Although Reinforcement Learning (RL) is effective for sequential decision-making problems under uncertainty, it still fails to thrive in real-world systems where risk or safety is a binding constraint. In this paper, we formulate the RL…

Machine Learning · Computer Science 2022-07-07 Yannis Flet-Berliac , Debabrota Basu

This paper proposes a new method to drastically speed up deep reinforcement learning (deep RL) training for problems that have the property of state-action permissibility (SAP). Two types of permissibility are defined under SAP. The first…

Machine Learning · Computer Science 2022-10-31 Sahisnu Mazumder , Bing Liu , Shuai Wang , Yingxuan Zhu , Xiaotian Yin , Lifeng Liu , Jian Li

Data preparation is a foundational yet notoriously challenging component of the machine learning lifecycle, characterized by a vast combinatorial search space. While reinforcement learning (RL) offers a promising direction, state-of-the-art…

Databases · Computer Science 2025-07-29 Jing Chang , Chang Liu , Jinbin Huang , Shuyuan Zheng , Rui Mao , Jianbin Qin

Persona-driven role-playing (PRP) aims to build AI characters that can respond to user queries by faithfully sticking with all persona statements. Unfortunately, existing faithfulness criteria for PRP are limited to coarse-grained LLM-based…

Computation and Language · Computer Science 2024-10-17 Letian Peng , Jingbo Shang

Reinforcement learning (RL) algorithms are highly sensitive to reward function specification, which remains a central challenge limiting their broad applicability. We present ARM-FM: Automated Reward Machines via Foundation Models, a…

Artificial Intelligence · Computer Science 2026-03-10 Roger Creus Castanyer , Faisal Mohamed , Pablo Samuel Castro , Cyrus Neary , Glen Berseth

Enforcing state and input constraints during reinforcement learning (RL) in continuous state spaces is an open but crucial problem which remains a roadblock to using RL in safety-critical applications. This paper leverages invariant sets to…

Systems and Control · Electrical Eng. & Systems 2019-06-28 Ankush Chakrabarty , Rien Quirynen , Claus Danielson , Weinan Gao

Autonomous parking (AP) represents a critical yet complex subset of intelligent vehicle automation, characterized by tight spatial constraints, frequent close-range obstacle interactions, and stringent safety margins. However, conventional…

Robotics · Computer Science 2025-08-05 Ahmad Suleman , Misha Urooj Khan , Zeeshan Kaleem , Ali H. Alenezi , Iqra Shabbir , Sinem Coleri , Chau Yuen

Large Language Models (LLMs) can generate code from natural language, but their performance is highly sensitive to prompt formulation. We propose a reinforcement-learning-based framework that models prompt refinement as a sequential…

Software Engineering · Computer Science 2026-05-20 Ali Mohammadi Esfahani , Nafiseh Kahani , Samuel A. Ajila

Reinforcement Learning is a highly active research field with promising advancements. In the field of autonomous driving, however, often very simple scenarios are being examined. Common approaches use non-interpretable control commands as…

Machine Learning · Computer Science 2025-05-06 Daniel Bogdoll , Jing Qin , Moritz Nekolla , Ahmed Abouelazm , Tim Joseph , J. Marius Zöllner