English
Related papers

Related papers: SpecRLBench: A Benchmark for Generalization in Spe…

200 papers

This study presents a benchmark for evaluating action-constrained reinforcement learning (RL) algorithms. In action-constrained RL, each action taken by the learning system must comply with certain constraints. These constraints are crucial…

Machine Learning · Computer Science 2023-06-30 Kazumi Kasaura , Shuwa Miura , Tadashi Kozuno , Ryo Yonetani , Kenta Hoshino , Yohei Hosoe

The success of AI assistants based on language models (LLMs) hinges crucially on Reinforcement Learning from Human Feedback (RLHF), which enables the generation of responses more aligned with human preferences. As universal AI assistants,…

Machine Learning · Computer Science 2023-12-27 Rui Zheng , Wei Shen , Yuan Hua , Wenbin Lai , Shihan Dou , Yuhao Zhou , Zhiheng Xi , Xiao Wang , Haoran Huang , Tao Gui , Qi Zhang , Xuanjing Huang

Multi-turn instruction following capability constitutes a core competency of large language models (LLMs) in real-world applications. Existing evaluation benchmarks predominantly focus on fine-grained constraint satisfaction and…

Computation and Language · Computer Science 2025-06-02 Jinnan Li , Jinzhe Li , Yue Wang , Yi Chang , Yuan Wu

Deep regression networks are widely used to tackle the problem of predicting a continuous value for a given input. Task-specialized approaches for training regression networks have shown significant improvement over generic approaches, such…

Machine Learning · Computer Science 2023-03-07 Deval Shah , Tor M. Aamodt

Large Language Models (LLMs) display strikingly different generalization behaviors: supervised fine-tuning (SFT) often narrows capability, whereas reinforcement-learning (RL) tuning tends to preserve it. The reasons behind this divergence…

Machine Learning · Computer Science 2026-01-01 Haoyue Bai , Yiyou Sun , Wenjie Hu , Shi Qiu , Maggie Ziyu Huan , Peiyang Song , Robert Nowak , Dawn Song

This paper delves into designing stabilizing feedback control gains for continuous linear systems with unknown state matrix, in which the control is subject to a general structural constraint. We bring forth the ideas from reinforcement…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Sayak Mukherjee , Thanh Long Vu

With the development and widespread application of large language models (LLMs), the new paradigm of "Model as Product" is rapidly evolving, and demands higher capabilities to address complex user needs, often requiring precise workflow…

Computation and Language · Computer Science 2025-09-17 Tao Zou , Xinghua Zhang , Haiyang Yu , Minzheng Wang , Fei Huang , Yongbin Li

Reinforcement learning (RL) is one of the active fields in machine learning, demonstrating remarkable potential in tackling real-world challenges. Despite its promising prospects, this methodology has encountered with issues and challenges,…

Machine Learning · Computer Science 2024-11-21 Alireza Rashidi Laleh , Majid Nili Ahmadabadi

Reinforcement learning (RL) commonly relies on scalar rewards with limited ability to express temporal, conditional, or safety-critical goals, and can lead to reward hacking. Temporal logic expressible via the more general class of…

Artificial Intelligence · Computer Science 2025-11-26 Dominik Wagner , Leon Witzman , Luke Ong

Reinforcement Learning (RL) has shown remarkable success in solving relatively complex tasks, yet the deployment of RL systems in real-world scenarios poses significant challenges related to safety and robustness. This paper aims to…

Machine Learning · Computer Science 2024-04-02 Taku Yamagata , Raul Santos-Rodriguez

We propose a new Verbal Reinforcement Learning (VRL) framework for interpretable task-level planning in mobile robotic systems operating under execution uncertainty. The framework follows a closed-loop architecture that enables iterative…

Virtually all verification and synthesis techniques assume that the formal specifications are readily available, functionally correct, and fully match the engineer's understanding of the given system. However, this assumption is often…

Formal Languages and Automata Theory · Computer Science 2022-06-15 Simon Lutz , Daniel Neider , Rajarshi Roy

Preference-based reinforcement learning (PbRL) promises to learn a complex reward function with binary human preference. However, such human-in-the-loop formulation requires considerable human effort to assign preference labels to segment…

Machine Learning · Computer Science 2023-07-20 Yachen Kang , Li He , Jinxin Liu , Zifeng Zhuang , Donglin Wang

Large Language Models (LLMs) have achieved remarkable progress in recent years, driving their adoption across a wide range of domains, including computer security. In reverse engineering, LLMs are increasingly applied to critical tasks such…

Cryptography and Security · Computer Science 2026-05-01 Jun Yeon Won , Xin Jin , Shiqing Ma , Zhiqiang Lin

Reinforcement learning (RL) is a popular approach for robotic path planning in uncertain environments. However, the control policies trained for an RL agent crucially depend on user-defined, state-based reward functions. Poorly designed…

Artificial Intelligence · Computer Science 2024-12-05 Anand Balakrishnan , Stefan Jakšić , Edgar A. Aguilar , Dejan Ničković , Jyotirmoy V. Deshmukh

Language models often struggle to follow multi-constraint instructions that are crucial for real-world applications. Existing reinforcement learning (RL) approaches suffer from dependency on external supervision and sparse reward signals…

Computation and Language · Computer Science 2026-04-15 Qingyu Ren , Qianyu He , Powei Chang , Jie Zeng , Zeye Sun , Fei Yu , Jiaqing Liang , Yanghua Xiao

Scientific equation discovery is a fundamental task in the history of scientific progress, enabling the derivation of laws governing natural phenomena. Recently, Large Language Models (LLMs) have gained interest for this task due to their…

Computation and Language · Computer Science 2025-06-10 Parshin Shojaee , Ngoc-Hieu Nguyen , Kazem Meidani , Amir Barati Farimani , Khoa D Doan , Chandan K Reddy

Tool learning has emerged as a promising direction by extending Large Language Models' (LLMs) capabilities with external tools. Existing tool learning studies primarily focus on the general-purpose tool-use capability, which addresses…

Computation and Language · Computer Science 2025-02-27 Qiancheng Xu , Yongqi Li , Heming Xia , Fan Liu , Min Yang , Wenjie Li

Interactive recommender systems can dynamically adapt to user feedback, but often suffer from content homogeneity and filter bubble effects due to overfitting short-term user preferences. While recent efforts aim to improve content…

Information Retrieval · Computer Science 2026-05-12 Chongjun Xia , Yanchun Peng , Xianzhi Wang

Multi-task Reinforcement Learning (MTRL) has emerged as a critical training paradigm for applying reinforcement learning (RL) to a set of complex real-world robotic tasks, which demands a generalizable and robust policy. At the same time,…

Robotics · Computer Science 2025-08-04 Viraj Joshi , Zifan Xu , Bo Liu , Peter Stone , Amy Zhang