English
Related papers

Related papers: ARCANE: A Multi-Agent Framework for Interpretable …

200 papers

Automated short-answer grading (ASAG) remains a challenging task due to the linguistic variability of student responses and the need for nuanced, rubric-aligned partial credit. While Large Language Models (LLMs) offer a promising solution,…

Computation and Language · Computer Science 2026-01-15 Haotian Deng , Chris Farber , Jiyoon Lee , David Tang

The deployment of decision-making AI agents presents a critical challenge in maintaining alignment with human values or guidelines while operating in complex, dynamic environments. Agents trained solely to achieve their objectives may adopt…

Artificial Intelligence · Computer Science 2025-12-09 Dena Mujtaba , Brian Hu , Anthony Hoogs , Arslan Basharat

Responsible AI has risen to the forefront of the AI research community. As neural network-based learning algorithms continue to permeate real-world applications, the field of Responsible AI has played a large role in ensuring that such…

Artificial Intelligence · Computer Science 2023-11-06 Niko A. Grupen

The black-box nature of deep reinforcement learning (RL) hinders them from real-world applications. Therefore, interpreting and explaining RL agents have been active research topics in recent years. Existing methods for post-hoc…

Machine Learning · Computer Science 2023-09-06 Qisen Yang , Huanqian Wang , Mukun Tong , Wenjie Shi , Gao Huang , Shiji Song

Statistical spoken dialogue systems have the attractive property of being able to be optimised from data via interactions with real users. However in the reinforcement learning paradigm the dialogue manager (agent) often requires…

Machine Learning · Computer Science 2015-08-19 Pei-Hao Su , David Vandyke , Milica Gasic , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

Many studies have applied reinforcement learning to train a dialog policy and show great promise these years. One common approach is to employ a user simulator to obtain a large number of simulated user experiences for reinforcement…

Computation and Language · Computer Science 2020-04-24 Ryuichi Takanobu , Runze Liang , Minlie Huang

Preference-based reward learning is widely used for shaping agent behavior to match a user's preference, yet its sparse binary feedback makes it especially vulnerable to causal confusion. The learned reward often latches onto spurious…

Artificial Intelligence · Computer Science 2026-03-06 Minjune Hwang , Yigit Korkmaz , Daniel Seita , Erdem Bıyık

Recent work has shown that deep reinforcement-learning agents can learn to follow language-like instructions from infrequent environment rewards. However, this places on environment designers the onus of designing language-conditional…

Artificial Intelligence · Computer Science 2019-12-24 Dzmitry Bahdanau , Felix Hill , Jan Leike , Edward Hughes , Arian Hosseini , Pushmeet Kohli , Edward Grefenstette

Developing an agent capable of adapting to unseen environments remains a difficult challenge in imitation learning. This work presents Adaptive Return-conditioned Policy (ARP), an efficient framework designed to enhance the agent's…

Machine Learning · Computer Science 2023-10-26 Changyeon Kim , Younggyo Seo , Hao Liu , Lisa Lee , Jinwoo Shin , Honglak Lee , Kimin Lee

The open-ended generation in LLMs usually requires multi-dimensional rubrics to adequately assess quality and guide the improvement of reinforcement learning. However, a critical dilemma inherent in this training paradigm is the imbalanced…

Machine Learning · Computer Science 2026-05-27 Yu Huang , Zihua Zhao , Zhaoxin Huan , Wanli Gu , Feng Hong , Xinmu Ge , Lin Yuan , Weichang Wu , Qiang Hu , Xiaolu Zhang , Jun Zhou , Jiangchao Yao

Language model alignment is a critical step in training modern generative language models. Alignment targets to improve win rate of a sample from the aligned model against the base model. Today, we are increasingly using inference-time…

Existing Agent benchmarks suffer from two critical limitations: high environment interaction overhead (up to 41\% of total evaluation time) and imbalanced task horizon and difficulty distributions that make aggregate scores unreliable. To…

Artificial Intelligence · Computer Science 2026-04-13 Wang Yang , Chaoda Song , Xinpeng Li , Debargha Ganguly , Chuang Ma , Shouren Wang , Zhihao Dou , Yuli Zhou , Vipin Chaudhary , Xiaotian Han

AI agents are commonly aligned with "human values" through reinforcement learning from human feedback (RLHF), where a single reward model is learned from aggregated human feedback and used to align an agent's behavior. However, human values…

Artificial Intelligence · Computer Science 2025-06-24 Carter Blair , Kate Larson , Edith Law

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

Machine Learning · Computer Science 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

Large Language Models (LLMs) are increasingly used for clinical decision support, where hallucinations and unsafe suggestions may pose direct risks to patient safety. These risks are hard to assess: subtle clinical errors are often missed…

Computation and Language · Computer Science 2026-05-14 Yinzhu Chen , Abdine Maiga , Hossein A. Rahmani , Emine Yilmaz

Recent months have seen the emergence of a powerful new trend in which large language models (LLMs) are augmented to become autonomous language agents capable of performing objective oriented multi-step tasks on their own, rather than…

Argumentation is a very active research field of Artificial Intelligence concerned with the representation and evaluation of arguments used in dialogues between humans and/or artificial agents. Acceptability semantics of formal…

Artificial Intelligence · Computer Science 2025-03-05 Zlatina Mileva , Antonis Bikakis , Fabio Aurelio D'Asaro , Mark Law , Alessandra Russo

Training deep research agents, namely systems that plan, search, evaluate evidence, and synthesize long-form reports, pushes reinforcement learning beyond the regime of verifiable rewards. Their outputs lack ground-truth answers, their…

Reward modeling lies at the core of reinforcement learning from human feedback (RLHF), yet most existing reward models rely on scalar or pairwise judgments that fail to capture the multifaceted nature of human preferences. Recent studies…

Computation and Language · Computer Science 2026-02-04 Tianci Liu , Ran Xu , Tony Yu , Ilgee Hong , Carl Yang , Tuo Zhao , Haoyu Wang

Automating scientific computing workflows requires more than generating executable code: autonomous systems must also select appropriate computational strategies, implement them faithfully, and ensure that the resulting outcomes remain…

Artificial Intelligence · Computer Science 2026-05-29 Geremy Loachamín-Suntaxi , Robert Lazar , Dimitrios G. Giovanis , Ioannis G. Kevrekidis , Eleni D. Koronaki