English
Related papers

Related papers: ProRe: A Proactive Reward System for GUI Agents vi…

200 papers

One of the key challenges in current Reinforcement Learning (RL)-based Automated Driving (AD) agents is achieving flexible, precise, and human-like behavior cost-effectively. This paper introduces an innovative approach that uses large…

Artificial Intelligence · Computer Science 2024-12-30 Ziqi Zhou , Jingyue Zhang , Jingyuan Zhang , Yangfan He , Boyue Wang , Tianyu Shi , Alaa Khamis

AI systems often rely on two key components: a specified goal or reward function and an optimization algorithm to compute the optimal behavior for that goal. This approach is intended to provide value for a principal: the user on whose…

Artificial Intelligence · Computer Science 2021-02-09 Simon Zhuang , Dylan Hadfield-Menell

Information-seeking is a core capability for AI agents, requiring them to gather and reason over tool-generated information across long trajectories. However, such multi-step information-seeking tasks remain challenging for agents backed by…

Artificial Intelligence · Computer Science 2025-11-25 Jaewoo Lee , Archiki Prasad , Justin Chih-Yao Chen , Zaid Khan , Elias Stengel-Eskin , Mohit Bansal

Automating real-world software engineering tasks remains challenging for large language model (LLM)-based agents due to the need for long-horizon reasoning over large, evolving codebases and making consistent decisions across interdependent…

Software Engineering · Computer Science 2026-04-14 Mahir Labib Dihan , Md Ashrafur Rahman Khan

Computer use agents (CUAs) have shown strong potential for automating complex digital workflows, yet their training remains constrained by costly live environment interaction and limited high-quality supervision. Existing filtered behavior…

Artificial Intelligence · Computer Science 2026-05-29 Yifei He , Rui Yang , Hao Bai , Tong Zhang , Han Zhao

LLM-based agents are increasingly moving towards proactivity: rather than awaiting instruction, they exercise agency to anticipate user needs and solve them autonomously. However, evaluating proactivity is challenging; current benchmarks…

Artificial Intelligence · Computer Science 2026-02-20 Gil Pasternak , Dheeraj Rajagopal , Julia White , Dhruv Atreja , Matthew Thomas , George Hurn-Maloney , Ash Lewis

The reasoning abilities of Large Language Models (LLMs) remain a topic of debate. Some methods such as ReAct-based prompting, have gained popularity for claiming to enhance sequential decision-making abilities of agentic LLMs. However, it…

Artificial Intelligence · Computer Science 2024-05-24 Mudit Verma , Siddhant Bhambri , Subbarao Kambhampati

Offline imitation learning (offline IL) enables training effective policies without requiring explicit reward annotations. Recent approaches attempt to estimate rewards for unlabeled datasets using a small set of expert demonstrations.…

Machine Learning · Computer Science 2025-11-19 Shengjie Sun , Jiafei Lyu , Runze Liu , Mengbei Yan , Bo Liu , Deheng Ye , Xiu Li

Reinforcement learning (RL) in long horizon and sparse reward tasks is notoriously difficult and requires a lot of training steps. A standard solution to speed up the process is to leverage additional reward signals, shaping it to better…

Computation and Language · Computer Science 2022-10-14 Thomas Carta , Pierre-Yves Oudeyer , Olivier Sigaud , Sylvain Lamprier

Rule-based reasoning is acknowledged as one of the fundamental problems of reasoning. While recent studies show that large reasoning models (LRMs) have remarkable reasoning capabilities enhanced by reinforcement learning (RL), real…

Computation and Language · Computer Science 2026-02-17 Yang Liu , Jiaqi Li , Zilong Zheng

Large language models are increasingly influencing human moral decisions, yet current approaches focus primarily on evaluating rather than actively steering their moral decisions. We formulate this as an out-of-distribution moral alignment…

Artificial Intelligence · Computer Science 2025-11-18 Zhiyu An , Wan Du

Exploration is a fundamental aspect of reinforcement learning (RL), and its effectiveness is a deciding factor in the performance of RL algorithms, especially when facing sparse extrinsic rewards. Recent studies have shown the effectiveness…

Machine Learning · Computer Science 2023-05-19 Shanchuan Wan , Yujin Tang , Yingtao Tian , Tomoyuki Kaneko

Current approaches to proactive assistance move beyond the ask-and-respond paradigm by anticipating user needs. In practice, they either burden users with clarifying questions or rely on context-based extrapolation, often leading to…

Machine Learning · Computer Science 2026-04-24 Kirandeep Kaur , Vinayak Gupta , Aditya Gupta , Chirag Shah

Reward models are critical for reinforcement learning from human feedback, as they determine the alignment quality and reliability of generative models. For complex tasks such as image editing, reward models are required to capture global…

Enabling agentic AI systems to adapt their problem-solving approaches based on post-training interactions remains a fundamental challenge. While systems that update and maintain a memory at inference time have been proposed, existing…

Artificial Intelligence · Computer Science 2025-11-17 Adam Stein , Matthew Trager , Benjamin Bowman , Michael Kleinman , Aditya Chattopadhyay , Wei Xia , Stefano Soatto

Recently, the development of large language models (LLMs) has been significantly enhanced the question answering and dialogue generation, and makes them become increasingly popular in current practical scenarios. While unlike the general…

Computation and Language · Computer Science 2023-09-19 Zhiyuan Hu , Yue Feng , Yang Deng , Zekun Li , See-Kiong Ng , Anh Tuan Luu , Bryan Hooi

As humans increasingly share environments with diverse agents powered by RL, LLMs, and beyond, the ability to explain agent policies in natural language is vital for reliable coexistence. We introduce a general-purpose framework that trains…

Computation and Language · Computer Science 2026-02-13 Xinyi Yang , Liang Zeng , Heng Dong , Chao Yu , Xiaoran Wu , Huazhong Yang , Yu Wang , Milind Tambe , Tonghan Wang

Mathematical reasoning is a key benchmark for large language models. Reinforcement learning is a standard post-training mechanism for improving the reasoning capabilities of large language models, yet performance remains sensitive to the…

Computation and Language · Computer Science 2026-05-11 Arash Ahmadi , Sarah Sharif , Yaser , Banad

Reinforcement learning (RL) has been widely adopted in post-training for large language models (LLMs) at scale. Recently, the incentivization of reasoning capabilities in LLMs from RL indicates that $\textit{proper learning methods could…

Computation and Language · Computer Science 2025-09-26 Zijun Liu , Peiyi Wang , Runxin Xu , Shirong Ma , Chong Ruan , Peng Li , Yang Liu , Yu Wu

Large reasoning models (LRMs) have recently achieved significant progress in complex reasoning tasks, aided by reinforcement learning with verifiable rewards. However, LRMs often suffer from overthinking, expending excessive computation on…

Artificial Intelligence · Computer Science 2025-08-19 Chuhuai Yue , Chengqi Dong , Yinan Gao , Hang He , Jiajun Chai , Guojun Yin , Wei Lin