English
Related papers

Related papers: MagicGUI-RMS: A Multi-Agent Reward Model System fo…

200 papers

Pre-trained Vision-Language-Action (VLA) models represent a major leap towards general-purpose robots, yet efficiently adapting them to novel, specific tasks in-situ remains a significant hurdle. While reinforcement learning (RL) is a…

Robotics · Computer Science 2026-04-10 Baicheng Li , Dong Wu , Zike Yan , Xinchen Liu , Lusong Li , Zecui Zeng , Hongbin Zha

Agentic reasoning models trained with multimodal reinforcement learning (MMRL) have become increasingly capable, yet they are almost universally optimized using sparse, outcome-based rewards computed based on the final answers. Richer…

While Large Language Models (LLMs) excel in certain reasoning tasks, they struggle in multi-agent games where the final outcome depends on the joint strategies of all agents. In multi-agent games, the non-stationarity of other agents brings…

Artificial Intelligence · Computer Science 2026-05-26 Yidong He , Yutao Lai , Pengxu Yang , Jiarui Gan , Jiexin Wang , Yi Cai , Mengchen Zhao

The rapid progress of large language models (LLMs) has sparked growing interest in building Artificial General Intelligence (AGI) within Graphical User Interface (GUI) environments. However, existing GUI agents based on LLMs or…

Artificial Intelligence · Computer Science 2025-05-27 Runliang Niu , Jinglong Ji , Yi Chang , Qi Wang

Reinforcement learning is increasingly used to transform large language models into agentic systems that act over long horizons, invoke tools, and manage memory under partial observability. While recent work has demonstrated performance…

Cryptography and Security · Computer Science 2026-01-01 Ken Huang , Jerry Huang

Existing LLM-based agents have achieved strong performance on held-in tasks, but their generalizability to unseen tasks remains poor. Hence, some recent work focus on fine-tuning the policy model with more diverse tasks to improve the…

Computation and Language · Computer Science 2025-02-26 Yu Xia , Jingru Fan , Weize Chen , Siyu Yan , Xin Cong , Zhong Zhang , Yaxi Lu , Yankai Lin , Zhiyuan Liu , Maosong Sun

Graphical user interfaces (GUIs) are the primary medium for human-computer interaction, yet automating GUI interactions remains challenging due to the complexity of visual elements, dynamic environments, and the need for multi-step…

GUI agents powered by vision-language models (VLMs) show promise in automating complex digital tasks. However, their effectiveness in real-world applications is often limited by scarce training data and the inherent complexity of these…

Computation and Language · Computer Science 2025-09-30 Ran Xu , Kaixin Ma , Wenhao Yu , Hongming Zhang , Joyce C. Ho , Carl Yang , Dong Yu

We study a sequential mechanism design problem in which a principal seeks to elicit truthful reports from multiple rational agents while starting with no prior knowledge of agents' beliefs. We introduce Distributionally Robust Adaptive…

Computer Science and Game Theory · Computer Science 2026-04-22 Qiushi Han , David Simchi-Levi , Renfei Tan , Zishuo Zhao

Reinforcement learning (RL) relies heavily on exploration to learn from its environment and maximize observed rewards. Therefore, it is essential to design a reward function that guarantees optimal learning from the received experience.…

Artificial Intelligence · Computer Science 2022-06-20 Ingy ElSayed-Aly , Lu Feng

The primary obstacle for applying reinforcement learning (RL) to real-world robotics is the design of effective reward functions. While recently learning-based Process Reward Models (PRMs) are a promising direction, they are often hindered…

Reward engineering, the manual specification of reward functions to induce desired agent behavior, remains a fundamental challenge in multi-agent reinforcement learning. This difficulty is amplified by credit assignment ambiguity,…

Artificial Intelligence · Computer Science 2026-01-14 Haoran Su , Yandong Sun , Congjia Yu

Reward Models (RMs) are key components for evaluating and guiding language model outputs. However, traditional scalar RMs often struggle with incorporating contextual and background information during inference, leading to incomplete…

Artificial Intelligence · Computer Science 2025-10-07 Xiaoyu Liu , Di Liang , Chang Dai , Hongyu Shan , Peiyang Liu , Yonghao Liu , Muling Wu , Yuntao Li , Xianjie Wu , LI Miao , Jiangrong Shen , Minlong Peng

Providing timely, consistent, and high-quality feedback in large-scale higher education courses remains a persistent challenge, often constrained by instructor workload and resource limitations. This study presents an LLM-powered, agentic…

Computers and Society · Computer Science 2026-01-13 Reza Vatankhah Barenji , Nazila Salimi , Sina Khoshgoftar

Language model (LM) agents have gained significant attention for their ability to autonomously complete tasks through interactions with environments, tools, and APIs. LM agents are primarily built with prompt engineering or supervised…

Artificial Intelligence · Computer Science 2025-07-22 Renxi Wang , Rifo Ahmad Genadi , Bilal El Bouardi , Yongxin Wang , Fajri Koto , Zhengzhong Liu , Timothy Baldwin , Haonan Li

We introduce Agent Process Reward Models (AgentPRM), a simple and scalable framework for training LLM agents to continually improve through interactions. AgentPRM follows a lightweight actor-critic paradigm, using Monte Carlo rollouts to…

Machine Learning · Computer Science 2025-02-17 Sanjiban Choudhury

Reward design plays a pivotal role in the training of game AIs, requiring substantial domain-specific knowledge and human effort. In recent years, several studies have explored reward generation for training game agents and controlling…

Artificial Intelligence · Computer Science 2026-05-26 In-Chang Baek , Sung-Hyun Kim , Sam Earle , Zehua Jiang , Jin-Ha Noh , Julian Togelius , Kyung-Joong Kim

Current mobile GUI agent benchmarks systematically fail to assess memory capabilities, with only 5.2-11.8% memory-related tasks and no cross-session learning evaluation. We introduce MemGUI-Bench, a comprehensive memory-centric benchmark…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-09 Guangyi Liu , Pengxiang Zhao , Yaozhen Liang , Qinyi Luo , Shunye Tang , Yuxiang Chai , Weifeng Lin , Han Xiao , WenHao Wang , Siheng Chen , Zhengxi Lu , Gao Wu , Hao Wang , Liang Liu , Yong Liu

Training effective Vision-Language Models (VLMs) for GUI agents typically depends on large-scale annotated datasets, whose collection is both labor-intensive and error-prone. We introduce K-step GUI Transition, a self-supervised inverse…

Artificial Intelligence · Computer Science 2025-10-13 Longxi Gao , Li Zhang , Pengzhi Gao , Wei Liu , Jian Luan , Mengwei Xu

Recently, remarkable progress has been made in Unified Multimodal Models (UMMs), which integrate vision-language generation and understanding capabilities within a single framework. However, a significant gap exists where a model's strong…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Weiyang Jin , Yuwei Niu , Jiaqi Liao , Chengqi Duan , Aoxue Li , Shenghua Gao , Xihui Liu