中文
相关论文

相关论文: InfiGUI-G1: Advancing GUI Grounding with Adaptive …

200 篇论文

Multimodal reasoning models (MRMs) trained with reinforcement learning with verifiable rewards (RLVR) show improved accuracy on visual reasoning benchmarks. However, we observe that accuracy gains often come at the cost of reasoning…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Sai Srinivas Kancheti , Aditya Kanade , Rohit Sinha , Vineeth N Balasubramanian , Tanuja Ganu

Existing Reinforcement Learning from Verifiable Rewards (RLVR) methods, such as Group Relative Policy Optimization (GRPO), have achieved remarkable progress in improving the reasoning capabilities of Large Reasoning Models (LRMs). However,…

机器学习 · 计算机科学 2026-04-16 Hsiu-Yuan Huang , Chenming Tang , Weijie Liu , Clive Bai , Saiyong Yang , Yunfang Wu

Graphical User Interface (GUI) grounding, the task of mapping natural language instructions to precise screen coordinates, is fundamental to autonomous GUI agents. While existing methods achieve strong performance through extensive…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Yong Du , Yuchen Yan , Fei Tang , Zhengxi Lu , Chang Zong , Weiming Lu , Shengpei Jiang , Yongliang Shen

Recent advances in Multimodal Large Language Models (MLLMs) have substantially driven the progress of autonomous agents for Graphical User Interface (GUI). Nevertheless, in real-world applications, GUI agents are often faced with…

人工智能 · 计算机科学 2026-02-17 Yibo Wang , Guangda Huzhang , Yuwei Hu , Yu Xia , Shiyin Lu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Lijun Zhang

Reinforcement learning (RL) agents are particularly hard to train when rewards are sparse. One common solution is to use intrinsic rewards to encourage agents to explore their environment. However, recent intrinsic exploration methods often…

机器学习 · 计算机科学 2022-11-23 Jesse Mu , Victor Zhong , Roberta Raileanu , Minqi Jiang , Noah Goodman , Tim Rocktäschel , Edward Grefenstette

The advent of autonomous agents is transforming interactions with Graphical User Interfaces (GUIs) by employing natural language as a powerful intermediary. Despite the predominance of Supervised Fine-Tuning (SFT) methods in current GUI…

机器学习 · 计算机科学 2026-04-22 Jiaqi Tang , Yu Xia , Yi-Feng Wu , Yuwei Hu , Yuhui Chen , Qing-Guo Chen , Xiaogang Xu , Xiangyu Wu , Hao Lu , Yanqing Ma , Shiyin Lu , Qifeng Chen

Reinforcement learning has become essential for strengthening the reasoning abilities of large language models, yet current exploration mechanisms remain fundamentally misaligned with how these models actually learn. Entropy bonuses and…

机器学习 · 计算机科学 2025-12-18 Zhenwen Liang , Sidi Lu , Wenhao Yu , Kishan Panaganti , Yujun Zhou , Haitao Mi , Dong Yu

Reinforcement Learning with Verifiable Rewards (RLVR) enhances Large Language Model (LLM) reasoning but suffers from advantage collapse on ``hard samples'' where all rollouts fail. This lack of variance eliminates crucial learning signals.…

机器学习 · 计算机科学 2026-05-08 Xinyu Lu , Kaiqi Zhang , Jinglin Yang , Boxi Cao , Yaojie Lu , Hongyu Lin , Min He , Xianpei Han , Le Sun

Large Language Models (LLMs) are increasingly deployed in business-critical domains such as finance, education, healthcare, and customer support, where users expect consistent and reliable recommendations. Yet LLMs often exhibit variability…

机器学习 · 计算机科学 2026-04-20 Sonal Prabhune , Balaji Padmanabhan , Kaushik Dutta

Generating grounded and trustworthy responses remains a key challenge for large language models (LLMs). While retrieval-augmented generation (RAG) with citation-based grounding holds promise, instruction-tuned models frequently fail even in…

计算与语言 · 计算机科学 2025-06-19 Shang Hong Sim , Tej Deep Pala , Vernon Toh , Hai Leong Chieu , Amir Zadeh , Chuan Li , Navonil Majumder , Soujanya Poria

Recent advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs) have made them powerful tools in embodied navigation, enabling agents to leverage commonsense and spatial reasoning for efficient exploration in…

Reward-based alignment methods for large language models (LLMs) face two key limitations: vulnerability to reward hacking, where models exploit flaws in the reward signal; and reliance on brittle, labor-intensive prompt engineering when…

计算与语言 · 计算机科学 2025-05-20 Zae Myung Kim , Chanwoo Park , Vipul Raheja , Suin Kim , Dongyeop Kang

State-of-the-art reinforcement learning (RL) algorithms typically use random sampling (e.g., $\epsilon$-greedy) for exploration, but this method fails on hard exploration tasks like Montezuma's Revenge. To address the challenge of…

机器学习 · 计算机科学 2022-11-21 Eric Chen , Zhang-Wei Hong , Joni Pajarinen , Pulkit Agrawal

Reinforcement Learning with Verifiable Rewards (RLVR) has become the standard paradigm for LLM mathematical reasoning, where Group Relative Policy Optimization (GRPO) serves as the mainstream algorithm. We point out two understudied…

人工智能 · 计算机科学 2026-05-14 Mingxiong Lin , Zhangquan Gong , Maowen Tang , Qian Li , Chuangchuang Wang , Jian Ma , Sutian Huang , Kai Tang , Haonan Lu

Post-training techniques combined with inference-time scaling significantly enhance the reasoning and alignment capabilities of large language models (LLMs). However, a fundamental tension arises: inference-time methods benefit from diverse…

机器学习 · 计算机科学 2026-05-12 Changhao Li , Yuchen Zhuang , Chenxiao Gao , Haotian Sun , Rushi Qiang , Chao Zhang , Bo Dai

Building general-purpose graphical user interface (GUI) agents has become increasingly promising with the progress in vision language models. However, developing effective mobile GUI agents with reinforcement learning (RL) remains…

机器学习 · 计算机科学 2025-10-27 Yifan Xu , Xiao Liu , Xinghan Liu , Jiaqi Fu , Hanchen Zhang , Bohao Jing , Shudan Zhang , Yuting Wang , Wenyi Zhao , Yuxiao Dong

Aligning large language models (LLMs) with human values and safety constraints is challenging, especially when objectives like helpfulness, truthfulness, and avoidance of harm conflict. Reinforcement Learning from Human Feedback (RLHF) has…

计算与语言 · 计算机科学 2025-03-31 Xuying Li , Zhuo Li , Yuji Kosuga , Victor Bian

The rapid advancement of vision-language models has catalyzed the emergence of GUI agents, which hold immense potential for automating complex tasks, from online shopping to flight booking, thereby alleviating the burden of repetitive…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Zhongyin Zhao , Yuan Liu , Yikun Liu , Haicheng Wang , Le Tian , Xiao Zhou , Yangxiu You , Zilin Yu , Yang Yu , Jie Zhou

Reasoning ability has become a defining capability of Large Language Models (LLMs), with Reinforcement Learning with Verifiable Rewards (RLVR) emerging as a key paradigm to enhance it. However, RLVR training often suffers from policy…

机器学习 · 计算机科学 2026-04-20 Xiaoyun Zhang , Xiaojian Yuan , Di Huang , Wang You , Chen Hu , Jingqing Ruan , Ai Jian , Kejiang Chen , Xing Hu

Reinforcement learning with verifiable rewards (RLVR) has recently enhanced the reasoning capabilities of large language models (LLMs), particularly for mathematical problem solving. However, a fundamental limitation remains: as the…

机器学习 · 计算机科学 2025-11-03 Wenhao Deng , Long Wei , Chenglei Yu , Tailin Wu