中文
相关论文

相关论文: LiteGUI: Distilling Compact GUI Agents with Reinfo…

200 篇论文

Knowledge distillation involves transferring the predictive capabilities of large, high-performing AI models (teachers) to smaller models (students) that can operate in environments with limited computing power. In this paper, we address…

机器学习 · 计算机科学 2026-01-12 Pattarawat Chormai , Ali Hashemi , Klaus-Robert Müller , Grégoire Montavon

Large language models (LLMs) have recently demonstrated strong potential for autonomous vehicle motion planning by reformulating trajectory prediction as a language generation problem. However, deploying capable LLMs in resource-constrained…

机器人学 · 计算机科学 2026-04-10 Amirhossein Afsharrad , Amirhesam Abedsoltan , Ahmadreza Moradipari , Sanjay Lall

Large language models (LLMs) excel at complex reasoning tasks but remain computationally expensive, limiting their practical deployment. To address this, recent works have focused on distilling reasoning capabilities into smaller language…

计算与语言 · 计算机科学 2025-11-06 Minki Kang , Jongwon Jeong , Seanie Lee , Jaewoong Cho , Sung Ju Hwang

While large language model (LLM) multi-agent systems achieve superior reasoning performance through iterative debate, practical deployment is limited by their high computational cost and error propagation. This paper proposes AgentArk, a…

人工智能 · 计算机科学 2026-05-26 Yinyi Luo , Yiqiao Jin , Weichen Yu , Mengqi Zhang , Srijan Kumar , Xiaoxiao Li , Weijie Xu , Xin Chen , Jindong Wang

Recent advances in Large Language Model (LLM) agents have demonstrated their promising general capabilities. However, their performance in specialized real-world domains often degrades due to challenges in effectively integrating external…

计算与语言 · 计算机科学 2025-10-10 Yuzheng Cai , Siqi Cai , Yuchen Shi , Zihan Xu , Lichao Chen , Yulei Qin , Xiaoyu Tan , Gang Li , Zongyi Li , Haojia Lin , Yong Mao , Ke Li , Xing Sun

Graphical User Interface (GUI) Agents, powered by multimodal large language models (MLLMs), have shown great potential for task automation on computing devices such as computers and mobile phones. However, existing agents face challenges in…

人工智能 · 计算机科学 2025-01-09 Yuhang Liu , Pengxiang Li , Zishu Wei , Congkai Xie , Xueyu Hu , Xinchen Xu , Shengyu Zhang , Xiaotian Han , Hongxia Yang , Fei Wu

Large reasoning models such as DeepSeek-R1 and their distilled variants achieve strong performance on complex reasoning tasks. Yet, distilling these models often demands large-scale data for supervised fine-tuning (SFT), motivating the…

计算与语言 · 计算机科学 2026-01-16 Lechen Zhang , Yunxiang Zhang , Wei Hu , Lu Wang

Recent advancements in Graphical User Interface (GUI) agents have predominantly focused on training paradigms like supervised fine-tuning (SFT) and reinforcement learning (RL). However, the challenge of high-dynamic GUI environments remains…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Enqi Liu , Liyuan Pan , Zhi Gao , Yan Yang , Chenrui Shi , Yang Liu , Jingrong Wu , Qing Li

The research focus of GUI agents is shifting from text-dependent to pure-vision-based approaches, which, though promising, prioritize comprehensive pre-training data collection while neglecting contextual modeling challenges. We probe the…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Gongwei Chen , Xurui Zhou , Rui Shao , Yibo Lyu , Kaiwen Zhou , Shuai Wang , Wentao Li , Yinchuan Li , Zhongang Qi , Liqiang Nie

This paper presents MagicGUI, a foundational mobile GUI agent designed to address critical challenges in perception, grounding, and reasoning within real-world mobile GUI environments. The framework is underpinned by following six key…

Developing robotic agents that can perform well in diverse environments while showing a variety of behaviors is a key challenge in AI and robotics. Traditional reinforcement learning (RL) methods often create agents that specialize in…

机器人学 · 计算机科学 2025-03-25 Octi Zhang , Quanquan Peng , Rosario Scalise , Bryon Boots

Current long chain-of-thought (long-CoT) models excel at mathematical reasoning but rely on slow and error-prone natural language traces. Tool-augmented agents address arithmetic via code execution, but often falter on complex logical…

计算与语言 · 计算机科学 2025-09-03 Weihua Du , Pranjal Aggarwal , Sean Welleck , Yiming Yang

This paper studies the problem of pre-training for small models, which is essential for many mobile devices. Current state-of-the-art methods on this problem transfer the representational knowledge of a large network (as a Teacher) into a…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Mingsheng Li , Lin Zhang , Mingzhen Zhu , Zilong Huang , Gang Yu , Jiayuan Fan , Tao Chen

Recent advances in vision-language models (VLMs) and reinforcement learning (RL) have driven progress in GUI automation. However, most existing methods rely on static, one-shot visual inputs and passive perception, lacking the ability to…

人工智能 · 计算机科学 2026-01-16 Chen Chen , Jiawei Shao , Dakuan Lu , Haoyi Hu , Xiangcheng Liu , Hantao Yao , Wu Liu

Graphical User Interface (GUI) agents show amazing abilities in assisting human-computer interaction, automating human user's navigation on digital devices. An ideal GUI agent is expected to achieve high accuracy, low latency, and…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Zhiyuan Huang , Ziming Cheng , Junting Pan , Zhaohui Hou , Mingjie Zhan

Autonomous mobile GUI agents have attracted increasing attention along with the advancement of Multimodal Large Language Models (MLLMs). However, existing methods still suffer from inefficient learning from failed trajectories and ambiguous…

Reinforcement learning (RL) is a powerful tool for finding optimal policies in sequential decision processes. However, deep RL methods have two weaknesses: collecting the amount of agent experience required for practical RL problems is…

Multimodal Large Language Models (MLLMs) have powered Graphical User Interface (GUI) Agents, showing promise in automating tasks on computing devices. Recent works have begun exploring reasoning in GUI tasks with encouraging results.…

人工智能 · 计算机科学 2025-04-22 Yuhang Liu , Pengxiang Li , Congkai Xie , Xavier Hu , Xiaotian Han , Shengyu Zhang , Hongxia Yang , Fei Wu

Few-step diffusion or flow-based generative models typically distill a velocity-predicting teacher into a student that predicts a shortcut towards denoised data. This format mismatch has led to complex distillation procedures that often…

机器学习 · 计算机科学 2026-02-20 Hansheng Chen , Kai Zhang , Hao Tan , Leonidas Guibas , Gordon Wetzstein , Sai Bi

Reinforcement learning (RL) has been widely used to train LLM agents for multi-turn interactive tasks, but its sample efficiency is severely limited by sparse rewards and long horizons. On-policy self-distillation (OPSD) alleviates this by…

机器学习 · 计算机科学 2026-04-14 Hao Wang , Guozhi Wang , Han Xiao , Yufeng Zhou , Yue Pan , Jichao Wang , Ke Xu , Yafei Wen , Xiaohu Ruan , Xiaoxin Chen , Honggang Qi