中文
相关论文

相关论文: UI-R1: Enhancing Efficient Action Prediction of GU…

200 篇论文

Existing efforts in building Graphical User Interface (GUI) agents largely rely on the training paradigm of supervised fine-tuning on Large Vision-Language Models (LVLMs). However, this approach not only demands extensive amounts of…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Run Luo , Lu Wang , Wanwei He , Longze Chen , Jiaming Li , Xiaobo Xia

Recently DeepSeek R1 has shown that reinforcement learning (RL) can substantially improve the reasoning capabilities of Large Language Models (LLMs) through a simple yet effective design. The core of R1 lies in its rule-based reward…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Haozhan Shen , Peng Liu , Jingcheng Li , Chunxin Fang , Yibo Ma , Jiajia Liao , Qiaoli Shen , Zilun Zhang , Kangjia Zhao , Qianqian Zhang , Ruochen Xu , Tiancheng Zhao

Recent Graphical User Interface (GUI) agents replicate the R1-Zero paradigm, coupling online Reinforcement Learning (RL) with explicit chain-of-thought reasoning prior to object grounding and thereby achieving substantial performance gains.…

计算与语言 · 计算机科学 2025-05-23 Yuqi Zhou , Sunhao Dai , Shuai Wang , Kaiwen Zhou , Qinglin Jia , Jun Xu

Multimodal Large Language Models (MLLMs) have powered Graphical User Interface (GUI) Agents, showing promise in automating tasks on computing devices. Recent works have begun exploring reasoning in GUI tasks with encouraging results.…

人工智能 · 计算机科学 2025-04-22 Yuhang Liu , Pengxiang Li , Congkai Xie , Xavier Hu , Xiaotian Han , Shengyu Zhang , Hongxia Yang , Fei Wu

Tabular data serves as the backbone of modern data analysis and scientific research. While Large Language Models (LLMs) fine-tuned via Supervised Fine-Tuning (SFT) have significantly improved natural language interaction with such…

Graphical User Interface (GUI) agents, driven by Multi-modal Large Language Models (MLLMs), have emerged as a promising paradigm for enabling intelligent interaction with digital systems. This paper provides a structured survey of recent…

人工智能 · 计算机科学 2025-05-14 Jiahao Li , Kaer Huang

Graphical User Interface (GUI) agents have made substantial strides in understanding and executing user instructions across diverse platforms. Yet, grounding these instructions to precise interface elements remains challenging, especially…

人工智能 · 计算机科学 2025-05-27 Xinbin Yuan , Jian Zhang , Kaixin Li , Zhuoxuan Cai , Lujian Yao , Jie Chen , Enguang Wang , Qibin Hou , Jinwei Chen , Peng-Tao Jiang , Bo Li

Efficiently acquiring external knowledge and up-to-date information is essential for effective reasoning and text generation in large language models (LLMs). Prompting advanced LLMs with reasoning capabilities to use search engines during…

计算与语言 · 计算机科学 2025-08-07 Bowen Jin , Hansi Zeng , Zhenrui Yue , Jinsung Yoon , Sercan Arik , Dong Wang , Hamed Zamani , Jiawei Han

Deep Research agents tackle knowledge-intensive tasks through multi-round retrieval and decision-oriented generation. While reinforcement learning (RL) has been shown to improve performance in this paradigm, its contributions remain…

计算与语言 · 计算机科学 2026-02-24 Yinuo Xu , Shuo Lu , Jianjie Cheng , Meng Wang , Qianlong Xie , Xingxing Wang , Ran He , Jian Liang

Inspired by the success of DeepSeek-R1, we explore the potential of rule-based reinforcement learning (RL) in MLLM post-training for perception policy learning. While promising, our initial experiments reveal that incorporating a thinking…

计算机视觉与模式识别 · 计算机科学 2025-04-11 En Yu , Kangheng Lin , Liang Zhao , Jisheng Yin , Yana Wei , Yuang Peng , Haoran Wei , Jianjian Sun , Chunrui Han , Zheng Ge , Xiangyu Zhang , Daxin Jiang , Jingyu Wang , Wenbing Tao

Graphical User Interface (GUI) agents have demonstrated remarkable progress in automating complex user interface interactions through reinforcement learning. However, current approaches face a fundamental dilemma: offline RL enables stable…

机器学习 · 计算机科学 2025-09-25 Zhengxi Lu , Jiabo Ye , Fei Tang , Yongliang Shen , Haiyang Xu , Ziwei Zheng , Weiming Lu , Ming Yan , Fei Huang , Jun Xiao , Yueting Zhuang

Vision-language models (VLMs) have achieved impressive progress in natural image reasoning, yet their potential in medical imaging remains underexplored. Medical vision-language tasks demand precise understanding and clinically coherent…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Yuxiang Lai , Jike Zhong , Ming Li , Shitian Zhao , Yuheng Li , Konstantinos Psounis , Xiaofeng Yang

Recent advances in vision-language models (VLMs) and reinforcement learning (RL) have driven progress in GUI automation. However, most existing methods rely on static, one-shot visual inputs and passive perception, lacking the ability to…

人工智能 · 计算机科学 2026-01-16 Chen Chen , Jiawei Shao , Dakuan Lu , Haoyi Hu , Xiangcheng Liu , Hantao Yao , Wu Liu

The success of DeepSeek-R1 demonstrates the immense potential of using reinforcement learning (RL) to enhance LLMs' reasoning capabilities. This paper introduces Retrv-R1, the first R1-style MLLM specifically designed for multimodal…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Lanyun Zhu , Deyi Ji , Tianrun Chen , Haiyang Wu , Shiqi Wang

Reinforcement Learning (RL) has shown promise in improving the reasoning abilities of Large Language Models (LLMs). However, the specific challenges of adapting RL to multimodal data and formats remain relatively unexplored. In this work,…

机器学习 · 计算机科学 2025-05-20 Zirun Guo , Minjie Hong , Tao Jin

Large language models (LLMs) have notably progressed in multi-step and long-chain reasoning. However, extending their reasoning capabilities to encompass deep interactions with search remains a non-trivial challenge, as models often fail to…

计算与语言 · 计算机科学 2025-06-05 Qingfei Zhao , Ruobing Wang , Dingling Xu , Daren Zha , Limin Liu

Large Language Models (LLMs) have recently demonstrated strong potential in generating 'believable human-like' behavior in web environments. Prior work has explored augmenting training data with LLM-synthesized rationales and applying…

Reinforcement learning (RL) has demonstrated strong potential in training large language models (LLMs) capable of complex reasoning for real-world problem solving. More recently, RL has been leveraged to create sophisticated LLM-based…

计算与语言 · 计算机科学 2025-05-22 Bowen Jin , Jinsung Yoon , Priyanka Kargupta , Sercan O. Arik , Jiawei Han

Reasoning-focused large language models (LLMs) are rapidly evolving across various domains, yet their capabilities in handling complex legal problems remains underexplored. In this paper, we introduce Unilaw-R1, a large language model…

计算与语言 · 计算机科学 2025-12-09 Hua Cai , Shuang Zhao , Liang Zhang , Xuli Shen , Qing Xu , Weilin Shen , Zihao Wen , Tianke Ban

Large language models (LLMs)-empowered web agents enables automating complex, real-time web navigation tasks in enterprise environments. However, existing web agents relying on supervised fine-tuning (SFT) often struggle with generalization…

计算与语言 · 计算机科学 2025-06-10 Yuchen Zhuang , Di Jin , Jiaao Chen , Wenqi Shi , Hanrui Wang , Chao Zhang
‹ 上一页 1 2 3 10 下一页 ›