中文
相关论文

相关论文: InfiGUI-G1: Advancing GUI Grounding with Adaptive …

200 篇论文

LLM-based search agents are increasingly trained on entity-centric synthetic data to solve complex, knowledge-intensive tasks. However, prevailing training methods like Group Relative Policy Optimization (GRPO) discard this rich entity…

Large Language Models (LLMs) have demonstrated impressive capabilities in language processing, yet they often struggle with tasks requiring genuine visual spatial reasoning. In this paper, we introduce a novel two-stage training framework…

计算与语言 · 计算机科学 2025-02-26 Alan Dao , Dinh Bach Vu

The rapid proliferation of AI-Generated Images (AIGIs) has introduced severe risks of misinformation, making AIGI detection a critical yet challenging task. While traditional detection paradigms mainly rely on low-level features, recent…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Chenyang Zhu , Maorong Wang , Jun Liu , Ching-Chun Chang , Isao Echizen

Prompt injection attacks pose a significant challenge to the safe deployment of Large Language Models (LLMs) in real-world applications. While prompt-based detection offers a lightweight and interpretable defense strategy, its effectiveness…

密码学与安全 · 计算机科学 2025-10-10 Ting-Chun Liu , Ching-Yu Hsu , Kuan-Yi Lee , Chi-An Fu , Hung-yi Lee

In an era where tool-augmented AI agents are becoming increasingly vital, our findings highlight the ability of Group Relative Policy Optimization (GRPO) to empower SLMs, which are traditionally constrained in tool use. The ability to use…

计算与语言 · 计算机科学 2025-09-10 Dhruvi Paprunia , Vansh Kharidia , Pankti Doshi

Visual agent models for automating human activities on Graphical User Interfaces (GUIs) have emerged as a promising research direction, driven by advances in large Vision Language Models (VLMs). A critical challenge in GUI automation is the…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Joonhyung Park , Peng Tang , Sagnik Das , Srikar Appalaraju , Kunwar Yashraj Singh , R. Manmatha , Shabnam Ghadar

Group Relative Policy Optimization (GRPO) has recently emerged as an effective approach for improving the reasoning capabilities of large language models through online multi-objective reinforcement learning. While personalization on…

机器学习 · 计算机科学 2026-02-03 Ziyao Wang , Daeun Jung , Yexiao He , Guoheng Sun , Zheyu Shen , Myungjin Lee , Ang Li

Reinforcement learning (RL) has emerged as the predominant paradigm for training large language model (LLM)-based AI agents. However, existing backbone RL algorithms lack verified convergence guarantees in agentic scenarios, especially in…

人工智能 · 计算机科学 2026-02-09 Tianyi Hu , Qingxu Fu , Yanxi Chen , Zhaoyang Liu , Bolin Ding

Reinforcement learning (RL) has been successfully applied to solve the problem of finding obstacle-free paths for autonomous agents operating in stochastic and uncertain environments. However, when the underlying stochastic dynamics of the…

机器学习 · 计算机科学 2024-10-29 Sheryl Paul , Jyotirmoy V. Deshmukh

Recent advancements in Multi-modal Large Language Models (MLLMs) have led to significant progress in developing GUI agents for general tasks such as web browsing and mobile phone use. However, their application in professional domains…

计算机视觉与模式识别 · 计算机科学 2025-04-14 Kaixin Li , Ziyang Meng , Hongzhan Lin , Ziyang Luo , Yuchen Tian , Jing Ma , Zhiyong Huang , Tat-Seng Chua

Instruction-fine-tuned large language models (LLMs) under 14B parameters continue to underperform on natural language understanding (NLU) tasks, often trailing smaller models like BERT-base on benchmarks such as GLUE and SuperGLUE.…

计算与语言 · 计算机科学 2025-09-29 Bokai Hu , Sai Ashish Somayajula , Xin Pan , Pengtao Xie

Large Language Model (LLM)-guided evolutionary search is increasingly used for automated algorithm discovery, yet most current methods track search progress primarily through executable programs and scalar fitness. Even when…

计算与语言 · 计算机科学 2026-05-11 Sichun Luo , Yi Huang , Haochen Luo , Fengyuan Liu , Guanzhi Deng , Lei Li , Qinghua Yao , Zefa Hu , Junlan Feng , Qi Liu

Multimodal large language models (MLLMs) have demonstrated impressive reasoning and instruction-following capabilities, yet their expanded modality space introduces new compositional safety risks that emerge from complex text-image…

密码学与安全 · 计算机科学 2025-11-18 Xuankun Rong , Wenke Huang , Tingfeng Wang , Daiguo Zhou , Bo Du , Mang Ye

Reinforcement Learning from Verifiable Rewards (RLVR) has substantially enhanced the reasoning capabilities of large language models in abstract reasoning tasks. However, its application to Large Vision-Language Models (LVLMs) remains…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Yuhang Han , Yuyang Wu , Zhengbo Jiao , Yiyu Wang , Xuyang Liu , Shaobo Wang , Hanlin Xu , Xuming Hu , Linfeng Zhang

Real-world sequential decision making is characterized by sparse rewards and large decision spaces, posing significant difficulty for experiential learning systems like $\textit{tabula rasa}$ reinforcement learning (RL) agents. Large…

计算与语言 · 计算机科学 2024-03-06 Hitesh Golchha , Sahil Yerawar , Dhruvesh Patel , Soham Dan , Keerthiram Murugesan

Recently, reinforcement learning~(RL) has become an important approach for improving the capabilities of large language models~(LLMs). In particular, reinforcement learning from verifiable rewards~(RLVR) has emerged as a promising paradigm…

机器学习 · 计算机科学 2026-03-26 Fei Bai , Zhipeng Chen , Chuan Hao , Ming Yang , Ran Tao , Bryan Dai , Wayne Xin Zhao , Jian Yang , Hongteng Xu

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

机器学习 · 计算机科学 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

Evaluating the alignment between textual prompts and generated images is critical for ensuring the reliability and usability of text-to-image (T2I) models. However, most existing evaluation methods rely on coarse-grained metrics or static…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Fulin Shi , Wenyi Xiao , Bin Chen , Liang Din , Leilei Gan

Large language models~(LLMs) are trained on heterogeneous multilingual corpora, yet existing policy optimization methods often implicitly restrict each training question to a single response language or rely on a fixed dominant language for…

计算与语言 · 计算机科学 2026-05-26 Geyang Guo , Hiromi Wakaki , Yuki Mitsufuji , Alan Ritter , Wei Xu

GUI grounding aims to align natural language instructions with precise regions in complex user interfaces. Advanced multimodal large language models show strong ability in visual GUI grounding but still struggle with small or visually…

人工智能 · 计算机科学 2025-12-02 Aiden Yiliu Li , Bizhi Yu , Daoan Lei , Tianhe Ren , Shilong Liu