English
Related papers

Related papers: InfiGUI-G1: Advancing GUI Grounding with Adaptive …

200 papers

Rapid urbanization intensifies the demand for Urban General Intelligence (UGI), referring to AI systems that can understand and reason about complex urban environments. Recent studies have built urban foundation models using supervised…

Artificial Intelligence · Computer Science 2025-10-21 Qiongyan Wang , Xingchen Zou , Yutian Jiang , Haomin Wen , Jiaheng Wei , Qingsong Wen , Yuxuan Liang

Large Language Models (LLMs) have demonstrated remarkable proficiency in English mathematical reasoning, yet a significant performance disparity persists in multilingual contexts, largely attributed to deficiencies in language…

Computation and Language · Computer Science 2026-03-27 Xu Huang , Zhejian Lai , Zixian Huang , Jiajun Chen , Shujian Huang

Medical Image Grounding (MIG), which involves localizing specific regions in medical images based on textual descriptions, requires models to not only perceive regions but also deduce spatial relationships of these regions. Existing…

Machine Learning · Computer Science 2025-07-08 Huihui Xu , Yuanpeng Nie , Hualiang Wang , Ying Chen , Wei Li , Junzhi Ning , Lihao Liu , Hongqiu Wang , Lei Zhu , Jiyao Liu , Xiaomeng Li , Junjun He

Enabling agentic AI systems to adapt their problem-solving approaches based on post-training interactions remains a fundamental challenge. While systems that update and maintain a memory at inference time have been proposed, existing…

Artificial Intelligence · Computer Science 2025-11-17 Adam Stein , Matthew Trager , Benjamin Bowman , Michael Kleinman , Aditya Chattopadhyay , Wei Xia , Stefano Soatto

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach for improving the reasoning abilities of large language models (LLMs). The Group Relative Policy Optimization (GRPO) family has demonstrated strong…

Computation and Language · Computer Science 2025-11-10 Chenxi Liu , Junjie Liang , Yuqi Jia , Bochuan Cao , Yang Bai , Heng Huang , Xun Chen

Recent advances in large language models (LLMs) have popularized test-time scaling, where models generate additional reasoning tokens before producing final answers. These approaches have demonstrated significant performance improvements on…

Artificial Intelligence · Computer Science 2026-01-13 Wenxun Wu , Yuanyang Li , Guhan Chen , Linyue Wang , Hongyang Chen

Large Language Models (LLMs) have made remarkable breakthroughs in reasoning, yet continue to struggle with hallucinations, logical errors, and inability to self-correct during complex multi-step tasks. Current approaches like…

Computation and Language · Computer Science 2025-04-22 Lingrui Mei , Shenghua Liu , Yiwei Wang , Baolong Bi , Yuyao Ge , Jun Wan , Yurong Wu , Xueqi Cheng

A key challenge in reinforcement learning (RL) is managing the exploration-exploitation trade-off without sacrificing sample efficiency. Policy gradient (PG) methods excel in exploitation through fine-grained, gradient-based optimization…

Machine Learning · Computer Science 2025-04-18 Zelal Su "Lain" Mustafaoglu , Keshav Pingali , Risto Miikkulainen

Large language models frequently exhibit suboptimal performance on low resource languages, primarily due to inefficient subword segmentation and systemic training data imbalances. In this paper, we propose Variable Entropy Policy…

Computation and Language · Computer Science 2026-03-20 Chonghan Liu , Yimin Du , Qi An , Xin He , Cunqi Zhai , Fei Tan , Weijia Lin , Xiaochun Gong , Yongchao Deng , Shousheng Jia , Xiangzheng Zhang

Group-Relative Policy Optimization (GRPO) has emerged as an efficient paradigm for aligning Large Language Models (LLMs), yet its efficacy is primarily confined to domains with verifiable ground truths. Extending GRPO to open-domain…

Machine Learning · Computer Science 2026-04-14 Yang Zhao , Hepeng Wang , Xiao Ding , Yangou Ouyang , Bibo Cai , Kai Xiong , Jinglong Gao , Zhouhao Sun , Li Du , Bing Qin , Ting Liu

Reinforcement Learning with Verifiable Rewards (RLVR) has proven to be a highly effective strategy for endowing Large Language Models (LLMs) with robust multi-step reasoning abilities. However, its design and optimizations remain tailored…

Computation and Language · Computer Science 2026-04-15 Zhenhailong Wang , Xuehang Guo , Sofia Stoica , Haiyang Xu , Hongru Wang , Hyeonjeong Ha , Xiusi Chen , Yangyi Chen , Ming Yan , Fei Huang , Heng Ji

State-of-the-art large multi-modal models (LMMs) face challenges when processing high-resolution images, as these inputs are converted into enormous visual tokens, many of which are irrelevant to the downstream task. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Xinyu Huang , Yuhao Dong , Weiwei Tian , Bo Li , Rui Feng , Ziwei Liu

Large Language Models (LLMs) have demonstrated remarkable performance across a wide range of reasoning tasks. Recent methods have further improved LLM performance in complex mathematical reasoning. However, when extending these methods…

Artificial Intelligence · Computer Science 2025-11-11 Chen He , Xun Jiang , Lei Wang , Hao Yang , Chong Peng , Peng Yan , Fumin Shen , Xing Xu

Improving and understanding the training dynamics and reasoning of Large Language Models (LLMs) has become essential for their deployment in AI-based security tools, such as software vulnerability detection. In this work, we present an…

Cryptography and Security · Computer Science 2025-07-08 Marco Simoni , Aleksandar Fontana , Giulio Rossolini , Andrea Saracino

Recently, foundation models such as OpenAI's O1 and O3, along with DeepSeek's R1, have demonstrated strong reasoning capacities and problem-solving skills acquired through large-scale reinforcement learning (RL), with wide applications in…

Machine Learning · Computer Science 2025-04-29 Tianbing Xu

Iterative refinement has been a promising paradigm to enable large language models (LLMs) to resolve difficult reasoning and problem-solving tasks. One of the key challenges, however, is how to effectively search through the enormous search…

Artificial Intelligence · Computer Science 2025-10-09 Daria Ozerova , Ekaterina Trofimova

Agentic Reinforcement Learning (Agentic RL) has shown remarkable potential in large language model-based (LLM) agents. These works can empower LLM agents to tackle complex tasks via multi-step, tool-integrated reasoning. However, an…

Artificial Intelligence · Computer Science 2026-03-04 Siwei Zhang , Yun Xiong , Xi Chen , Zi'an Jia , Renhong Huang , Jiarong Xu , Jiawei Zhang

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective paradigm for improving the reasoning capabilities of large language models. However, RLVR training is often hindered by sparse binary rewards and weak credit…

Computation and Language · Computer Science 2026-05-15 Mengjie Ren , Jie Lou , Boxi Cao , Xueru Wen , Hongyu Lin , Xianpei Han , Le Sun , Xing Yu , Yaojie Lu

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an indispensable paradigm for enhancing reasoning in Large Language Models (LLMs). However, standard policy optimization methods, such as Group Relative Policy…

Machine Learning · Computer Science 2026-02-09 Pengyi Li , Elizaveta Goncharova , Andrey Kuznetsov , Ivan Oseledets

Understanding human--environment interactions from egocentric vision is essential for assistive robotics and embodied intelligent agents, yet existing multimodal large language models (MLLMs) still struggle with accurate interaction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yuejiao Su , Xinshen Zhang , Zhen Ye , Lei Yao , Lap-Pui Chau , Yi Wang