English
Related papers

Related papers: AGRO-SQL: Agentic Group-Relative Optimization with…

200 papers

Recently, empowered with the powerful capabilities of neural networks, reinforcement learning (RL) has successfully tackled numerous challenging tasks. However, while these models demonstrate enhanced decision-making abilities, they are…

Machine Learning · Computer Science 2025-10-09 Zhengpeng Xie , Yulong Zhang

This paper introduces lateral thinking to implement System-2 reasoning capabilities in AI systems, focusing on anticipatory and causal reasoning under uncertainty. We present a framework for systematic generation and modeling of lateral…

Artificial Intelligence · Computer Science 2024-12-12 Stefan Dernbach , Alejandro Michel , Khushbu Agarwal , Christopher Brissette , Geetika Gupta , Sutanay Choudhury

Automating clinical documentation with large language models requires precise alignment with priorities such as completeness and factual grounding. We present an evaluation-integrated reinforcement learning framework for long-form clinical…

Computation and Language · Computer Science 2025-10-06 Samyak Jhaveri , Praphul Singh , Jangwon Kim , Tara Taghavi , Krishnaram Kenthapadi

Synthetic data is becoming increasingly important for accelerating the development of language models, both large and small. Despite several successful use cases, researchers also raised concerns around model collapse and drawbacks of…

Deep reinforcement learning (DRL) is a booming area of artificial intelligence. Many practical applications of DRL naturally involve more than one collaborative learners, making it important to study DRL in a multi-agent context. Previous…

Machine Learning · Computer Science 2019-10-22 Gang Chen

Recent studies have demonstrated that Reinforcement Learning (RL), notably Group Relative Policy Optimization (GRPO), can intrinsically elicit and enhance the reasoning capabilities of Vision-Language Models (VLMs). However, despite the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Xinyu Tian , Shu Zou , Zhaoyuan Yang , Mengqi He , Peter Tu , Jing Zhang

Reinforcement learning (RL) has emerged as a powerful tool for fine-tuning large language models (LLMs) to improve complex reasoning abilities. However, state-of-the-art policy optimization methods often suffer from high computational…

Machine Learning · Computer Science 2025-05-28 Kianté Brantley , Mingyu Chen , Zhaolin Gao , Jason D. Lee , Wen Sun , Wenhao Zhan , Xuezhou Zhang

Schema linking is a critical step in Text-to-SQL task, aiming to accurately predict the table names and column names required for the SQL query based on the given question. However, current fine-tuning approaches for schema linking models…

Artificial Intelligence · Computer Science 2025-06-16 Wuzhenghong Wen , Su Pan , yuwei Sun

This paper investigates the model-based methods in multi-agent reinforcement learning (MARL). We specify the dynamics sample complexity and the opponent sample complexity in MARL, and conduct a theoretic analysis of return discrepancy upper…

Machine Learning · Computer Science 2022-03-18 Weinan Zhang , Xihuai Wang , Jian Shen , Ming Zhou

Large Language Model (LLM) based agents are powerful yet fundamentally static after deployment, lacking the ability to autonomously expand capabilities, generate new tools, or evolve their reasoning. This work introduces a hierarchical…

Computation and Language · Computer Science 2026-01-21 Indrajit Kar , Sammy Zonunpuia , Zonunfeli Ralte

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising paradigm for post-training reasoning models. However, group-based methods such as Group Relative Policy Optimization (GRPO) face a critical dilemma in…

Machine Learning · Computer Science 2026-04-07 Yuning Wu , Ke Wang , Devin Chen , Kai Wei

Retrieval-augmented generation (RAG) agents are increasingly deployed to answer questions over local knowledge bases that cannot be centralized due to knowledge-sovereignty constraints. This results in two recurring failures in production:…

Multiagent Systems · Computer Science 2026-04-07 Feijie Wu , Zitao Li , Fei Wei , Yaliang Li , Bolin Ding , Jing Gao

Large reasoning models (LRMs) have demonstrated strong performance on complex reasoning tasks, but often suffer from overthinking, generating redundant content regardless of task difficulty. Inspired by the dual process theory in cognitive…

Artificial Intelligence · Computer Science 2025-05-26 Xiaoxue Cheng , Junyi Li , Zhenduo Zhang , Xinyu Tang , Wayne Xin Zhao , Xinyu Kong , Zhiqiang Zhang

Retrieval-Augmented Generation (RAG) utilizes external knowledge to augment Large Language Models' (LLMs) reliability. For flexibility, agentic RAG employs autonomous, multi-round retrieval and reasoning to resolve queries. Although recent…

Information Retrieval · Computer Science 2025-11-10 Chao Zhang , Yuhao Wang , Derong Xu , Haoxin Zhang , Yuanjie Lyu , Yuhao Chen , Shuochen Liu , Tong Xu , Xiangyu Zhao , Yan Gao , Yao Hu , Enhong Chen

RL-based agentic search enables LLMs to solve complex questions via dynamic planning and external search. While this approach significantly enhances accuracy with agent policies optimized via large-scale reinforcement learning, we identify…

Artificial Intelligence · Computer Science 2026-04-22 Shiyu Liu , Yongjing Yin , Jianhao Yan , Yunbo Tang , Qinggang Zhang , Bei Li , Xin Chen , Jingang Wang , Xunliang Cai , Jinsong Su

Conducting reinforcement learning (RL) in simulated environments offers a cost-effective and highly scalable way to enhance language-based agents. However, previous work has been limited to semi-automated environment synthesis or tasks…

Computation and Language · Computer Science 2025-12-30 Shihao Cai , Runnan Fang , Jialong Wu , Baixuan Li , Xinyu Wang , Yong Jiang , Liangcai Su , Liwen Zhang , Wenbiao Yin , Zhen Zhang , Fuli Feng , Pengjun Xie , Xiaobin Wang

Agentic reinforcement learning (Agentic RL) has achieved strong progress in tasks with clear success signals. However, many real-world agent applications require user-conditioned behavior: the same query may call for different planning…

Computation and Language · Computer Science 2026-05-25 Ranxu zhang , zeyang li , Jiacheng Huang , Rui Zhang , Xiaozhou Xu , sun zhe , Yanyong Zhang , Chao Wang

Feature transformation enhances downstream task performance by generating informative features through mathematical feature crossing. Despite the advancements in deep learning, feature transformation remains essential for structured data,…

Machine Learning · Computer Science 2026-03-02 Tao Zhe , Huazhen Fang , Kunpeng Liu , Qian Lou , Tamzidul Hoque , Dongjie Wang

Finetuning Large Vision-Language Models with reinforcement learning has emerged as a promising approach to enhance their capability in object-level grounding. However, existing methods, mainly based on GRPO, assign rewards at the response…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yuyuan Liu , Yiping Ji , Anjie Le , Jiayuan Zhu , Jiazhen Pan , Can Peng , Jiajun Deng , Fengbei Liu , Junde Wu

Robust text-to-SQL over complex, real-world databases remains brittle even with modern LLMs: iterative refinement often introduces syntactic and semantic drift, corrections tend to be non-transferable across queries, and naive use of large…

Databases · Computer Science 2026-01-13 Isabelle Mohr , Joao Gandarela , John Dujany , Andre Freitas