English
Related papers

Related papers: SQL-ASTRA: Alleviating Sparse Feedback in Agentic …

200 papers

Cooperative multi-agent reinforcement learning (MARL) aims to coordinate multiple agents to achieve a common goal. A key challenge in MARL is credit assignment, which involves assessing each agent's contribution to the shared reward. Given…

Artificial Intelligence · Computer Science 2025-08-12 Xutong Zhao , Yaqi Xie

Multi-turn tool calling is challenging for Large Language Models (LLMs) because rewards are sparse and exploration is expensive. A common recipe, SFT followed by GRPO, can stall when within-group reward variation is low (e.g., more rollouts…

Artificial Intelligence · Computer Science 2026-02-04 Haitian Zhong , Jixiu Zhai , Lei Song , Jiang Bian , Qiang Liu , Tieniu Tan

Reinforcement Learning with Verifiable Rewards (RLVR) is a promising approach for enhancing agentic deep search. However, its application is often hindered by low \textbf{Reward Density} in deep search scenarios, where agents expend…

Computation and Language · Computer Science 2025-10-31 Kun Luo , Hongjin Qian , Zheng Liu , Ziyi Xia , Shitao Xiao , Siqi Bao , Jun Zhao , Kang Liu

We present Robust Agent Compensation (RAC), a log-based recovery paradigm (providing a safety net) implemented through an architectural extension that can be applied to most Agent frameworks to support reliable executions (avoiding…

Artificial Intelligence · Computer Science 2026-05-19 Srinath Perera , Kaviru Hapuarachchi , Frank Leymann , Rania Khalaf

Text-to-SQL parsing has achieved remarkable progress under the Full Schema Assumption. However, this premise fails in real-world enterprise environments where databases contain hundreds of tables with massive noisy metadata. Rather than…

Artificial Intelligence · Computer Science 2026-03-19 Ai Jian , Xiaoyun Zhang , Wanrou Du , Jingqing Ruan , Jiangbo Pei , Weipeng Zhang , Ke Zeng , Xunliang Cai

Click-through rate (CTR) prediction is a vital task in industrial recommendation systems. Most existing methods focus on the network architecture design of the CTR model for better accuracy and suffer from the data sparsity problem.…

Information Retrieval · Computer Science 2023-12-19 Qi Liu , Xuyang Hou , Defu Lian , Zhe Wang , Haoran Jin , Jia Cheng , Jun Lei

In many real-world applications, it is hard to provide a reward signal in each step of a Reinforcement Learning (RL) process and more natural to give feedback when an episode ends. To this end, we study the recently proposed model of RL…

Machine Learning · Computer Science 2024-05-15 Asaf Cassel , Haipeng Luo , Aviv Rosenberg , Dmitry Sotnikov

Text-based games are a popular testbed for language-based reinforcement learning (RL). In previous work, deep Q-learning is commonly used as the learning agent. Q-learning algorithms are challenging to apply to complex real-world domains…

Machine Learning · Computer Science 2023-06-28 Weichen Li , Rati Devidze , Sophie Fellenz

Reinforcement learning (RL) post-training has enabled newer capabilities in models, such as agentic tool-use for search. However, these models struggle primarily due to limitations with sparse outcome-based rewards and a lack of training…

Machine Learning · Computer Science 2026-05-08 Harsh Goel , Akhil Udathu , Susmija Jabireddy , Pradnesh Kalkar , Atharva Parulekar

Large-scale Text-to-SQL benchmarks such as BIRD typically assume complete and accurate database annotations as well as readily available external knowledge, which fails to reflect common industrial settings where annotations are missing,…

Computation and Language · Computer Science 2026-01-15 Jiahui Chen , Lei Fu , Jian Cui , Yu Lei , Zhenning Dong

This paper investigates Reinforcement Learning (RL) approaches to enhance the reasoning capabilities of Large Language Model (LLM) agents in long-horizon, multi-turn scenarios. Although RL algorithms such as Group Relative Policy…

Click-through rate (CTR) prediction plays an indispensable role in online platforms. Numerous models have been proposed to capture users' shifting preferences by leveraging user behavior sequences. However, these historical sequences often…

Information Retrieval · Computer Science 2024-04-16 Junjie Huang , Guohao Cai , Jieming Zhu , Zhenhua Dong , Ruiming Tang , Weinan Zhang , Yong Yu

Recently, connectionist temporal classification (CTC)-based end-to-end (E2E) automatic speech recognition (ASR) models have achieved impressive results, especially with the development of self-supervised learning. However, E2E ASR models…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Keqi Deng , Philip C. Woodland

Long-term temporal credit assignment is an important challenge in deep reinforcement learning (RL). It refers to the ability of the agent to attribute actions to consequences that may occur after a long time interval. Existing…

Machine Learning · Computer Science 2020-10-27 Tanmay Gangwani , Yuan Zhou , Jian Peng

As comprehensive large model evaluation becomes prohibitively expensive, predicting model performance from limited observations has become essential. However, existing statistical methods struggle with pattern shifts, data sparsity, and…

Artificial Intelligence · Computer Science 2026-02-13 Xiaoxiao Wang , Chunxiao Li , Junying Wang , Yijin Guo , Zijian Chen , Chunyi Li , Xiaohong Liu , Zicheng Zhang , Guangtao Zhai

Our work involves enriching the Stack-LSTM transition-based AMR parser (Ballesteros and Al-Onaizan, 2017) by augmenting training with Policy Learning and rewarding the Smatch score of sampled graphs. In addition, we also combined several…

Computation and Language · Computer Science 2019-06-03 Tahira Naseem , Abhishek Shah , Hui Wan , Radu Florian , Salim Roukos , Miguel Ballesteros

Agentic reasoning enables large reasoning models (LRMs) to dynamically acquire external knowledge, but yet optimizing the retrieval process remains challenging due to the lack of dense, principled reward signals. In this paper, we introduce…

Artificial Intelligence · Computer Science 2026-02-10 Senkang Hu , Yong Dai , Yuzhi Zhao , Yihang Tao , Yu Guo , Zhengru Fang , Sam Tak Wu Kwong , Yuguang Fang

Tool use enables large language models to solve complex tasks through sequences of API calls, yet existing reinforcement learning approaches fail to scale to multi-step composition settings. Outcome-based rewards provide only sparse…

Machine Learning · Computer Science 2026-05-19 Anay Kulkarni , ChiaEn Lu , Dheeraj Mekala , Jayanth Srinivasa , Gaowen Liu , Jingbo Shang

Agentic systems solve complex tasks by coordinating multiple agents that iteratively reason, invoke tools, and exchange intermediate results. To improve robustness and solution quality, recent approaches deploy multiple agent teams running…

Multiagent Systems · Computer Science 2026-02-06 Joseph Fioresi , Parth Parag Kulkarni , Ashmal Vayani , Song Wang , Mubarak Shah

We study what actually works and what doesn't for training large language models as agents via multi-turn reinforcement learning. Despite rapid progress, existing frameworks and definitions are fragmented, and there is no systematic…

Machine Learning · Computer Science 2025-12-09 Ruiyi Wang , Prithviraj Ammanabrolu