English
Related papers

Related papers: Beyond Uniform Credit: Causal Credit Assignment fo…

200 papers

Reinforcement learning improves LLM reasoning, but PPO/GRPO typically use fixed clipping and decoding temperature, which makes training brittle and tuning-heavy. We propose Adaptive Group Policy Optimization (AGPO), a critic-free refinement…

Machine Learning · Computer Science 2026-05-21 Miaobo Hu , Shuhao Hu , Bokun Wang , Ruohan Wang , Xin Wang , Xiaobo Guo , Daren Zha , Jun Xiao

Standard policy gradients weight each sampled action by advantage alone, regardless of how likely that action was under the current policy. This creates two pathologies: within a single decision context (e.g. one image or prompt), a rare…

Machine Learning · Computer Science 2026-03-17 Ian Osband

We study the problem of offline policy optimization in stochastic contextual bandit problems, where the goal is to learn a near-optimal policy based on a dataset of decision data collected by a suboptimal behavior policy. Rather than making…

Machine Learning · Computer Science 2023-09-28 Germano Gabbianelli , Gergely Neu , Matteo Papini

Molecular property prediction is a crucial task that guides the design of new compounds, including drugs and materials. While explainable artificial intelligence methods aim to scrutinize model predictions by identifying influential…

Machine Learning · Computer Science 2025-08-27 Łukasz Janisiów , Marek Kochańczyk , Bartosz Zieliński , Tomasz Danel

We propose answer-set programs that specify and compute counterfactual interventions as a basis for causality-based explanations to decisions produced by classification models. They can be applied with black-box models and models that can…

Machine Learning · Computer Science 2020-06-17 Leopoldo Bertossi

In reasoning tasks, even a minor error can cascade into inaccurate results, leading to suboptimal performance of large language models in such domains. Earlier fine-tuning approaches sought to mitigate this by leveraging more precise…

Computation and Language · Computer Science 2024-07-12 Changyu Chen , Xiting Wang , Ting-En Lin , Ang Lv , Yuchuan Wu , Xin Gao , Ji-Rong Wen , Rui Yan , Yongbin Li

We predict credit applications with off-the-shelf, interchangeable black-box classifiers and we explain single predictions with counterfactual explanations. Counterfactual explanations expose the minimal changes required on the input data…

Artificial Intelligence · Computer Science 2018-11-19 Rory Mc Grath , Luca Costabello , Chan Le Van , Paul Sweeney , Farbod Kamiab , Zhao Shen , Freddy Lecue

Reinforcement Learning with Verifiable Rewards (RLVR) is an essential paradigm that enhances the reasoning capabilities of Large Language Models (LLMs). However, existing methods typically rely on static policy optimization schemes that…

Computation and Language · Computer Science 2026-05-08 Yiming Huang , Zhenbo Shi , Shuzheng Gao , Cuiyun Gao , Peiyi Han , Chuanyi Liu

Large language models pick up social biases from the data they are trained on and carry those biases into downstream applications, often reinforcing stereotypes around gender, race, religion, disability, age, and socioeconomic status. The…

Computation and Language · Computer Science 2026-05-05 Muneeb Ur Raheem Khan

Test-time compute scaling allocates inference computation uniformly, uses fixed sampling strategies, and applies verification only for reranking. In contrast, we propose a verifier-guided adaptive framework treating reasoning as iterative…

Computation and Language · Computer Science 2026-04-08 Ahsan Bilal , Ahmed Mohsin , Muhammad Umer , Ali Subhan , Hassan Rizwan , Ayesha Mohsin , Dean Hougen

Reinforcement learning with verifiable rewards (RLVR) has become an effective paradigm for improving reasoning language models on tasks such as mathematics, coding, and scientific question answering. However, widely used group-relative…

Computation and Language · Computer Science 2026-05-29 Redacted by arXiv

The enhancement of reasoning capabilities in large language models (LLMs) has garnered significant attention, with supervised fine-tuning (SFT) and reinforcement learning emerging as dominant paradigms. While recent studies recognize the…

Artificial Intelligence · Computer Science 2026-03-17 Zhijie Wang

Counterfactual reasoning -- the practice of asking ``what if'' by varying inputs and observing changes in model behavior -- has become central to interpretable and fair AI. This thesis develops frameworks that use counterfactuals to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Pushkar Shukla

Recent work on enhancing the reasoning abilities of large language models (LLMs) has introduced explicit length control as a means of constraining computational cost while preserving accuracy. However, existing approaches rely on…

Computation and Language · Computer Science 2025-08-13 Hasan Abed Al Kader Hammoud , Kumail Alhamoud , Abed Hammoud , Elie Bou-Zeid , Marzyeh Ghassemi , Bernard Ghanem

We present Future-KL Influenced Policy Optimization (FIPO), a reinforcement learning algorithm designed to overcome reasoning bottlenecks in large language models. While GRPO style training scales effectively, it typically relies on…

Machine Learning · Computer Science 2026-04-01 Chiyu Ma , Shuo Yang , Kexin Huang , Jinda Lu , Haoming Meng , Shangshang Wang , Bolin Ding , Soroush Vosoughi , Guoyin Wang , Jingren Zhou

Evaluation of counterfactual queries (e.g., "If A were true, would C have been true?") is important to fault diagnosis, planning, determination of liability, and policy analysis. We present a method of revaluating counterfactuals when the…

Artificial Intelligence · Computer Science 2013-02-21 Alexander Balke , Judea Pearl

Social networks are frequently polluted by rumors, which can be detected by advanced models such as graph neural networks. However, the models are vulnerable to attacks and understanding the vulnerabilities is critical to rumor detection in…

Machine Learning · Computer Science 2022-10-17 Yuefei Lyu , Xiaoyu Yang , Jiaxin Liu , Philip S. Yu , Sihong Xie , Xi Zhang

In Reinforcement Learning, the optimal action at a given state is dependent on policy decisions at subsequent states. As a consequence, the learning targets evolve with time and the policy optimization process must be efficient at…

Machine Learning · Computer Science 2022-02-16 Romain Laroche , Remi Tachet

The emergence of large language models (LLMs) has revolutionized numerous applications across industries. However, their "black box" nature often hinders the understanding of how they make specific decisions, raising concerns about their…

Artificial Intelligence · Computer Science 2024-03-06 Stefan Hackmann , Haniyeh Mahmoudian , Mark Steadman , Michael Schmidt

Self-generated counterfactual explanations (SCEs) are minimally modified inputs (minimality) generated by large language models (LLMs) that flip their own predictions (validity), offering a causally grounded approach to unraveling black-box…

Computation and Language · Computer Science 2026-05-13 Yilong Wang , Qianli Wang , Bohao Chu , Yihong Liu , Jing Yang , Simon Ostermann