English
Related papers

Related papers: Reward-Balancing for Statistical Spoken Dialogue S…

200 papers

While Reinforcement Learning (RL) shows promise in training tool-use Large Language Models (LLMs) using verifiable outcome rewards, existing methods largely overlook the potential of reasoning rewards based on chain-of-thought quality for…

Computation and Language · Computer Science 2026-01-16 Zihan Lin , Xiaohan Wang , Hexiong Yang , Jiajun Chai , Jie Cao , Guojun Yin , Wei Lin , Ran He

To perform robot manipulation tasks, a low-dimensional state of the environment typically needs to be estimated. However, designing a state estimator can sometimes be difficult, especially in environments with deformable objects. An…

Robotics · Computer Science 2019-07-16 Xingyu Lin , Harjatin Singh Baweja , David Held

Recent advancements in large language models have heavily relied on the large reward model from reinforcement learning from human feedback for fine-tuning. However, the use of a single reward model across various domains may not always be…

Machine Learning · Computer Science 2024-07-26 Hyuk Namgoong , Jeesu Jung , Sangkeun Jung , Yoonhyung Roh

Misalignment between model predictions and intended usage can be detrimental for the deployment of computer vision models. The issue is exacerbated when the task involves complex structured outputs, as it becomes harder to design procedures…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 André Susano Pinto , Alexander Kolesnikov , Yuge Shi , Lucas Beyer , Xiaohua Zhai

Reward functions are central in reinforcement learning (RL), guiding agents towards optimal decision-making. The complexity of RL tasks requires meticulously designed reward functions that effectively drive learning while avoiding…

Machine Learning · Computer Science 2025-03-31 Rati Devidze

Large language models can predict real-valued quantities from heterogeneous inputs such as text, code, and molecular strings, but most training objectives score each decoded floating-point number independently, improving point estimates…

Machine Learning · Computer Science 2026-05-21 Jungsoo Park , Hyungjoo Chae , Ethan Mendes , Jay DeYoung , Varsha Kishore , Wei Xu , Alan Ritter

We consider the problem of reinforcement learning when provided with (1) a baseline control policy and (2) a set of constraints that the learner must satisfy. The baseline policy can arise from demonstration data or a teacher agent and may…

Machine Learning · Computer Science 2021-07-13 Tsung-Yen Yang , Justinian Rosca , Karthik Narasimhan , Peter J. Ramadge

With the continuous growth in communication network complexity and traffic volume, communication load balancing solutions are receiving increasing attention. Specifically, reinforcement learning (RL)-based methods have shown impressive…

Networking and Internet Architecture · Computer Science 2023-03-30 Yi Tian Xu , Jimmy Li , Di Wu , Michael Jenkin , Seowoo Jang , Xue Liu , Gregory Dudek

This paper addresses key challenges in task scheduling for multi-tenant distributed systems, including dynamic resource variation, heterogeneous tenant demands, and fairness assurance. An adaptive scheduling method based on reinforcement…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-13 Xiaopei Zhang , Xingang Wang , Xin Wang

In recent years, the generation of conversation content based on deep neural networks has attracted many researchers. However, traditional neural language models tend to generate general replies, lacking logical and emotional factors. This…

Computation and Language · Computer Science 2019-04-18 Jia Li , Xiao Sun , Xing Wei , Changliang Li , Jianhua Tao

Many sequential decision-making tasks involve optimizing multiple conflicting objectives, requiring policies that adapt to different user preferences. In multi-objective reinforcement learning (MORL), one widely studied approach} addresses…

Machine Learning · Computer Science 2026-04-28 Ying-Tu Chen , Wei Hung , Bing-Shu Wu , Zhang-Wei Hong , Ping-Chun Hsieh

Reinforcement learning (RL), particularly in sparse reward settings, often requires prohibitively large numbers of interactions with the environment, thereby limiting its applicability to complex problems. To address this, several prior…

Machine Learning · Computer Science 2020-11-20 Prasoon Goyal , Scott Niekum , Raymond J. Mooney

In the last years decision-focused learning framework, also known as predict-and-optimize, have received increasing attention. In this setting, the predictions of a machine learning model are used as estimated cost coefficients in the…

Machine Learning · Computer Science 2022-06-20 Jayanta Mandi , Víctor Bucarey , Maxime Mulamba , Tias Guns

In most machine learning training paradigms a fixed, often handcrafted, loss function is assumed to be a good proxy for an underlying evaluation metric. In this work we assess this assumption by meta-learning an adaptive loss function to…

Machine Learning · Computer Science 2019-05-16 Chen Huang , Shuangfei Zhai , Walter Talbott , Miguel Angel Bautista , Shih-Yu Sun , Carlos Guestrin , Josh Susskind

Reinforcement learning based dialogue policies are typically trained in interaction with a user simulator. To obtain an effective and robust policy, this simulator should generate user behaviour that is both realistic and varied. Current…

Computation and Language · Computer Science 2023-06-02 Simon Keizer , Caroline Dockes , Norbert Braunschweiler , Svetlana Stoyanchev , Rama Doddipatla

We investigate the task of learning to follow natural language instructions by jointly reasoning with visual observations and language inputs. In contrast to existing methods which start with learning from demonstrations (LfD) and then use…

Computation and Language · Computer Science 2018-07-10 Wenhan Xiong , Xiaoxiao Guo , Mo Yu , Shiyu Chang , Bowen Zhou , William Yang Wang

Improving sample efficiency is central to Reinforcement Learning (RL), especially in environments where the rewards are sparse. Some recent approaches have proposed to specify reward functions as manually designed or learned reward…

Machine Learning · Computer Science 2024-01-26 Shuai Han , Mehdi Dastani , Shihan Wang

This paper introduces two learning schemes for distributed agents in Reinforcement Learning (RL) environments, namely Reward-Weighted (R-Weighted) and Loss-Weighted (L-Weighted) gradient merger. The R/L weighted methods replace standard…

Machine Learning · Computer Science 2024-08-20 Martin Holen , Per-Arne Andersen , Kristian Muri Knausgård , Morten Goodwin

Recently, there are many trials to apply reinforcement learning in asset allocation for earning more stable profits. In this paper, we compare performance between several reinforcement learning algorithms - actor-only, actor-critic and PPO…

Computational Finance · Quantitative Finance 2023-01-16 Jiwon Kim , Moon-Ju Kang , KangHun Lee , HyungJun Moon , Bo-Kwan Jeon

Reinforcement learning usually uses the feedback rewards of environmental to train agents. But the rewards in the actual environment are sparse, and even some environments will not rewards. Most of the current methods are difficult to get…

Machine Learning · Computer Science 2020-01-13 Kai Jiang , XiaoLong Qin