English
Related papers

Related papers: What Makes a Model Breathe? Understanding Reinforc…

200 papers

Model-based reinforcement learning (MBRL) holds the promise of sample-efficient learning by utilizing a world model, which models how the environment works and typically encompasses components for two tasks: observation modeling and reward…

Machine Learning · Computer Science 2024-06-06 Haoyu Ma , Jialong Wu , Ningya Feng , Chenjun Xiao , Dong Li , Jianye Hao , Jianmin Wang , Mingsheng Long

Reward functions are central in specifying the task we want a reinforcement learning agent to perform. Given a task and desired optimal behavior, we study the problem of designing informative reward functions so that the designed rewards…

Machine Learning · Computer Science 2024-02-13 Rati Devidze , Parameswaran Kamalaruban , Adish Singla

Mechanism design is a well-established game-theoretic paradigm for designing games to achieve desired outcomes. This paper addresses a closely related but distinct concept, equilibrium design. Unlike mechanism design, the designer's…

Computer Science and Game Theory · Computer Science 2024-08-20 Muhammad Najib , Giuseppe Perelli

This article surveys reinforcement learning approaches in social robotics. Reinforcement learning is a framework for decision-making problems in which an agent interacts through trial-and-error with its environment to discover an optimal…

Robotics · Computer Science 2021-02-12 Neziha Akalin , Amy Loutfi

We study the problem of cross-embodiment inverse reinforcement learning, where we wish to learn a reward function from video demonstrations in one or more embodiments and then transfer the learned reward to a different embodiment (e.g.,…

Robotics · Computer Science 2024-08-13 Connor Mattson , Anurag Aribandi , Daniel S. Brown

Learned dynamics models combined with both planning and policy learning algorithms have shown promise in enabling artificial agents to learn to perform many diverse tasks with limited supervision. However, one of the fundamental challenges…

Machine Learning · Computer Science 2020-08-12 Suraj Nair , Silvio Savarese , Chelsea Finn

Although reinforcement learning has seen tremendous success recently, this kind of trial-and-error learning can be impractical or inefficient in complex environments. The use of demonstrations, on the other hand, enables agents to benefit…

Machine Learning · Computer Science 2023-03-29 Tongzhou Mu , Hao Su

Reward modeling is essential for aligning large language models with human preferences through reinforcement learning. To provide accurate reward signals, a reward model (RM) should stimulate deep thinking and conduct interpretable…

Computation and Language · Computer Science 2026-03-09 Xiusi Chen , Gaotang Li , Ziqi Wang , Bowen Jin , Cheng Qian , Yu Wang , Hongru Wang , Yu Zhang , Denghui Zhang , Tong Zhang , Hanghang Tong , Heng Ji

We propose a method for training language models in an interactive setting inspired by child language acquisition. In our setting, a speaker attempts to communicate some information to a listener in a single-turn dialogue and receives a…

Computation and Language · Computer Science 2025-05-12 Lennart Stöpler , Rufat Asadli , Mitja Nikolaus , Ryan Cotterell , Alex Warstadt

Recent work has shown that deep reinforcement-learning agents can learn to follow language-like instructions from infrequent environment rewards. However, this places on environment designers the onus of designing language-conditional…

Artificial Intelligence · Computer Science 2019-12-24 Dzmitry Bahdanau , Felix Hill , Jan Leike , Edward Hughes , Arian Hosseini , Pushmeet Kohli , Edward Grefenstette

Imitation is a key component of human social behavior, and is widely used by both children and adults as a way to navigate uncertain or unfamiliar situations. But in an environment populated by multiple heterogeneous agents pursuing…

Neurons and Cognition · Quantitative Biology 2023-05-15 Max Taylor-Davies , Stephanie Droop , Christopher G. Lucas

Combining interconnected wearables provides fascinating opportunities like augmenting exergaming with virtual coaches, feedback on the execution of sports activities, or how to improve on them. Breathing rhythm is a particularly interesting…

We consider active learning under incentive compatibility constraints. The main application of our results is to economic experiments, in which a learner seeks to infer the parameters of a subject's preferences: for example their attitudes…

Computer Science and Game Theory · Computer Science 2019-11-15 Federico Echenique , Siddharth Prasad

Reward Models (RMs) are crucial for online alignment of language models (LMs) with human preferences. However, RM-based preference-tuning is vulnerable to reward hacking, whereby LM policies learn undesirable behaviors from flawed RMs. By…

Computation and Language · Computer Science 2026-03-05 Daniel Fein , Max Lamparth , Violet Xiang , Mykel J. Kochenderfer , Nick Haber

Reward models play a key role in aligning language model applications towards human preferences. However, this setup creates an incentive for the language model to exploit errors in the reward model to achieve high estimated reward, a…

Dormancy is an essential strategy for microorganisms to cope with environmental stress. However, global ecosystem models typically ignore microbial dormancy, resulting in major model uncertainties. To facilitate the consideration of…

Quantitative Methods · Quantitative Biology 2014-02-20 Gangsheng Wang , Melanie A. Mayes , Lianhong Gu , Christopher W. Schadt

A breathing mode in a Hamiltonian system is a function on the phase space whose evolution is exactly periodic for all solutions of the equations of motion. Such breathing modes are familiar from nonlinear dynamics in harmonic traps or…

Mathematical Physics · Physics 2020-04-24 Oleg Evnin

We introduce a class of learning problems where the agent is presented with a series of tasks. Intuitively, if there is relation among those tasks, then the information gained during execution of one task has value for the execution of…

Machine Learning · Computer Science 2012-09-06 Christos Dimitrakakis

Learning suitable and well-performing dialogue behaviour in statistical spoken dialogue systems has been in the focus of research for many years. While most work which is based on reinforcement learning employs an objective measure like…

Computation and Language · Computer Science 2020-01-22 Stefan Ultes

In model-based reinforcement learning it is typical to decouple the problems of learning the dynamics model and learning the reward function. However, when the dynamics model is flawed, it may generate erroneous states that would never…

Machine Learning · Computer Science 2018-06-12 Erik Talvitie