English
Related papers

Related papers: Personalized Policy Learning through Discrete Expe…

200 papers

The performance of off-policy learning, including deep Q-learning and deep deterministic policy gradient (DDPG), critically depends on the choice of the exploration policy. Existing exploration methods are mostly based on adding noise to…

Machine Learning · Computer Science 2018-03-28 Tianbing Xu , Qiang Liu , Liang Zhao , Jian Peng

In a wide variety of applications, humans interact with a complex environment by means of asynchronous stochastic discrete events in continuous time. Can we design online interventions that will help humans achieve certain goals in such…

Machine Learning · Computer Science 2018-11-07 Utkarsh Upadhyay , Abir De , Manuel Gomez-Rodriguez

While large-scale unsupervised language models (LMs) learn broad world knowledge and some reasoning skills, achieving precise control of their behavior is difficult due to the completely unsupervised nature of their training. Existing…

Machine Learning · Computer Science 2024-07-31 Rafael Rafailov , Archit Sharma , Eric Mitchell , Stefano Ermon , Christopher D. Manning , Chelsea Finn

Recent theoretical work studies sample-efficient reinforcement learning (RL) extensively in two settings: learning interactively in the environment (online RL), or learning from an offline dataset (offline RL). However, existing algorithms…

Machine Learning · Computer Science 2022-02-14 Tengyang Xie , Nan Jiang , Huan Wang , Caiming Xiong , Yu Bai

We study the estimation of policy gradients for continuous-time systems with known dynamics. By reframing policy learning in continuous-time, we show that it is possible construct a more efficient and accurate gradient estimator. The…

Machine Learning · Computer Science 2021-06-25 Samuel Ainsworth , Kendall Lowrey , John Thickstun , Zaid Harchaoui , Siddhartha Srinivasa

Click-through rate (CTR) prediction tasks play a pivotal role in real-world applications, particularly in recommendation systems and online advertising. A significant research branch in this domain focuses on user behavior modeling. Current…

Information Retrieval · Computer Science 2024-04-18 Hengyu Zhang , Junwei Pan , Dapeng Liu , Jie Jiang , Xiu Li

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

Direct policy gradient methods for reinforcement learning are a successful approach for a variety of reasons: they are model free, they directly optimize the performance metric of interest, and they allow for richly parameterized policies.…

Machine Learning · Computer Science 2020-08-14 Alekh Agarwal , Mikael Henaff , Sham Kakade , Wen Sun

Most reinforcement learning algorithms seek a single optimal strategy that solves a given task. However, it can often be valuable to learn a diverse set of solutions, for instance, to make an agent's interaction with users more engaging, or…

Machine Learning · Computer Science 2024-01-09 Wentse Chen , Shiyu Huang , Yuan Chiang , Tim Pearce , Wei-Wei Tu , Ting Chen , Jun Zhu

With the rapid advancement of data science, charts have evolved from simple numerical presentation tools to essential instruments for insight discovery and decision-making support. However, current chart data intelligence exhibits…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jiajin Tang , Gaoyang , Wenjie Wang , Sibei Yang , Xing Chen

Firms increasingly delegate decisions to learning algorithms in platform markets. Standard algorithms perform well when platform policies are stationary, but firms often face ambiguity about whether policies are stationary or adapt…

Theoretical Economics · Economics 2026-02-11 Kyohei Okumura

Despite the significant progress of deep learning models in multitude of applications, their adaption in planning and policy related areas remains challenging due to the black-box nature of these models. In this work, we develop a set of…

Machine Learning · Computer Science 2025-09-18 Jeremy Oon , Rakhi Manohar Mepparambath , Ling Feng

Imitation learning from human demonstrations enables robots to perform complex manipulation tasks and has recently witnessed huge success. However, these techniques often struggle to adapt behavior to new preferences or changes in the…

Robotics · Computer Science 2025-01-15 Yuxin Chen , Devesh K. Jha , Masayoshi Tomizuka , Diego Romeres

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

While deep reinforcement learning has achieved promising results in challenging decision-making tasks, the main bones of its success --- deep neural networks are mostly black-boxes. A feasible way to gain insight into a black-box model is…

Machine Learning · Computer Science 2021-08-17 Zhao-Hua Li , Yang Yu , Yingfeng Chen , Ke Chen , Zhipeng Hu , Changjie Fan

The goal of unbiased learning to rank (ULTR) is to leverage implicit user feedback for optimizing learning-to-rank systems. Among existing solutions, automatic ULTR algorithms that jointly learn user bias models (i.e., propensity models)…

Information Retrieval · Computer Science 2023-07-11 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Chenliang Li , Dawei Yin , Brian D. Davison

Deep reinforcement learning (RL) algorithms can learn complex policies to optimize agent operation over time. RL algorithms have shown promising results in solving complicated problems in recent years. However, their application on…

Machine Learning · Computer Science 2021-09-29 Hamed Khorasgani , Haiyan Wang , Chetan Gupta , Susumu Serita

Reinforcement learning (RL), a common tool in decision making, learns control policies from various experiences based on the associated cumulative return/rewards without treating them differently. Humans, on the contrary, often learn to…

Machine Learning · Computer Science 2025-11-25 Mingkang Wu , Devin White , Vernon Lawhern , Nicholas R. Waytowich , Yongcan Cao

The key to personalized recommendation is to predict a personalized ranking on a catalog of items by modeling the user's preferences. There are many personalized ranking approaches for item recommendation from implicit feedback like…

Information Retrieval · Computer Science 2024-06-25 Yuli Liu , Christian Walder , Lexing Xie

Medical treatments often involve a sequence of decisions, each informed by previous outcomes. This process closely aligns with reinforcement learning (RL), a framework for optimizing sequential decisions to maximize cumulative rewards under…

Machine Learning · Computer Science 2024-10-15 Ali Shirali , Alexander Schubert , Ahmed Alaa