中文
相关论文

相关论文: Policy Search with High-Dimensional Context Variab…

200 篇论文

Linear dimensionality reduction methods are commonly used to extract low-dimensional structure from high-dimensional data. However, popular methods disregard temporal structure, rendering them prone to extracting noise rather than…

信息论 · 计算机科学 2021-06-10 David G. Clark , Jesse A. Livezey , Kristofer E. Bouchard

Adapting an agent's behaviour to new environments has been one of the primary focus areas of physics based reinforcement learning. Although recent approaches such as universal policy networks partially address this issue by enabling the…

机器学习 · 计算机科学 2022-02-15 Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana , Svetha Venkatesh

Having a large number of covariates can have a negative impact on the quality of causal effect estimation since confounding adjustment becomes unreliable when the number of covariates is large relative to the samples available. Propensity…

统计方法学 · 统计学 2020-09-15 Debo Cheng , Jiuyong Li , Lin Liu , Jixue Liu

High-dimensional measurements are often correlated which motivates their approximation by factor models. This holds also true when features are engineered via low-dimensional interactions or kernel tricks. This often results in over…

应用统计 · 统计学 2025-09-03 Xiaonan Zhu , Bingyan Wang , Jianqing Fan

We introduce the problem of model selection for contextual bandits, where a learner must adapt to the complexity of the optimal policy while balancing exploration and exploitation. Our main result is a new model selection guarantee for…

机器学习 · 计算机科学 2019-11-15 Dylan J. Foster , Akshay Krishnamurthy , Haipeng Luo

Guided policy search is a method for reinforcement learning that trains a general policy for accomplishing a given task by guiding the learning of the policy with multiple guiding distributions. Guided policy search relies on learning an…

机器人学 · 计算机科学 2017-10-03 Connor Schenck , Dieter Fox

A context-aware recommender system (CARS) applies sensing and analysis of user context to provide personalized services. The contextual information can be driven from sensors in order to improve the accuracy of the recommendations. Yet,…

机器学习 · 计算机科学 2022-08-10 Amit Livne , Eliad Shem Tov , Adir Solomon , Achiya Elyasaf , Bracha Shapira , Lior Rokach

Most existing studies on learning local features focus on the patch-based descriptions of individual keypoints, whereas neglecting the spatial relations established from their keypoint locations. In this paper, we go beyond the local detail…

计算机视觉与模式识别 · 计算机科学 2019-04-09 Zixin Luo , Tianwei Shen , Lei Zhou , Jiahui Zhang , Yao Yao , Shiwei Li , Tian Fang , Long Quan

We study contextual dynamic pricing problems where a firm sells products to $T$ sequentially-arriving consumers, behaving according to an unknown demand model. The firm aims to minimize its regret over a clairvoyant that knows the model in…

机器学习 · 计算机科学 2025-04-07 Zifeng Zhao , Feiyu Jiang , Yi Yu

We propose a novel neural architecture search algorithm via reinforcement learning by decoupling structure and operation search processes. Our approach samples candidate models from the multinomial distribution on the policy vectors defined…

机器学习 · 计算机科学 2020-04-28 Heung-Chang Lee , Do-Guk Kim , Bohyung Han

We study the policy evaluation problem in an online multi-reward multi-policy discounted setting, where multiple reward functions must be evaluated simultaneously for different policies. We adopt an $(\epsilon,\delta)$-PAC perspective to…

机器学习 · 计算机科学 2025-08-19 Alessio Russo , Aldo Pacchiano

Linear dimensionality reduction methods are a cornerstone of analyzing high dimensional data, due to their simple geometric interpretations and typically attractive computational properties. These methods capture many data features of…

机器学习 · 统计学 2016-03-22 John P. Cunningham , Zoubin Ghahramani

Stochastic policies (also known as relaxed controls) are widely used in continuous-time reinforcement learning algorithms. However, executing a stochastic policy and evaluating its performance in a continuous-time environment remain open…

机器学习 · 计算机科学 2025-10-03 Yanwei Jia , Du Ouyang , Yufei Zhang

Policy gradient (PG) methods are successful approaches to deal with continuous reinforcement learning (RL) problems. They learn stochastic parametric (hyper)policies by either exploring in the space of actions or in the space of parameters.…

机器学习 · 计算机科学 2024-05-31 Alessandro Montenegro , Marco Mussi , Alberto Maria Metelli , Matteo Papini

Cooperative multi-agent reinforcement learning is a decentralized paradigm in sequential decision making where agents distributed over a network iteratively collaborate with neighbors to maximize global (network-wide) notions of rewards.…

机器学习 · 计算机科学 2021-09-27 Carlo Alfano , Patrick Rebeschini

Exploration is essential in reinforcement learning as an agent relies on trial and error to learn an optimal policy. However, when rewards are sparse, naive exploration strategies, like noise injection, are often insufficient. Intrinsic…

机器学习 · 计算机科学 2026-01-30 Minjae Cho , Huy Trong Tran

Natural policy gradient (NPG) methods are among the most widely used policy optimization algorithms in contemporary reinforcement learning. This class of methods is often applied in conjunction with entropy regularization -- an algorithmic…

机器学习 · 统计学 2022-09-13 Shicong Cen , Chen Cheng , Yuxin Chen , Yuting Wei , Yuejie Chi

Diversity-based approaches have recently gained popularity as an alternative paradigm to performance-based policy search. A popular approach from this family, Quality-Diversity (QD), maintains a collection of high-performing policies…

机器学习 · 计算机科学 2020-12-17 Nemanja Rakicevic , Antoine Cully , Petar Kormushev

Policy search reinforcement learning has been drawing much attention as a method of learning a robot control policy. In particular, policy search using such non-parametric policies as Gaussian process regression can learn optimal actions…

机器人学 · 计算机科学 2021-06-15 Hikaru Sasaki , Takamitsu Matsubara

Model-free deep-reinforcement-based learning algorithms have been applied to a range of COPs~\cite{bello2016neural}~\cite{kool2018attention}~\cite{nazari2018reinforcement}. However, these approaches suffer from two key challenges when…

机器学习 · 计算机科学 2022-06-01 Nasrin Sultana , Jeffrey Chan , Tabinda Sarwar , A. K. Qin