中文
相关论文

相关论文: IMO$^3$: Interactive Multi-Objective Off-Policy Op…

200 篇论文

The majority of multi-agent system (MAS) implementations aim to optimise agents' policies with respect to a single objective, despite the fact that many real-world problem domains are inherently multi-objective in nature. Multi-objective…

多智能体系统 · 计算机科学 2020-11-17 Roxana Rădulescu , Patrick Mannion , Diederik M. Roijers , Ann Nowé

Sequential decision-making problems with multiple objectives arise naturally in practice and pose unique challenges for research in decision-theoretic planning and learning, which has largely focused on single-objective settings. This…

人工智能 · 计算机科学 2014-02-05 Diederik Marijn Roijers , Peter Vamplew , Shimon Whiteson , Richard Dazeley

By reusing data throughout training, off-policy deep reinforcement learning algorithms offer improved sample efficiency relative to on-policy approaches. For continuous action spaces, the most popular methods for off-policy learning include…

机器学习 · 计算机科学 2023-12-01 Jared Markowitz , Jesse Silverberg , Gary Collins

The option framework has shown great promise by automatically extracting temporally-extended sub-tasks from a long-horizon task. Methods have been proposed for concurrently learning low-level intra-option policies and high-level option…

人工智能 · 计算机科学 2020-06-26 Chenghao Li , Xiaoteng Ma , Chongjie Zhang , Jun Yang , Li Xia , Qianchuan Zhao

Design problems in industrial engineering often involve a large number of design variables with multiple objectives, under complex nonlinear constraints. The algorithms for multiobjective problems can be significantly different from the…

最优化与控制 · 数学 2013-03-27 Xin-She Yang

We study the problem of optimizing nonlinear objective functions over bipartite matchings. While the problem is generally intractable, we provide several efficient algorithms for it, including a deterministic algorithm for maximizing convex…

最优化与控制 · 数学 2008-07-24 Yael Berstein , Shmuel Onn

In multiobjective optimization, the result of an optimization algorithm is a set of efficient solutions from which the decision maker selects one. It is common that not all the efficient solutions can be computed in a short time and the…

神经与进化计算 · 计算机科学 2024-03-20 Miguel Ángel Domínguez-Ríos , Francisco Chicano , Enrique Alba

Off-policy estimation (OPE) methods enable unbiased offline evaluation of recommender systems, directly estimating the online reward some target policy would have obtained, from offline data and with statistical guarantees. The theoretical…

机器学习 · 统计学 2025-08-12 Olivier Jeunen

Multi-objective optimization (MOO) is a well-studied problem for several important recommendation problems. While multiple approaches have been proposed, in this work, we focus on using constrained optimization formulations (e.g., quadratic…

应用统计 · 统计学 2016-02-16 Kinjal Basu , Ankan Saha , Shaunak Chatterjee

This paper studies the off-policy evaluation problem, where one aims to estimate the value of a target policy based on a sample of observations collected by another policy. We first consider the multi-armed bandit case, establish a minimax…

人工智能 · 计算机科学 2014-09-15 Lihong Li , Remi Munos , Csaba Szepesvari

Offline policy evaluation (OPE) allows us to evaluate and estimate a new sequential decision-making policy's performance by leveraging historical interaction data collected from other policies. Evaluating a new policy online without a…

机器学习 · 计算机科学 2024-11-04 Allen Nie , Yash Chandak , Christina J. Yuan , Anirudhan Badrinath , Yannis Flet-Berliac , Emma Brunskil

Evaluating a policy by deploying it in the real world can be risky and costly. Off-policy policy evaluation (OPE) algorithms use historical data collected from running a previous policy to evaluate a new policy, which provides a means for…

人工智能 · 计算机科学 2017-12-07 Zhaohan Daniel Guo , Philip S. Thomas , Emma Brunskill

Solving multi-objective optimization problems is important in various applications where users are interested in obtaining optimal policies subject to multiple, yet often conflicting objectives. A typical approach to obtain optimal policies…

系统与控制 · 电气工程与系统科学 2019-10-07 Huixin Zhan , Yongcan Cao

The objective of offline RL is to learn optimal policies when a fixed exploratory demonstrations data-set is available and sampling additional observations is impossible (typically if this operation is either costly or rises ethical…

机器学习 · 计算机科学 2021-06-10 Firas Jarboui , Vianney Perchet

Offline policy optimization could have a large impact on many real-world decision-making problems, as online learning may be infeasible in many applications. Importance sampling and its variants are a commonly used type of estimator in…

机器学习 · 计算机科学 2022-07-05 Yao Liu , Yannis Flet-Berliac , Emma Brunskill

The Internet of Mirrors (IoM) is an emerging IoT ecosystem of interconnected smart mirrors designed to deliver personalised services across a three-tier node hierarchy spanning consumer, professional, and hub nodes. Determining where…

网络与互联网体系结构 · 计算机科学 2026-03-10 Haneen Fatima , Muhammad Ali Imran , Ahmad Taha , Lina Mohjazi

Policy-based methods have achieved remarkable success in solving challenging reinforcement learning problems. Among these methods, off-policy policy gradient methods are particularly important due to that they can benefit from off-policy…

机器学习 · 计算机科学 2024-05-07 Wenjia Meng , Qian Zheng , Long Yang , Yilong Yin , Gang Pan

Real-world user requests to LLM agents are often underspecified. Agents must interact to acquire missing information and make correct downstream decisions. However, current multi-turn GRPO-based methods often rely on trajectory-level reward…

人工智能 · 计算机科学 2026-03-03 Fanqi Kong , Jiayi Zhang , Mingyi Deng , Chenglin Wu , Yuyu Luo , Bang Liu

Proximal policy optimization (PPO) is one of the most popular state-of-the-art on-policy algorithms that has become a standard baseline in modern reinforcement learning with applications in numerous fields. Though it delivers stable…

机器学习 · 计算机科学 2025-02-25 Qisai Liu , Zhanhong Jiang , Hsin-Jung Yang , Mahsa Khosravi , Joshua R. Waite , Soumik Sarkar

Many engineering problems have multiple objectives, and the overall aim is to optimize a non-linear function of these objectives. In this paper, we formulate the problem of maximizing a non-linear concave function of multiple long-term…

机器学习 · 计算机科学 2025-09-23 Qinbo Bai , Mridul Agarwal , Vaneet Aggarwal