English
Related papers

Related papers: Multi-Objective Recommendation via Multivariate Po…

200 papers

We study multi-objective reinforcement learning with nonlinear preferences over trajectories. That is, we maximize the expected value of a nonlinear function over accumulated rewards (expected scalarized return or ESR) in a multi-objective…

Machine Learning · Computer Science 2025-02-19 Nianli Peng , Muhang Tian , Brandon Fain

Policy learning can be used to extract individualized treatment regimes from observational data in healthcare, civics, e-commerce, and beyond. One big hurdle to policy learning is a commonplace lack of overlap in the data for different…

Machine Learning · Statistics 2020-12-04 Nathan Kallus

Solving multi-objective optimization problems is important in various applications where users are interested in obtaining optimal policies subject to multiple, yet often conflicting objectives. A typical approach to obtain optimal policies…

Systems and Control · Electrical Eng. & Systems 2019-10-07 Huixin Zhan , Yongcan Cao

Large language models (LLMs) are currently aligned using techniques such as reinforcement learning from human feedback (RLHF). However, these methods use scalar rewards that can only reflect user preferences on average. Pluralistic…

Computation and Language · Computer Science 2025-08-13 Jadie Adams , Brian Hu , Emily Veenhuis , David Joy , Bharadwaj Ravichandran , Aaron Bray , Anthony Hoogs , Arslan Basharat

Multi-objective Markov decision processes are a special kind of multi-objective optimization problem that involves sequential decision making while satisfying the Markov property of stochastic processes. Multi-objective reinforcement…

Machine Learning · Computer Science 2023-08-22 Sherif Abdelfattah , Kathryn Kasmarik , Jiankun Hu

Sequential decision-making problems with multiple objectives arise naturally in practice and pose unique challenges for research in decision-theoretic planning and learning, which has largely focused on single-objective settings. This…

Artificial Intelligence · Computer Science 2014-02-05 Diederik Marijn Roijers , Peter Vamplew , Shimon Whiteson , Richard Dazeley

In order to truly understand how social media might shape online discourses or contribute to societal polarization, we need refined models of platform choice, that is: models that help us understand why users prefer one social media…

Adaptation and Self-Organizing Systems · Physics 2024-11-08 Sven Banisch , Dennis Jacob , Tom Willaert , Eckehard Olbrich

Efficiently allocating incoming jobs to nodes in large-scale clusters can lead to substantial improvements in both cluster utilization and job performance. In order to allocate incoming jobs, cluster schedulers usually rely on a set of…

Machine Learning · Computer Science 2026-03-12 Martin Asenov , Qiwen Deng , Gingfung Yeung , Adam Barker

Recommender Systems today are still mostly evaluated in terms of accuracy, with other aspects beyond the immediate relevance of recommendations, such as diversity, long-term user retention and fairness, often taking a back seat. Moreover,…

The beneficial effects of treatments vary across individuals in most studies. Treatment heterogeneity motivates practitioners to search for the optimal policy based on personal characteristics. A long-standing common practice in policy…

Statistics Theory · Mathematics 2025-01-06 Xuqiao Li , Ying Yan

In many real-world applications of reinforcement learning (RL), deployed policies have varied impacts on different stakeholders, creating challenges in reaching consensus on how to effectively aggregate their preferences. Generalized…

Machine Learning · Computer Science 2025-07-17 Cheol Woo Kim , Jai Moondra , Shresth Verma , Madeleine Pollack , Lingkai Kong , Milind Tambe , Swati Gupta

Recent multi-task learning studies suggest that linear scalarization, when using well-chosen fixed task weights, can achieve comparable to or even better performance than complex multi-task optimization (MTO) methods. It remains unclear why…

Machine Learning · Computer Science 2025-08-20 Yi Yang , Kei Ikemura , Qingwen Zhang , Xiaomeng Zhu , Ci Li , Nazre Batool , Sina Sharif Mansouri , John Folkesson

The main challenge of multiagent reinforcement learning is the difficulty of learning useful policies in the presence of other simultaneously learning agents whose changing behaviors jointly affect the environment's transition and reward…

We learn about the world from a diverse range of sensory information. Automated systems lack this ability as investigation has centred on processing information presented in a single form. Adapting architectures to learn from multiple…

Machine Learning · Computer Science 2020-10-27 Jason Armitage , Shramana Thakur , Rishi Tripathi , Jens Lehmann , Maria Maleshkova

The open-ended generation in LLMs usually requires multi-dimensional rubrics to adequately assess quality and guide the improvement of reinforcement learning. However, a critical dilemma inherent in this training paradigm is the imbalanced…

Machine Learning · Computer Science 2026-05-27 Yu Huang , Zihua Zhao , Zhaoxin Huan , Wanli Gu , Feng Hong , Xinmu Ge , Lin Yuan , Weichang Wu , Qiang Hu , Xiaolu Zhang , Jun Zhou , Jiangchao Yao

Multi-objective reinforcement learning (MORL) is used to solve problems involving multiple objectives. An MORL agent must make decisions based on the diverse signals provided by distinct reward functions. Training an MORL agent yields a set…

Artificial Intelligence · Computer Science 2024-11-08 Zuzanna Osika , Jazmin Zatarain-Salazar , Frans A. Oliehoek , Pradeep K. Murukannaiah

The goal of probabilistic prediction is to issue predictive distributions that are as informative as possible, subject to being calibrated. Despite substantial progress in the univariate setting, achieving multivariate calibration remains…

Machine Learning · Computer Science 2026-02-02 Aya Laajil , Elnura Zhalieva , Naomi Desobry , Souhaib Ben Taieb

Designing a multi-layer optical system with designated optical characteristics is an inverse design problem in which the resulting design is determined by several discrete and continuous parameters. In particular, we consider three design…

Machine Learning · Computer Science 2021-11-17 Heribert Wankerl , Maike L. Stern , Ali Mahdavi , Christoph Eichler , Elmar W. Lang

Fashion is a unique domain for developing recommender systems (RS). Personalization is critical to fashion users. As a result, highly accurate recommendations are not sufficient unless they are also specific to users. Moreover, fashion data…

Information Retrieval · Computer Science 2019-09-11 Jake Sherman , Chinmay Shukla , Rhonda Textor , Su Zhang , Amy A. Winecoff

In this paper, we aim to utilize only offline trajectory data to train a policy for multi-objective RL. We extend the offline policy-regularized method, a widely-adopted approach for single-objective offline RL problems, into the…

Machine Learning · Computer Science 2024-01-05 Qian Lin , Chao Yu , Zongkai Liu , Zifan Wu