中文
相关论文

相关论文: Improving User Experience in Preference-Based Opti…

200 篇论文

The covariance matrix adaptation evolution strategy (CMA-ES) is one of the most successful methods for solving continuous black-box optimization problems. A practically useful aspect of the CMA-ES is that it can be used without…

神经与进化计算 · 计算机科学 2024-09-30 Masahiro Nomura , Youhei Akimoto , Isao Ono

Conversational recommender systems (CRS) dynamically obtain the user preferences via multi-turn questions and answers. The existing CRS solutions are widely dominated by deep reinforcement learning algorithms. However, deep reinforcement…

信息检索 · 计算机科学 2022-09-01 A S M Ahsan-Ul Haque , Hongning Wang

Most recommender systems optimize the model on observed interaction data, which is affected by the previous exposure mechanism and exhibits many biases like popularity bias. The loss functions, such as the mostly used pointwise Binary…

信息检索 · 计算机科学 2022-04-27 Qi Wan , Xiangnan He , Xiang Wang , Jiancan Wu , Wei Guo , Ruiming Tang

Conversational recommender systems (CRS) explicitly solicit users' preferences for improved recommendations on the fly. Most existing CRS solutions count on a single policy trained by reinforcement learning for a population of users.…

人工智能 · 计算机科学 2023-02-17 Zhendong Chu , Hongning Wang , Yun Xiao , Bo Long , Lingfei Wu

Modern machine learning uses more and more advanced optimization techniques to find optimal hyper parameters. Whenever the objective function is non-convex, non continuous and with potentially multiple local minima, standard gradient…

机器学习 · 计算机科学 2019-02-13 Eric Benhamou , Jamal Atif , Rida Laraki

Personalization in social robots refers to the ability of the robot to meet the needs and/or preferences of an individual user. Existing approaches typically rely on large language models (LLMs) to generate context-aware responses based on…

机器人学 · 计算机科学 2026-01-28 Jin Huang , Fethiye Irmak Doğan , Hatice Gunes

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is a popular method to deal with nonconvex and/or stochastic optimization problems when the gradient information is not available. Being based on the CMA-ES, the recently proposed…

神经与进化计算 · 计算机科学 2017-05-19 Ilya Loshchilov , Tobias Glasmachers , Hans-Georg Beyer

Reinforcement learning (RL) faces challenges in evaluating policy trajectories within intricate game tasks due to the difficulty in designing comprehensive and precise reward functions. This inherent difficulty curtails the broader…

人工智能 · 计算机科学 2024-07-02 Zichao Shen , Tianchen Zhu , Qingyun Sun , Shiqi Gao , Jianxin Li

Complex planning and scheduling problems have long been solved using various optimization or heuristic approaches. In recent years, imitation learning that aims to learn from expert demonstrations has been proposed as a viable alternative…

机器学习 · 计算机科学 2024-05-24 Qian Shao , Pradeep Varakantham , Shih-Fen Cheng

In this paper, we study the well-known team orienteering problem where a fleet of robots collects rewards by visiting locations. Usually, the rewards are assumed to be known to the robots; however, in applications such as environmental…

机器人学 · 计算机科学 2021-12-16 Nils Wilde , Armin Sadeghi , Stephen L. Smith

Negative user preference is an important context that is not sufficiently utilized by many existing recommender systems. This context is especially useful in scenarios where the cost of negative items is high for the users. In this work, we…

信息检索 · 计算机科学 2021-02-19 Bibek Paudel , Sandro Luck , Abraham Bernstein

Preference-based reinforcement learning (PbRL) aligns a robot behavior with human preferences via a reward function learned from binary feedback over agent behaviors. We show that dynamics-aware reward functions improve the sample…

人工智能 · 计算机科学 2024-02-29 Katherine Metcalf , Miguel Sarabia , Natalie Mackraz , Barry-John Theobald

Conversational recommendation system (CRS) is able to obtain fine-grained and dynamic user preferences based on interactive dialogue. Previous CRS assumes that the user has a clear target item. However, for many users who resort to CRS,…

信息检索 · 计算机科学 2022-02-08 Yiming Zhang , Lingfei Wu , Qi Shen , Yitong Pang , Zhihua Wei , Fangli Xu , Bo Long , Jian Pei

In practical multi-criterion decision-making, it is cumbersome if a decision maker (DM) is asked to choose among a set of trade-off alternatives covering the whole Pareto-optimal front. This is a paradox in conventional evolutionary…

神经与进化计算 · 计算机科学 2022-04-07 Ke Li , Guiyu Lai , Xin Yao

Recommender systems rely heavily on the predictive accuracy of the learning algorithm. Most work on improving accuracy has focused on the learning algorithm itself. We argue that this algorithmic focus is myopic. In particular, since…

人机交互 · 计算机科学 2018-02-22 Tobias Schnabel , Paul N. Bennett , Thorsten Joachims

In preference-based Reinforcement Learning (RL), obtaining a large number of preference labels are both time-consuming and costly. Furthermore, the queried human preferences cannot be utilized for the new tasks. In this paper, we propose…

机器学习 · 计算机科学 2024-06-06 Runze Liu , Yali Du , Fengshuo Bai , Jiafei Lyu , Xiu Li

Hyperparameters of deep neural networks are often optimized by grid search, random search or Bayesian optimization. As an alternative, we propose to use the Covariance Matrix Adaptation Evolution Strategy (CMA-ES), which is known for its…

神经与进化计算 · 计算机科学 2016-04-26 Ilya Loshchilov , Frank Hutter

This work presents a novel data-driven path planning algorithm named Instruction-Guided Probabilistic Roadmap (IG-PRM). Despite the recent development and widespread use of mobile robot navigation, the safe and effective travels of mobile…

机器人学 · 计算机科学 2025-02-25 Jiaqi Bao , Ryo Yonetani

We propose a new online learning model for learning with preference feedback. The model is especially suited for applications like web search and recommender systems, where preference data is readily available from implicit user feedback…

机器学习 · 计算机科学 2011-11-04 Pannagadatta K. Shivaswamy , Thorsten Joachims

Reward models (RMs) are essential for aligning large language models (LLMs) with human preferences to improve interaction quality. However, the real world is pluralistic, which leads to diversified human preferences with respect to…

计算与语言 · 计算机科学 2023-09-18 Pengyu Cheng , Jiawen Xie , Ke Bai , Yong Dai , Nan Du