English
Related papers

Related papers: Sequential Preference-Based Optimization

200 papers

Learning of preference models from human feedback has been central to recent advances in artificial intelligence. Motivated by the cost of obtaining high-quality human annotations, we study efficient human preference elicitation for…

Machine Learning · Computer Science 2026-02-17 Subhojyoti Mukherjee , Anusha Lalitha , Kousha Kalantari , Aniket Deshmukh , Ge Liu , Yifei Ma , Branislav Kveton

Trajectory prediction is an essential step in the pipeline of an autonomous vehicle. Inaccurate or inconsistent predictions regarding the movement of agents in its surroundings lead to poorly planned maneuvers and potentially dangerous…

Machine Learning · Computer Science 2025-07-04 Caio Azevedo , Lina Achaji , Stefano Sabatini , Nicola Poerio , Grzegorz Bartyzel , Sascha Hornauer , Fabien Moutarde

Given a sequence of sets, where each set has a timestamp and contains an arbitrary number of elements, temporal sets prediction aims to predict the elements in the subsequent set. Previous studies for temporal sets prediction mainly focus…

Machine Learning · Computer Science 2023-08-29 Le Yu , Zihang Liu , Leilei Sun , Bowen Du , Chuanren Liu , Weifeng Lv

We provide a semantic framework for preference handling in answer set programming. To this end, we introduce preference preserving consequence operators. The resulting fixpoint characterizations provide us with a uniform semantic framework…

Artificial Intelligence · Computer Science 2007-05-23 Torsten Schaub , Kewen Wang

Optimization techniques play an important role in several scientific and real-world applications, thus becoming of great interest for the community. As a consequence, a number of open-source libraries are available in the literature, which…

Neural and Evolutionary Computing · Computer Science 2017-04-19 Joao Paulo Papa , Gustavo Henrique Rosa , Douglas Rodrigues , Xin-She Yang

Preference tuning is a crucial process for aligning deep generative models with human preferences. This survey offers a thorough overview of recent advancements in preference tuning and the integration of human feedback. The paper is…

Computation and Language · Computer Science 2024-11-05 Genta Indra Winata , Hanyang Zhao , Anirban Das , Wenpin Tang , David D. Yao , Shi-Xiong Zhang , Sambit Sahu

We focus on collaborative and federated black-box optimization (BBOpt), where agents optimize their heterogeneous black-box functions through collaborative sequential experimentation. From a Bayesian optimization perspective, we address the…

Machine Learning · Computer Science 2025-08-25 Raed Al Kontar

Resource-efficient training optimization techniques are becoming increasingly important as the size of large language models (LLMs) continues to grow. In particular, batch packing is commonly used in pre-training and supervised fine-tuning…

Computation and Language · Computer Science 2026-03-02 Jaekyung Cho

We propose SonOpt, the first (open source) data sonification application for monitoring the progress of bi-objective population-based optimization algorithms during search, to facilitate algorithm understanding. SonOpt provides insights…

Neural and Evolutionary Computing · Computer Science 2022-02-25 Tasos Asonitis , Richard Allmendinger , Matt Benatan , Ricardo Climent

Reinforcement Learning from Human Feedback and its variants excel in aligning with human intentions to generate helpful, harmless, and honest responses. However, most of them rely on costly human-annotated pairwise comparisons for…

Computation and Language · Computer Science 2025-02-19 Hongyu Yang , Qi Zhao , Zhenhua hu , Rui Li

Learning from human preferences is a cornerstone of aligning machine learning models with subjective human judgments. Yet, collecting such preference data is often costly and time-consuming, motivating the need for more efficient learning…

Machine Learning · Computer Science 2025-11-07 Matteo Cercola , Valeria Capretti , Simone Formentin

In this work, we present a novel human-in-the-loop framework to help the human user understand the decision making process that involves choosing preferred options. We focus on qualitative preference models over alternatives from…

Artificial Intelligence · Computer Science 2019-09-20 Joseph Allen , Ahmed Moussa , Xudong Liu

Preference Inference involves inferring additional user preferences from elicited or observed preferences, based on assumptions regarding the form of the user's preference relation. In this paper we consider a situation in which…

Logic in Computer Science · Computer Science 2024-09-18 Nic Wilson , Anne-Marie George , Barry O'Sullivan

Direct Preference Optimization (DPO) and its variants have become the de facto standards for aligning large language models (LLMs) with human preferences or specific goals. However, DPO requires high-quality preference data and suffers from…

Machine Learning · Computer Science 2024-11-12 Zhuotong Chen , Fang Liu , Jennifer Zhu , Wanyu Du , Yanjun Qi

Preference elicitation explicitly asks users what kind of recommendations they would like to receive. It is a popular technique for conversational recommender systems to deal with cold-starts. Previous work has studied selection bias in…

Information Retrieval · Computer Science 2024-05-02 Shashank Gupta , Harrie Oosterhuis , Maarten de Rijke

For a real-world decision-making problem, the reward function often needs to be engineered or learned. A popular approach is to utilize human feedback to learn a reward function for training. The most straightforward way to do so is to ask…

Machine Learning · Computer Science 2023-10-31 Xiang Ji , Huazheng Wang , Minshuo Chen , Tuo Zhao , Mengdi Wang

Bayesian optimization is an effective method for finding extrema of a black-box function. We propose a new type of Bayesian optimization for learning user preferences in high-dimensional spaces. The central assumption is that the underlying…

Machine Learning · Statistics 2020-08-17 Petrus Mikkola , Milica Todorović , Jari Järvi , Patrick Rinke , Samuel Kaski

Training reinforcement learning agents with human feedback is crucial when task objectives are difficult to specify through dense reward functions. While prior methods rely on offline trajectory comparisons to elicit human preferences, such…

Machine Learning · Computer Science 2025-10-08 Zhengran Ji , Boyuan Chen

Recent advances in computing hardware and modeling software have given rise to new applications for numerical optimization. These new applications occasionally uncover bottlenecks in existing optimization algorithms and necessitate further…

Mathematical Software · Computer Science 2024-10-18 Anugrah Jo Joshy , John T. Hwang

Can we allow humans to pick among different, yet reasonably similar, decisions? Are we able to construct optimization problems whose outcome are sets of feasible, close-to-optimal decisions for human users to pick from, instead of a single,…

Optimization and Control · Mathematics 2024-03-07 Andrea Simonetto