English
Related papers

Related papers: Leveraging Human Feedback for Semantically-Relevan…

200 papers

Semantic Shift Detection (SSD) is the task of identifying, interpreting, and assessing the possible change over time in the meanings of a target word. Traditionally, SSD has been addressed by linguists and social scientists through manual…

Computation and Language · Computer Science 2024-06-12 Stefano Montanelli , Francesco Periti

Assistance robots have gained widespread attention in various industries such as logistics and human assistance. The tasks of guiding or following a human in a crowded environment such as airports or train stations to carry weight or goods…

Robotics · Computer Science 2022-06-14 Linh Kästner , Bassel Fatloun , Zhengcheng Shen , Daniel Gawrisch , Jens Lambrecht

Semantic novelty detection aims at discovering unknown categories in the test data. This task is particularly relevant in safety-critical applications, such as autonomous driving or healthcare, where it is crucial to recognize unknown…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Francesco Cappio Borlino , Silvia Bucci , Tatiana Tommasi

We introduce Large Language Model-Assisted Preference Prediction (LAPP), a novel framework for robot learning that enables efficient, customizable, and expressive behavior acquisition with minimum human effort. Unlike prior approaches that…

Robotics · Computer Science 2025-04-23 Pingcheng Jian , Xiao Wei , Yanbaihui Liu , Samuel A. Moore , Michael M. Zavlanos , Boyuan Chen

We develop an online learning algorithm that dramatically improves the data efficiency of reinforcement learning from human feedback (RLHF). Our algorithm incrementally updates reward and language models as choice data is received. The…

Preference-based reinforcement learning (PbRL) provides a powerful paradigm to avoid meticulous reward engineering by learning rewards based on human preferences. However, real-time human feedback is hard to obtain in online tasks. Most…

Machine Learning · Computer Science 2024-12-24 Songjun Tu , Jingbo Sun , Qichao Zhang , Xiangyuan Lan , Dongbin Zhao

Diverse decoding of large language models is crucial for applications requiring multiple semantically distinct responses, yet existing methods primarily achieve lexical rather than semantic diversity. This limitation significantly…

Computation and Language · Computer Science 2025-09-30 Weijie Shi , Yue Cui , Yaguang Wu , Jingzhi Fang , Shibo Zhang , Mengze Li , Sirui Han , Jia Zhu , Jiajie Xu , Xiaofang Zhou

Reward models (RMs) are essential for aligning large language models (LLMs) with human preferences to improve interaction quality. However, the real world is pluralistic, which leads to diversified human preferences with respect to…

Computation and Language · Computer Science 2023-09-18 Pengyu Cheng , Jiawen Xie , Ke Bai , Yong Dai , Nan Du

Job recommendation aims to provide potential talents with suitable job descriptions (JDs) consistent with their career trajectory, which plays an essential role in proactive talent recruitment. In real-world management scenarios, the…

Information Retrieval · Computer Science 2024-04-09 Zhihao Guan , Jia-Qi Yang , Yang Yang , Hengshu Zhu , Wenjie Li , Hui Xiong

Recent advancements in explainable recommendation have greatly bolstered user experience by elucidating the decision-making rationale. However, the existing methods actually fail to provide effective feedback signals for potentially better…

Information Retrieval · Computer Science 2025-08-08 Jiakai Tang , Jingsen Zhang , Zihang Tian , Xueyang Feng , Lei Wang , Xu Chen

This paper presents Scalable Semantic Transfer (SST), a novel training paradigm, to explore how to leverage the mutual benefits of the data from different label domains (i.e. various levels of label granularity) to train a powerful human…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Jie Yang , Chaoqun Wang , Zhen Li , Junle Wang , Ruimao Zhang

Reinforcement learning based fine-tuning of large language models (LLMs) on human preferences has been shown to enhance both their capabilities and safety behavior. However, in cases related to safety, without precise instructions to human…

Artificial Intelligence · Computer Science 2024-11-05 Tong Mu , Alec Helyar , Johannes Heidecke , Joshua Achiam , Andrea Vallone , Ian Kivlichan , Molly Lin , Alex Beutel , John Schulman , Lilian Weng

Reinforcement Learning (RL) can be extremely effective in solving complex, real-world problems. However, injecting human knowledge into an RL agent may require extensive effort and expertise on the human designer's part. To date, human…

Artificial Intelligence · Computer Science 2018-05-16 Ariel Rosenfeld , Moshe Cohen , Matthew E. Taylor , Sarit Kraus

In Reinforcement Learning from Human Feedback (RLHF), it is crucial to learn suitable reward models from human feedback to align large language models (LLMs) with human intentions. However, human feedback can often be noisy, inconsistent,…

Artificial Intelligence · Computer Science 2025-09-03 Taywon Min , Haeone Lee , Yongchan Kwon , Kimin Lee

Re-inforcement learning from human feedback (RLHF) has been effective in the task of AI alignment. However, one of the key assumptions of RLHF is that the annotators (referred to as workers from here on out) have a homogeneous response…

Human-Computer Interaction · Computer Science 2026-01-29 Sarvesh Shashidhar , Abhishek Mishra , Madhav Kotecha

The embedded sensors in widely used smartphones and other wearable devices make the data of human activities more accessible. However, recognizing different human activities from the wearable sensor data remains a challenging research…

Machine Learning · Computer Science 2023-07-25 Taoran Sheng , Manfred Huber

Reinforcement Learning from Human Feedback (RLHF) is crucial for aligning large language models with human preferences. While recent research has focused on algorithmic improvements, the importance of prompt-data construction has been…

Machine Learning · Computer Science 2025-04-03 Wei Shen , Guanlin Liu , Zheng Wu , Ruofei Zhu , Qingping Yang , Chao Xin , Yu Yue , Lin Yan

Human feedback can greatly accelerate robot learning, but in real-world settings, such feedback is costly and limited. Existing human-in-the-loop reinforcement learning (HiL-RL) methods often assume abundant feedback, limiting their…

Robotics · Computer Science 2025-09-26 Anujith Muraleedharan , Anamika J H

In this paper, we introduce an attribute-based interactive image search which can leverage human-in-the-loop feedback to iteratively refine image search results. We study active image search where human feedback is solicited exclusively in…

Computer Vision and Pattern Recognition · Computer Science 2018-09-25 Bryan A. Plummer , M. Hadi Kiapour , Shuai Zheng , Robinson Piramuthu

This paper revisits datasets and evaluation criteria for Symbolic Regression (SR), specifically focused on its potential for scientific discovery. Focused on a set of formulas used in the existing datasets based on Feynman Lectures on…

Machine Learning · Computer Science 2025-01-06 Yoshitomo Matsubara , Naoya Chiba , Ryo Igarashi , Yoshitaka Ushiku