English
Related papers

Related papers: Vibrotactile Preference Learning: Uncertainty-Awar…

200 papers

In practice, preference learning from human feedback depends on incomplete data with hidden context. Hidden context refers to data that affects the feedback received, but which is not represented in the data used to train a preference…

Machine Learning · Computer Science 2024-04-18 Anand Siththaranjan , Cassidy Laidlaw , Dylan Hadfield-Menell

Reinforcement Learning (RL) algorithms suffer from the dependency on accurately engineered reward functions to properly guide the learning agents to do the required tasks. Preference-based reinforcement learning (PbRL) addresses that by…

Artificial Intelligence · Computer Science 2024-08-23 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

Learning from preference feedback has emerged as an essential step for improving the generation quality and performance of modern language models (LMs). Despite its widespread use, the way preference-based learning is applied varies wildly,…

Computation and Language · Computer Science 2024-10-10 Hamish Ivison , Yizhong Wang , Jiacheng Liu , Zeqiu Wu , Valentina Pyatkin , Nathan Lambert , Noah A. Smith , Yejin Choi , Hannaneh Hajishirzi

There is a growing interest in developing automated agents that can work alongside humans. In addition to completing the assigned task, such an agent will undoubtedly be expected to behave in a manner that is preferred by the human. This…

Artificial Intelligence · Computer Science 2023-02-02 Utkarsh Soni , Nupur Thakur , Sarath Sreedharan , Lin Guan , Mudit Verma , Matthew Marquez , Subbarao Kambhampati

Learning a reward function from human preferences is challenging as it typically requires having a high-fidelity simulator or using expensive and potentially unsafe actual physical rollouts in the environment. However, in many tasks the…

Machine Learning · Computer Science 2023-01-05 Daniel Shin , Anca D. Dragan , Daniel S. Brown

We investigate a learning decision support system for vehicle routing, where the routing engine learns implicit preferences that human planners have when manually creating route plans (or routings). The goal is to use these learned…

Artificial Intelligence · Computer Science 2021-01-12 Rocsildes Canoy , Víctor Bucarey , Jayanta Mandi , Tias Guns

This work addresses the challenge of personalizing trajectories generated in automated decision-making systems by introducing a resource-efficient approach that enables rapid adaptation to individual users' preferences. Our method leverages…

Machine Learning · Computer Science 2025-03-25 Wen Zheng Terence Ng , Jianda Chen , Yuan Xu , Tianwei Zhang

Text--image retrieval is necessary for applications such as product recommendation. Embedding-based approaches like CLIP enable efficient large-scale retrieval via vector similarity search, but they are primarily trained on literal…

Information Retrieval · Computer Science 2025-10-15 Eric He , Akash Gupta , Adian Liusie , Vatsal Raina , Piotr Molenda , Shirom Chabra , Vyas Raina

Traditionally, most of the existing attribute learning methods are trained based on the consensus of annotations aggregated from a limited number of annotators. However, the consensus might fail in settings, especially when a wide spectrum…

Machine Learning · Computer Science 2019-06-19 Zhiyong Yang , Qianqian Xu , Xiaochun Cao , Qingming Huang

Tactile information is a critical tool for dexterous manipulation. As humans, we rely heavily on tactile information to understand objects in our environments and how to interact with them. We use touch not only to perform manipulation…

Robotics · Computer Science 2024-09-30 Abraham George , Selam Gano , Pranav Katragadda , Amir Barati Farimani

The integration of extra-robotic limbs/fingers to enhance and expand motor skills, particularly for grasping and manipulation, possesses significant challenges. The grasping performance of existing limbs/fingers is far inferior to that of…

Robotics · Computer Science 2025-03-20 Naqash Afzal , Basma Hasanen , Lakmal Seneviratne , Oussama Khatib , Irfan Hussain

Recommendation services are extensively adopted in several user-centered applications as a tool to alleviate the information overload problem and help users in orienteering in a vast space of possible choices. In such scenarios, data…

Machine Learning · Computer Science 2020-12-23 Vito Walter Anelli , Yashar Deldjoo , Tommaso Di Noia , Antonio Ferrara , Fedelucio Narducci

Spatialized vibrotactile feedback systems deliver tactile information by placing multiple vibrotactile actuators on the body. As increasing numbers of actuators are required to adequately convey information in complicated applications,…

Human-Computer Interaction · Computer Science 2025-02-14 Bingjian Huang , Siyi Ren , Yuewen Luo , Qilong Cheng , Hanfeng Cai , Yeqi Sang , Mauricio Sousa , Paul H. Dietz , Daniel Wigdor

User-centric recommendation has become essential for delivering personalized services, as it enables systems to adapt to users' evolving behaviors while respecting their long-term preferences and privacy constraints. Although federated…

Information Retrieval · Computer Science 2026-03-19 Chunxu Zhang , Zhiheng Xue , Guodong Long , Weipeng Zhang , Bo Yang

Physically Assistive Robots (PARs) require personalized behaviors to ensure user safety and comfort. However, traditional preference learning methods, like exhaustive pairwise comparisons, cause severe physical and cognitive fatigue for…

Robotics · Computer Science 2026-04-03 Keshav Shankar , Dan Ding , Wei Gao

We consider the problem of learning preferences over trajectories for mobile manipulators such as personal robots and assembly line robots. The preferences we learn are more intricate than simple geometric constraints on trajectories; they…

Robotics · Computer Science 2016-01-06 Ashesh Jain , Shikhar Sharma , Thorsten Joachims , Ashutosh Saxena

Understanding human preferences is crucial for improving foundation models and building personalized AI systems. However, preferences are inherently diverse and complex, making it difficult for traditional reward models to capture their…

Artificial Intelligence · Computer Science 2025-06-12 Feng Luo , Rui Yang , Hao Sun , Chunyuan Deng , Jiarui Yao , Jingyan Shen , Huan Zhang , Hanjie Chen

Communicating information to users is a crucial aspect of human-machine interaction. Vibrotactile feedback encodes information into spatiotemporal vibrations, enabling users to perceive tactile sensations. It offers advantages such as…

Robotics · Computer Science 2024-09-16 Jingchen Huang , Yun Fang , Weichao Guo , Xinjun Sheng

Traditional recommender systems (RecSys) primarily infer user preferences from implicit signals (such as clicks, watches, and purchases), often neglecting the rich explicit contextual feedback users provide through verbal text, like…

This paper investigates how large language models (LLMs) can enhance recommender systems, with a specific focus on Conversational Recommender Systems that leverage user preferences and personalised candidate selections from existing ranking…

Information Retrieval · Computer Science 2023-09-08 Mateo Gutierrez Granada , Dina Zilbershtein , Daan Odijk , Francesco Barile