English
Related papers

Related papers: Learning Personalized User Preference from Cold St…

200 papers

Robot policies need to adapt to human preferences and/or new environments. Human experts may have the domain knowledge required to help robots achieve this adaptation. However, existing works often require costly offline re-training on…

Machine Learning · Computer Science 2023-02-28 Vivek Myers , Erdem Bıyık , Dorsa Sadigh

Given a sequence of sets, where each set has a timestamp and contains an arbitrary number of elements, temporal sets prediction aims to predict the elements in the subsequent set. Previous studies for temporal sets prediction mainly focus…

Machine Learning · Computer Science 2023-08-29 Le Yu , Zihang Liu , Leilei Sun , Bowen Du , Chuanren Liu , Weifeng Lv

User preference prediction requires a comprehensive and accurate understanding of individual tastes. This includes both surface-level attributes, such as color and style, and deeper content-related aspects, such as themes and composition.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Wenyi Mo , Ying Ba , Tianyu Zhang , Yalong Bai , Biye Li

With the rise of e-commerce and short videos, online recommender systems that can capture users' interests and update new items in real-time play an increasingly important role. In both online and offline recommendation systems, the…

Information Retrieval · Computer Science 2025-05-07 Yunze Luo , Yuezihan Jiang , Yinjie Jiang , Gaode Chen , Jingchi Wang , Kaigui Bian , Peiyi Li , Qi Zhang

The study illustrates a first step towards an ongoing work aimed at developing a dataset of dialogues potentially useful for customer service conversation management between humans and AI chatbots. The approach exploits ChatGPT 3.5 to…

Human-Computer Interaction · Computer Science 2025-01-03 Alfredo Cuzzocrea , Giovanni Pilato , Pablo Garcia Bringas

Researchers have proposed to use data of human preference feedback to fine-tune text-to-image generative models. However, the scalability of human feedback collection has been limited by its reliance on manual annotation. Therefore, we…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Shuangquan Feng , Junhua Ma , Virginia R. de Sa

Millions of learners worldwide are now using intelligent tutoring systems (ITSs). At their core, ITSs rely on machine learning algorithms to track each user's changing performance level over time to provide personalized instruction.…

Machine Learning · Computer Science 2022-02-09 Robin Schmucker , Tom M. Mitchell

Data generation and labeling are usually an expensive part of learning for robotics. While active learning methods are commonly used to tackle the former problem, preference-based learning is a concept that attempts to solve the latter by…

Machine Learning · Computer Science 2018-10-11 Erdem Bıyık , Dorsa Sadigh

Reinforcement learning (RL) has shown great promise in optimizing long-term user interest in recommender systems. However, existing RL-based recommendation methods need a large number of interactions for each user to learn a robust…

Machine Learning · Computer Science 2020-12-07 Yanan Wang , Yong Ge , Li Li , Rui Chen , Tong Xu

Since its launch, ChatGPT has achieved remarkable success as a versatile conversational AI platform, drawing millions of users worldwide and garnering widespread recognition across academic, industrial, and general communities. This paper…

Human-Computer Interaction · Computer Science 2023-12-19 Yuyang Deng , Ni Zhao , Xin Huang

Preference tuning is a crucial process for aligning deep generative models with human preferences. This survey offers a thorough overview of recent advancements in preference tuning and the integration of human feedback. The paper is…

Computation and Language · Computer Science 2024-11-05 Genta Indra Winata , Hanyang Zhao , Anirban Das , Wenpin Tang , David D. Yao , Shi-Xiong Zhang , Sambit Sahu

We propose a new approach that enables end users to directly solve the cold start problem by themselves. The cold start problem is a common issue in recommender systems, and many methods have been proposed to address the problem on the…

Information Retrieval · Computer Science 2025-10-01 Ryoma Sato

Cold-start recommendation is one of the major challenges faced by recommender systems (RS). Herein, we focus on the user cold-start problem. Recently, methods utilizing side information or meta-learning have been used to model cold-start…

Information Retrieval · Computer Science 2023-09-28 Xiangyu Zhang , Zongqiang Kuang , Zehao Zhang , Fan Huang , Xianfeng Tan

One key property in recommender systems is the long-tail distribution in user-item interactions where most items only have few user feedback. Improving the recommendation of tail items can promote novelty and bring positive effects to both…

Information Retrieval · Computer Science 2022-10-11 Tieyun Qian , Yile Liang , Qing Li , Xuan Ma , Ke Sun , Zhiyong Peng

How can artificial agents learn non-reinforced preferences to continuously adapt their behaviour to a changing environment? We decompose this question into two challenges: ($i$) encoding diverse memories and ($ii$) selectively attending to…

Machine Learning · Computer Science 2022-07-29 Noor Sajid , Panagiotis Tigas , Zafeirios Fountas , Qinghai Guo , Alexey Zakharov , Lancelot Da Costa

Conversational Recommender Systems (CRSs) deliver personalised recommendations through multi-turn natural language dialogue and increasingly support both task-oriented and exploratory interactions. Yet, the factors shaping user interaction…

Human-Computer Interaction · Computer Science 2025-08-05 Raj Mahmud , Shlomo Berkovsky , Mukesh Prasad , A. Baki Kocaballi

User preference learning is generally a hard problem. Individual preferences are typically unknown even to users themselves, while the space of choices is infinite. Here we study user preference learning from information-theoretic…

Machine Learning · Computer Science 2023-11-27 Tanya Ignatenko , Kirill Kondrashov , Marco Cox , Bert de Vries

Human-AI policy specification is a novel procedure we define in which humans can collaboratively warm-start a robot's reinforcement learning policy. This procedure is comprised of two steps; (1) Policy Specification, i.e. humans specifying…

Machine Learning · Computer Science 2023-05-23 Pradyumna Tambwekar , Andrew Silva , Nakul Gopalan , Matthew Gombolay

Traditionally, most of the existing attribute learning methods are trained based on the consensus of annotations aggregated from a limited number of annotators. However, the consensus might fail in settings, especially when a wide spectrum…

Machine Learning · Computer Science 2019-06-19 Zhiyong Yang , Qianqian Xu , Xiaochun Cao , Qingming Huang

While a streaming voice assistant system has been used in many applications, this system typically focuses on unnatural, one-shot interactions assuming input from a single voice query without hesitation or disfluency. However, a common…

Computation and Language · Computer Science 2022-08-30 Shuo-yiin Chang , Bo Li , Tara N. Sainath , Chao Zhang , Trevor Strohman , Qiao Liang , Yanzhang He