English
Related papers

Related papers: Learning Personalized User Preference from Cold St…

200 papers

Interactive AI systems, such as recommendation engines and virtual assistants, commonly use static user profiles and predefined rules to personalize interactions. However, these methods often fail to capture the dynamic nature of user…

Human-Computer Interaction · Computer Science 2026-03-02 Liu He

Session-based recommendation aims to predict user the next action based on historical behaviors in an anonymous session. For better recommendations, it is vital to capture user preferences as well as their dynamics. Besides, user…

Information Retrieval · Computer Science 2021-06-18 Dou Hu , Lingwei Wei , Wei Zhou , Xiaoyong Huai , Zhiqi Fang , Songlin Hu

In aligning large language models (LLMs), utilizing feedback from existing advanced AI rather than humans is an important method to scale supervisory signals. However, it is highly challenging for AI to understand human intentions and…

Computation and Language · Computer Science 2024-06-18 Rong Bao , Rui Zheng , Shihan Dou , Xiao Wang , Enyu Zhou , Bo Wang , Qi Zhang , Liang Ding , Dacheng Tao

Actively inferring user preferences, for example by asking good questions, is important for any human-facing decision-making system. Active inference allows such systems to adapt and personalize themselves to nuanced individual preferences.…

Computation and Language · Computer Science 2024-06-27 Wasu Top Piriyakulkij , Volodymyr Kuleshov , Kevin Ellis

Humans are talented with the ability to perform diverse interactions in the teaching process. However, when humans want to teach AI, existing interactive systems only allow humans to perform repetitive labeling, causing an unsatisfactory…

Human-Computer Interaction · Computer Science 2022-09-07 Zhongyi Zhou

Student opinions for a course are important to educators and administrators, regardless of the type of the course or the institution. Reading and manually analyzing open-ended feedback becomes infeasible for massive volumes of comments at…

Computation and Language · Computer Science 2023-10-30 Anna Koufakou

In personalized recommendation systems, accurately capturing users' evolving interests and combining them with contextual information is a critical research area. This paper proposes a novel model called the Deep Adaptive Interest Network…

Information Retrieval · Computer Science 2024-12-25 Shuaishuai Huang , Haowei Yang , You Yao , Xueting Lin , Yuming Tu

Agents that negotiate with humans find broad applications in pedagogy and conversational AI. Most efforts in human-agent negotiations rely on restrictive menu-driven interfaces for communication. To advance the research in language-based…

Computation and Language · Computer Science 2021-03-01 Kushal Chawla , Gale Lucas , Jonathan May , Jonathan Gratch

Automatic evaluation is beneficial for open-domain dialog system development. However, standard word-overlap metrics (BLEU, ROUGE) do not correlate well with human judgements of open-domain dialog systems. In this work we propose to use the…

Computation and Language · Computer Science 2022-02-18 Sarik Ghazarian , Behnam Hedayatnia , Alexandros Papangelis , Yang Liu , Dilek Hakkani-Tur

We present a real-time front-end for voice-based conversational AI to enable natural turn-taking in two-speaker scenarios by combining primary speaker segmentation with hierarchical End-of-Turn (EOT) detection. To operate robustly in…

Machine Learning · Computer Science 2026-03-17 Karim Helwani , Hoang Do , James Luan , Sriram Srinivasan

User response prediction is essential in industrial recommendation systems, such as online display advertising. Among all the features in recommendation models, user behaviors are among the most critical. Many works have revealed that a…

Information Retrieval · Computer Science 2024-07-08 Haolin Zhou , Junwei Pan , Xinyi Zhou , Xihua Chen , Jie Jiang , Xiaofeng Gao , Guihai Chen

Turn-taking is a fundamental aspect of conversation, but current Human-Robot Interaction (HRI) systems often rely on simplistic, silence-based models, leading to unnatural pauses and interruptions. This paper investigates, for the first…

Computation and Language · Computer Science 2025-01-16 Gabriel Skantze , Bahar Irfan

Adjusting robot behavior to human preferences can require intensive human feedback, preventing quick adaptation to new users and changing circumstances. Moreover, current approaches typically treat user preferences as a reward, which…

Robotics · Computer Science 2024-10-21 Jakob Thumm , Christopher Agia , Marco Pavone , Matthias Althoff

Information Retrieval (IR) systems used in search and recommendation platforms frequently employ Learning-to-Rank (LTR) models to rank items in response to user queries. These models heavily rely on features derived from user interactions,…

Information Retrieval · Computer Science 2024-12-11 Randy Ardywibowo , Rakesh Sunki , Lucy Kuo , Sankalp Nayak

Preference elicitation explicitly asks users what kind of recommendations they would like to receive. It is a popular technique for conversational recommender systems to deal with cold-starts. Previous work has studied selection bias in…

Information Retrieval · Computer Science 2024-05-02 Shashank Gupta , Harrie Oosterhuis , Maarten de Rijke

In modern recommender systems, experimental settings typically include filtering out cold users and items based on a minimum interaction threshold. However, these thresholds are often chosen arbitrarily and vary widely across studies,…

Information Retrieval · Computer Science 2025-08-12 Danil Gusak , Nikita Sukhorukov , Evgeny Frolov

As robots and digital assistants are deployed in the real world, these agents must be able to communicate their decision-making criteria to build trust, improve human-robot teaming, and enable collaboration. While the field of explainable…

Human-Computer Interaction · Computer Science 2025-04-22 Andrew Silva , Pradyumna Tambwekar , Mariah Schrum , Matthew Gombolay

Learning from human preferences is important for language models to match human needs and to align with human and social values. Prior works have achieved remarkable successes by learning from human feedback to understand and follow…

Machine Learning · Computer Science 2023-10-19 Hao Liu , Carmelo Sferrazza , Pieter Abbeel

Customizing robotic behaviors to be aligned with diverse human preferences is an underexplored challenge in the field of embodied AI. In this paper, we present Promptable Behaviors, a novel framework that facilitates efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Minyoung Hwang , Luca Weihs , Chanwoo Park , Kimin Lee , Aniruddha Kembhavi , Kiana Ehsani

In a human-machine dialog scenario, deciding the appropriate time for the machine to take the turn is an open research problem. In contrast, humans engaged in conversations are able to timely decide when to interrupt the speaker for…

Computation and Language · Computer Science 2019-07-12 Andrei C. Coman , Koichiro Yoshino , Yukitoshi Murase , Satoshi Nakamura , Giuseppe Riccardi